Overview and Access Points

Overview

The Brain Data Science Platform (BDSP) organizes projects into access levels. Understanding which access point to use depends on both the access level (Open, Restricted, Credentialed) and the type of data (publication-specific vs. large repository).

Important: Credentialed access data uses TWO different access points depending on the project type. See below for details.

To request access: Go to the project page for a specific dataset and follow the required instructions:

  • Open Access: No special requirements - data is publicly available
  • Restricted Access: Requires AWS account registration + Data Use Agreement (DUA)
  • Credentialed Access: Requires AWS account + DUA + CITI training certification

Available Access Points

Access Level Access Point Name Contains
Open bdsp-open-access-point Open access publication datasets
Restricted bdsp-restricted-access-point Restricted access publication datasets
Credentialed bdsp-credentialed-access-point Large repositories (EEG, ECG, PSG, EHR, Imaging)
bdsp-credentialed-projects-ap Publication-specific credentialed datasets

Scroll down to see the complete list of projects available at each access point.


Open Access Projects


Open Access Projects

Access Point: bdsp-open-access-point
Bucket: bdsp-opendata-unrestricted
Access Level: Open - No restrictions

List all available open access projects:

aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-open-access-point/

1. The Human Burst Suppression Electroencephalogram of Deep Hypothermia

Version: 1.0
Folder: hypothermia/

# List files
aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-open-access-point/hypothermia/

# Download entire dataset
aws s3 cp s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-open-access-point/hypothermia/ /your_local_path/ --recursive
Note: Several open access projects are currently being migrated to this access point. If you don't see a project you were approved for, please contact support@bdsp.io.

Restricted Access Projects


Restricted Access Projects

Access Point: bdsp-restricted-access-point
Bucket: bdsp-opendata-restricted
Access Level: Restricted - Requires AWS account + Data Use Agreement

List all available restricted access projects:

aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/

1. I-CARE - International Cardiac Arrest REsearch consortium EEG Database

Version: 1.0
Folders: i-care/ and ICARE_train/

# List files
aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/i-care/
aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/ICARE_train/

# Download datasets
aws s3 cp s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/i-care/ /your_local_path/ --recursive
aws s3 cp s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/ICARE_train/ /your_local_path/ --recursive

2. SPaRCNet - Seizures, Rhythmic and Periodic Patterns in ICU

Version: 1.1
Folders: sparcnet/ and sparcnet_data/

aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/sparcnet/
aws s3 cp s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/sparcnet/ /your_local_path/ --recursive

3. Real-Time Segmentation of Burst Suppression Patterns

Version: 1.0
Folder: burst-supression/

aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/burst-supression/
aws s3 cp s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/burst-supression/ /your_local_path/ --recursive

4. Complete AI Sleep Report (CAISR)

Version: 1.0
Folder: caisr/

aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/caisr/
aws s3 cp s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/caisr/ /your_local_path/ --recursive

5. Cyclops - Automated Detection of Interictal Epileptiform Discharges

Version: 2.0
Folder: cyclops/

aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/cyclops/
aws s3 cp s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/cyclops/ /your_local_path/ --recursive

6. E-CAM-S - Physiological Assessment of Delirium Severity

Version: 1.0
Folder: e-cam-s/

aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/e-cam-s/
aws s3 cp s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/e-cam-s/ /your_local_path/ --recursive

7. Quantifying Loop Gain using Dynamical Modelling

Version: 2.0
Folder: LG_estimation/

aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/LG_estimation/
aws s3 cp s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/LG_estimation/ /your_local_path/ --recursive

8. Sleep Recordings from Wearable Devices in Meditators

Version: 1.0
Folder: meditation-bai/

aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/meditation-bai/
aws s3 cp s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/meditation-bai/ /your_local_path/ --recursive

9. Ordinal Sleep Depth - Data and Code

Version: 1.0
Folder: regmet/

aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/regmet/
aws s3 cp s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/regmet/ /your_local_path/ --recursive

10. Continuous EEG Predicts Delayed Cerebral Ischemia After SAH

Version: 1.0
Folder: sah/

aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/sah/
aws s3 cp s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/sah/ /your_local_path/ --recursive

11. Morphological Prediction of CPAP Associated Acute Respiratory Events

Version: 1.0
Folder: self-sim/

aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/self-sim/
aws s3 cp s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/self-sim/ /your_local_path/ --recursive

12. SpikeNet 2.0

Version: 1.0
Folder: spikenet2/

aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/spikenet2/
aws s3 cp s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/spikenet2/ /your_local_path/ --recursive

13. TEEGLLTEEG - This EEG Looks Like That EEG

Version: 1.2
Folder: teegllteeg/

aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/teegllteeg/
aws s3 cp s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/teegllteeg/ /your_local_path/ --recursive

14. Transcranial Magnetic Stimulation in Alzheimer's Disease

Version: 1.0
Folder: tms-ad/

aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/tms-ad/
aws s3 cp s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/tms-ad/ /your_local_path/ --recursive

Credentialed Access - Large Repositories


Credentialed Access - Large Repositories

Access Point: bdsp-credentialed-access-point
Bucket: bdsp-opendata-repository
Access Level: Credentialed - Requires AWS account + DUA + CITI training

What are Large Repositories? These are comprehensive databases organized by data modality (EEG, ECG, PSG, etc.) that contain large volumes of clinical data. They differ from publication-specific datasets in scale and organization.

List all available repositories:

aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-credentialed-access-point/

1. Harvard Electroencephalography Database (v4.1)

Repository Folder: EEG/
Description: Large-scale EEG repository containing thousands of clinical EEG recordings

# List EEG repository contents
aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-credentialed-access-point/EEG/

# Download entire EEG repository
aws s3 cp s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-credentialed-access-point/EEG/ /your_local_path/ --recursive

# Browse specific subfolders
aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-credentialed-access-point/EEG/bids/
aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-credentialed-access-point/EEG/eeg-metadata/

2. Harvard-Emory ECG Database (HEEDB v4.0)

Repository Folder: ECG/
Description: Comprehensive ECG waveform database

# List ECG repository contents
aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-credentialed-access-point/ECG/

# Download entire ECG repository
aws s3 cp s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-credentialed-access-point/ECG/ /your_local_path/ --recursive

3. Polysomnography (PSG) Repository

Repository Folder: PSG/
Description: Contains multiple PSG datasets including:

  • The Human Sleep Project (v2.0)
  • The Boston Children's Hospital Sleep Corpus (v1.0.1)
# List PSG repository contents
aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-credentialed-access-point/PSG/

# Download entire PSG repository
aws s3 cp s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-credentialed-access-point/PSG/ /your_local_path/ --recursive

# Browse specific subfolders
aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-credentialed-access-point/PSG/bids/
aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-credentialed-access-point/PSG/psg-metadata/

4. Electronic Health Records (EHR) Repository

Repository Folder: EHR/
Description: Electronic health record data repository

# List EHR repository contents
aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-credentialed-access-point/EHR/

# Download entire EHR repository
aws s3 cp s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-credentialed-access-point/EHR/ /your_local_path/ --recursive

5. Neuroimaging Repository (BIND Database)

Repository Folder: Imaging/
Description: The Brain Imaging and Neurophysiology Database (BIND) - Neuroimaging data repository

# List Imaging repository contents
aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-credentialed-access-point/Imaging/

# Download entire Imaging repository
aws s3 cp s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-credentialed-access-point/Imaging/ /your_local_path/ --recursive

Credentialed Access - Publication-Specific Projects


Credentialed Access - Publication-Specific Projects

Access Point: bdsp-credentialed-projects-ap
Bucket: bdsp-opendata-credentialed
Access Level: Credentialed - Requires AWS account + DUA + CITI training

What are Publication-Specific Projects? These are focused datasets associated with specific research publications, typically smaller in scope than large repositories and organized by project slug.

List all available publication-specific credentialed projects:

aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-credentialed-projects-ap/

1. Philosopher's Stone

Version: 1.0.0
Folder: philosoph/

aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-credentialed-projects-ap/philosoph/
aws s3 cp s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-credentialed-projects-ap/philosoph/ /your_local_path/ --recursive

2. Automated Estimation of Frequency and Spatial Extent of Periodic Patterns

Version: 1.0.0
Folder: iiic-freq2/

aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-credentialed-projects-ap/iiic-freq2/
aws s3 cp s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-credentialed-projects-ap/iiic-freq2/ /your_local_path/ --recursive
Note: Several publication-specific credentialed projects are currently being migrated to this access point. If you don't see a project you were approved for, it may be using an individual access point. Please check your approval email for project-specific access instructions or contact support@bdsp.io.

General Usage Instructions


General Usage Instructions

Prerequisites

  1. AWS Account: Create an AWS account at https://aws.amazon.com/
  2. Add AWS Account ID: Log into BDSP and add your 12-digit AWS Account ID to your profile at https://bdsp.io/settings/cloud/
  3. Request Dataset Access: Navigate to each dataset's project page and click "Request Access"
    • For restricted access: Sign the Data Use Agreement (DUA)
    • For credentialed access: Sign DUA AND upload CITI training certificate
  4. Install AWS CLI: Download from https://aws.amazon.com/cli/
  5. Configure AWS Credentials: Run aws configure and enter your AWS access key and secret key

Verify Your AWS Identity

Before accessing data, verify your AWS credentials are configured correctly:

aws sts get-caller-identity

This should display your AWS Account ID, which must match the ID you added to your BDSP profile.

Common Commands

List Files in a Dataset

aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/[ACCESS-POINT-NAME]/[FOLDER-NAME]/

Download an Entire Dataset

aws s3 cp s3://arn:aws:s3:us-east-1:184438910517:accesspoint/[ACCESS-POINT-NAME]/[FOLDER-NAME]/ /your_local_path/ --recursive

Download a Specific File

aws s3 cp s3://arn:aws:s3:us-east-1:184438910517:accesspoint/[ACCESS-POINT-NAME]/[FOLDER-NAME]/[FILE-PATH] /your_local_path/

Sync a Dataset (Only Download New/Changed Files)

aws s3 sync s3://arn:aws:s3:us-east-1:184438910517:accesspoint/[ACCESS-POINT-NAME]/[FOLDER-NAME]/ /your_local_path/

Examples by Access Level

Example: Open Access

# List files in Deep Hypothermia project
aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-open-access-point/hypothermia/

# Download the project
aws s3 cp s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-open-access-point/hypothermia/ ./hypothermia/ --recursive

Example: Restricted Access

# List files in I-CARE project
aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/i-care/

# Download the project
aws s3 cp s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-restricted-access-point/i-care/ ./icare/ --recursive

Example: Credentialed Access - Large Repository

# List contents of EEG repository
aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-credentialed-access-point/EEG/

# Download entire EEG repository
aws s3 cp s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-credentialed-access-point/EEG/ ./eeg_repository/ --recursive

Example: Credentialed Access - Publication-Specific

# List files in Philosopher's Stone project
aws s3 ls s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-credentialed-projects-ap/philosoph/

# Download the project
aws s3 cp s3://arn:aws:s3:us-east-1:184438910517:accesspoint/bdsp-credentialed-projects-ap/philosoph/ ./philosoph/ --recursive

Troubleshooting Access Denied Errors

Getting "Access Denied" errors? Try these steps:
  1. Verify AWS Account ID: Make sure the AWS Account ID in your BDSP profile matches your actual AWS account
  2. Check S3 Permissions: Your IAM user/role needs S3 permissions (see section below)
  3. Wait for Access Propagation: After approval, AWS permissions may take 5-10 minutes to propagate
  4. Retry Request Access: On the project page, try clicking "Request Access" again (up to 3 times, waiting a few minutes between attempts)
  5. Enterprise/SSO Users: If your organization uses AWS SSO, you may need IT assistance to add S3 permissions outside the standard SSO configuration

Which Credentialed Access Point Should I Use?

If you're approved for a credentialed project, use this guide:

If you want... Use this access point Look for folder...
Harvard EEG Database bdsp-credentialed-access-point EEG/
Harvard-Emory ECG Database bdsp-credentialed-access-point ECG/
Human Sleep Project or BCH Sleep Corpus bdsp-credentialed-access-point PSG/
BIND (Brain Imaging Database) bdsp-credentialed-access-point Imaging/
Philosopher's Stone bdsp-credentialed-projects-ap philosoph/
Frequency Estimation Project bdsp-credentialed-projects-ap iiic-freq2/
Other credentialed projects Check your approval email or contact support@bdsp.io

AWS S3 Permissions Setup (keep existing)

Important: If you receive an "Access Denied" error when accessing S3 data, you need to add S3 permissions to your AWS account.

Step 1: Sign in to AWS

  1. Go to the AWS Management Console: https://console.aws.amazon.com/
  2. Log in with your AWS account.

Step 2: Open IAM

  1. In the search bar at the top of the AWS console, type IAM.
  2. Click IAM (Identity and Access Management).

Step 3: Select Your User or Role

  1. If you are using an IAM User: click Users from the left menu, then select your username.
  2. If you are using an IAM Role: click Roles from the left menu, then select the role you use.

Step 4: Attach S3 Permissions

  1. Go to the Permissions tab.
  2. Click Add permissionsAttach policies directly.
  3. Search for and select AmazonS3FullAccess.
  4. If your organization requires limited access, create a custom policy with at least the following permissions:
    {
      "Version": "2012-10-17",
      "Statement": [
        {
          "Effect": "Allow",
          "Action": [
            "s3:GetObject",
            "s3:ListBucket"
          ],
          "Resource": "*"
        }
      ]
    }
  5. Click Add permissions.
✓ Done! After adding these permissions, you should be able to access the S3 data without "Access Denied" errors.