UKB

Installing the UKB package

You can install UKB from github with:

# install.packages("remotes")
remotes::install_github("adigherman/UKB")

System dependencies

OSX

Unfortunately, UK Biobank currently (as of 11/20/2019) only provides binaries for unix and Windows OS. Natively, OSX is not able to run unix binaries.

Setup, download and convert UKB data

Please consult the short guide to using UKB data to familiarize yourself with the UKB tools and the overall UKB framework.

In order to access and download UKB data, you need to be have an Application for acessing the UK Biobank data approved and also have received an email containing a 32-character MD5 Checksum and a 64-character Password.

Download helper programs

Several binary files need to be downloaded locally in order to access/query/download UKB data. The files ukbmd5, ukbconv, ukbunpack, ukbfetch can be downloaded from here.

Download UKB data

Below are the steps to download the data locally once you have the checksum and the password.

Login to the Application Management System at https://bbams.ndph.ox.ac.uk/ams/
Go to the Projects section for your Application xxxx and click on the Data Tab then the "Go to Showcase download page" button.
On the Downloads page of the UKB Showcase, go to the Dataset Tab and click on the entry with ID xxxxx;
Enter the MD5 checksum for the data (see below) and click Generate;
On the following screen, click Fetch to download the data.

Verify the download integrity

After the bulk data was downloaded, it is recommended to verify the integrity of the file, making sure that it was not corrupted during transfer. To do so, the ukbmd5 utility will be used.

#for Unix and Windows
ukbmd5 filename

Make sure that the MD5 checksum generated is exactly the one received in the email.

Unpack the bulk data

Datasets are supplied in a compressed encrypted format. The ukbunpack program decrypts and uncompresses the downloaded file into a custom UK Biobank format. The ukbunpack utility will be used for this operation.

#for Unix and Windows
ukbunpack ukbXXXXX.enc keyvalue/keyfile

Keyvalue represents the 64 character Password from the notification email, which you will need to input. Keyfile is the name of a plain text file holding the Password, which you will need to create. Either one will work.

Convert data for R

The result of the unpacking program is a dataset in a custom UK Biobank format. The ukbconv program will be used to transform the data into a format suitable for the R language. The docs flag creates an html file containing a field-code-to-description table.

#for Unix and Windows
ukbconv ukbXXXXX.enc_ukb r
ukbconv ukbXXXXX.enc_ukb docs

Create UK Biobank data.frame

Next we should create a dataframe with usable column names. To do so, we'll use the ukb_read function. This function is calling the ukb_df function from the ukbtools package and takes in two arguments: the prefix of the UKB files (eg. ukbxxxxx) and the path where the files are stored.

ukb_data <- ukb_read("ukbXXXXX", path = "/full/path/to/UKBdata")

Create bulk download file for a specific UDI

Retrieving multiple datafiles as a batch from UK Biobank requires the creation of a bulk file that contains the person and data identifiers. The ukb_fetch_all function will create such a file for all existing entries for a specific UDI. The example below will create a batch file to retrieve all T1 structural brain images (UDI 20252-2.0, column # 1975).

ukb_fetch_all(ukb_data,'20252-2.0',path='/full/path/to/UKBdata')
#ukb_fetch_all(ukb_data,1975,path='/full/path/to/UKBdata')

Filter data based on gender

The first implemented filter is the gender and the function parameter is gender. It can take two values, 0 for female and 1 for male. By default, all subjects are returned but one can choose to return only female subjects via:

ukb_fetch_all(ukb_data,'20252-2.0',gender=0, path='/full/path/to/UKBdata')

Download bulk data locally

Once the file is saved locally, the ukbfetch can be used to retrieve all associated images using as parameter the name of the file that was created (eg. 20252-2.0.txt). If the UKB key file is in the same folder and named .ukbkey you do not need to append -akeyfilename to the ukbfetch command.

# For unix and Windows
ukbfetch -b20252-2.0.txt

adigherman / UKB

UKB