MultiPLIER
A unsupervised transfer learning approach for rare disease transcriptomics
Taroni JN, Grayson PC, Hu Q, Eddy S, Kretzler M, Merkel PA, and Greene CS+. MultiPLIER: a transfer learning framework reveals systemic features of rare autoimmune disease. bioRxiv. 2018.
+Correspondence via issues or to greenescientist@gmail.com
Data
Data used in this analysis repo were processed in greenelab/rheum-plier-data. Please see that repository for relevant citations.
The recount2 training data and the corresponding PLIER model (MultiPLIER) are too large to be stored with Git LFS, so we have placed them on figshare. DOI: 10.6084/m9.figshare.5716033.v4
Data and code, other than the recount2 training set and model, associated with v0.1.0
are available at the following DOI: 10.6084/m9.figshare.6982919
Dependencies
We have prepared a Docker image that contains all the dependencies required to reproduce these analyses. See docker/Dockerfile
for more information about dependencies.
After installing Docker (Docker documentation), the image can be obtained:
docker pull jtaroni/multi-plier:0.1.0
We use R notebooks for analysis, which can be run and modified using RStudio. RStudio is included on our Docker image. This guide from Andrew Heiss, specifically the Run locally with a GUI section, is a great starting point for working with RStudio and Docker.
Overview
Unsupervised machine learning methods provide a promising means to analyze and interpret large datasets. However, most datasets generated by individual researchers remain too small to fully benefit from these methods. In the case of rare diseases, there may be too few cases available, even when multiple studies are combined. We sought to determine whether or not machine learning models could be constructed from large public data compendia and then transferred to small datasets for subsequent analysis. We trained models using Pathway Level Information ExtractoR (PLIER) (Github) over datasets of different types and scales. Models constructed from large public datasets were i) more detailed than those constructed from individual datasets; ii) included features that aligned well to important biological factors; iii) transferrable to rare disease datasets where the models describe biological processes related to disease severity more effectively than models trained within those datasets.
We call this approach MultiPLIER because we train on multiple datasets, tissues, and biological conditions.
We focus on groups of systemic autoimmune conditions in this project; one group of conditions is rare and the other disease is not. First, we establish that PLIER is appropriate for use in a single tissue, multi-dataset compendium (greenelab/rheum-plier-data/sle-wb) constructed from publicly available systemic lupus erythematosus (SLE) whole blood (WB) microarray data. We demonstrate that MultiPLIER, trained on the recount2 RNA-seq compendium, performs similarly in capturing certain cell type-specific signals and captures additional pathway signals over an SLE WB model. We also analyze expression data from 3 tissues from anti-neutrophilic cytoplasmic antibodies (ANCA)-associated vasculitis (AAV), a family of rare diseases, with MultiPLIER.
Overview figure of dataset-specific PLIER and MultiPLIER. Boxes with solid colored fills represent inputs to the model. White boxes with colored outlines represent model output.
(A) PLIER (Mao et al., 2017) automatically extracts latent variables (LVs), shown as the matrix B
, and their loadings (Z
).
We can train PLIER model for each of three datasets from different tissues, which results in three dataset-specific latent spaces.
(B) PLIER takes as input a prior information/knowledge matrix C
and applies a constraint such that some of the loadings (Z
) and therefore some of the LVs capture biological signal in the form of curated pathways or cell type-specific gene sets.
(C) Ideally, an LV will map to a single gene set or a group of highly related gene sets to allow for easy interpretation of the model.
PLIER applies a penalty on U
to facilitate this.
Purple fill in a cell indicates a non-zero value and a darker purple indicates a higher value.
We show an undesirable U
matrix in the top toy example (Ci) and a favorable U
matrix in the bottom toy example (Cii). (D)
If models have been trained on individual datasets, we may be required to find “matching” LVs in different dataset- or tissue-specific models using the loadings (Z
) from each model.
Using a metric like the Pearson correlation between loadings, we may or may not be able to find a well-correlated match between datasets.
(E) The MultiPLIER approach: train a PLIER on a large collection of uniformly processed data from many different biological contexts and conditions (recount2; Collado-Torres et al., 2017)—a MultiPLIER model—and then project the individual datasets into the MultiPLIER latent space.
The hatched fill indicates the sample dataset of origin.
(F) Latent variables from the MultiPLIER model can be tested for differential expression between disease and controls in multiple tissues.
For more information about the training set, please see this notebook.
Notebooks
Analysis notebooks are numbered and present in the top level directory. We've enabled Github pages for easy viewing of the notebooks. Some steps in the pipeline are R scripts rather than notebooks due to their computationally intensive nature; we exclude these from the TOC below.
- PLIER functions proof of concept
- Exploratory analysis of the recount2 PLIER model (MultiPLIER)
- MultiPLIER on isolated immune cell populations microarray data
- Reconstruction of isolated immune cell data
- Training PLIER on the SLE whole blood compendium
- Analyzing cell type-associated LVs in the SLE WB data with SLE WB PLIER model
- Analyzing cell type patterns in the SLE WB data using MultiPLIER
- Identifying interferon-related LVs in the SLE WB and MultiPLIER models
- Preparing IFN trials data for plotting
- Plotting IFN trial results
- Training a PLIER model on the NARES nasal brushing microarray dataset
- Comparing the NARES and MultiPLIER latent spaces
- Comparing the MultiPLIER neutrophil-associated LV expression values to
MCPcounter
estimates - Evaluating PLIER models trained on subsampled recount2 compendia
- Plotting metrics for PLIER model repeats
- Identifying differentially expressed MultiPLIER LVs (DELVs) in the NARES nasal brushing dataset
- Identifying DELVs in granulomatosis with polyangiitis (GPA) peripheral blood mononuclear cells (PBMCs)
- Identifying DELVs in microdissected glomeruli cohort
- Identifying DELVs common across the 3 AAV tissues
- ANCA antigens in the GPA PBMCs
- Examining high weight genes in DELVs
- Exploring a rituximab (RTX) dataset (preliminary)
- Predicting RTX response (very preliminary, see #18)
- Describing the recount2 training set with MetaSRA predictions
Note that not all analyses present in this repository are included in the preprint.
The figure_notebooks
directory contains notebooks that were used specifically to generate figures suitable for publication (figure_notebooks/figures
).
License
This repository is dual licensed as BSD 3-Clause (source code) and CC0 1.0 (figures, documentation, and our arrangement of the facts contained in the underlying data), with the following exceptions:
- recount2 data downloaded from this figshare accession is licensed CC-BY.