chaitjo / geometric-rna-design

gRNAde: Geometric Deep Learning for 3D RNA inverse design

Home Page:https://arxiv.org/abs/2305.14749

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

πŸ’£ gRNAde: Geometric Deep Learning for 3D RNA Inverse Design

gRNAde is a geometric deep learning pipeline for 3D RNA inverse design, analogous to ProteinMPNN for protein design.

🧬 Tutorial notebook to get started: gRNAde 101 Open In Colab

βš™οΈ Using gRNAde for custom RNA design scenarios: Design notebook Open In Colab

✍️ New to 3D RNA modelling? Here's a currated reading + watch list for beginners: Resources

πŸ“„ For more details on the methodology, see the accompanying paper: 'gRNAde: Geometric Deep Learning for 3D RNA inverse design'

Chaitanya K. Joshi, Arian R. Jamasb, Ramon ViΓ±as, Charles Harris, Simon Mathis, Alex Morehead, and Pietro LiΓ². gRNAde: Geometric Deep Learning for 3D RNA inverse design. ICML Computational Biology Workshop, 2023.

PDF | Tweet | Slides

gRNAde generates an RNA sequence conditioned on one or more 3D RNA backbone conformations, i.e. both single- and multi-state fixed-backbone sequence design. RNA backbones are featurized as geometric graphs and processed via a multi-state GNN encoder which is equivariant to 3D roto-translation of coordinates as well as conformer order, followed by conformer order-invariant pooling and sequence design.

Installation

In order to get started, set up a python environment by following the installation instructions below. We have tested gRNAde on Linux with Python 3.10.12 and CUDA 11.8 on NVIDIA A100 80GB GPUs and Intel XPUs, as well as on MacOS (CPU).

# Clone gRNAde repository
cd ~  # change this to your prefered download location
git clone https://github.com/chaitjo/geometric-rna-design.git
cd geometric-rna-design

# Install mamba (a faster conda)
wget https://github.com/conda-forge/miniforge/releases/latest/download/Miniforge3-Linux-x86_64.sh
bash Miniforge3-Linux-x86_64.sh
source ~/.bashrc
# You may also use conda or virtualenv to create your environment

# Create new environment and activate it
mamba create -n rna python=3.10
mamba activate rna

Set up your new python environment, starting with PyTorch and PyG:

# Install Pytorch on Nvidia GPUs (ensure appropriate CUDA version for your hardware)
mamba install pytorch torchvision torchaudio pytorch-cuda=11.8 -c pytorch -c nvidia

# Install Pytorch on Intel XPUs (specific to Cambridge's Dawn supercomputer)
module load default-dawn
source /usr/local/dawn/software/external/intel-oneapi/2024.0/setvars.sh
export ZE_FLAT_DEVICE_HIERARCHY=COMPOSITE
python -m pip install torch==2.1.0a0 torchvision==0.16.0a0 torchaudio==2.1.0a0 intel-extension-for-pytorch==2.1.10+xpu --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/

# Install Pytorch Geometric (ensure matching torch + CUDA version to PyTorch)
pip install torch_geometric
pip install torch_scatter torch_cluster -f https://data.pyg.org/whl/torch-2.1.2+cu118.html
# To build PyG libraries from scartch, do not use -f (eg. in case of Intel XPUs)

Next, install other compulsory dependencies:

mamba install jupyterlab matplotlib seaborn pandas biopython biotite -c conda-forge
pip install wandb gdown pyyaml ipdb python-dotenv tqdm cpdb-protein torchmetrics einops ml_collections mdanalysis MDAnalysisTests

# Install X3DNA for secondary structure determination
cd ~/geometric-rna-design/tools/
tar -xvzf x3dna-v2.4-linux-64bit.tar.gz
./x3dna-v2.4/bin/x3dna_setup
# Follow the instructions to test your installation

# Install EternaFold for secondary structure prediction
cd ~/geometric-rna-design/tools/
git clone --depth=1 https://github.com/eternagame/EternaFold.git && cd EternaFold/src
make
# Notes: 
# - Multithreaded version of EternaFold did not install for me
# - To install on MacOS, start a shell in Rosetta using `arch -x86_64 zsh`

# Download RhoFold checkpoint (~500MB)
cd ~/geometric-rna-design/tools/rhofold/
gdown https://drive.google.com/uc?id=1To2bjbhQLFx1k8hBOW5q1JFq6ut27XEv

Optionally, you can also set up the following extra tools and dependencies:

# (Optional) Install CD-HIT for sequence identity clustering
mamba install cd-hit -c bioconda

# (Optional) Install US-align/qTMclust for structural similarity clustering
cd ~/geometric-rna-design/tools/
git clone https://github.com/pylelab/USalign.git && cd USalign/ && git checkout 97325d3aad852f8a4407649f25e697bbaa17e186
g++ -static -O3 -ffast-math -lm -o USalign USalign.cpp
g++ -static -O3 -ffast-math -lm -o qTMclust qTMclust.cpp

# (Optional) Install draw_rna for visualisation
cd ~/geometric-rna-design/tools/
git clone --depth=1 https://github.com/DasLab/draw_rna && cd draw_rna
python setup.py install

Once your python environment is set up, create your .env file with the appropriate environment variables; see the .env.example file included in the codebase for reference.

cd ~/geometric-rna-design/
touch .env

You're now ready to use gRNAde via the tutorial. In order to train your own models from scratch though, you still need to download and process raw RNA structures from RNAsolo (instructions below).

Directory Structure and Usage

Detailed usage instructions are available in the tutorial notebook.

.
β”œβ”€β”€ README.md
β”œβ”€β”€ LICENSE
|
β”œβ”€β”€ gRNAde.py                       # gRNAde python module and command line utility
β”œβ”€β”€ main.py                         # Main script for training and evaluating models
|
β”œβ”€β”€ .env.example                    # Example environment file
β”œβ”€β”€ .env                            # Your environment file
|
β”œβ”€β”€ checkpoints                     # Saved model checkpoints
β”œβ”€β”€ configs                         # Configuration files directory
β”œβ”€β”€ data                            # Dataset and data files directory
β”œβ”€β”€ notebooks                       # Directory for Jupyter notebooks
β”œβ”€β”€ tutorial                        # Tutorial with example usage
|
β”œβ”€β”€ tools                           # Directory for external tools
|   β”œβ”€β”€ draw_rna                    # RNA secondary structure visualization
|   β”œβ”€β”€ EternaFold                  # RNA sequence to secondary structure prediction tool
|   β”œβ”€β”€ RhoFold                     # RNA sequence to 3D structure prediction tool
|   β”œβ”€β”€ ribonanzanet                # RNA sequence to chemical mapping prediction tool
|   └── x3dna-v2.4                  # RNA secondary structure determination from 3D
|
└── src                             # Source code directory
    β”œβ”€β”€ constants.py                # Constant values for data, paths, etc.
    β”œβ”€β”€ evaluator.py                # Evaluation loop and metrics
    β”œβ”€β”€ layers.py                   # PyTorch modules for building Multi-state GNN models
    β”œβ”€β”€ models.py                   # Multi-state GNN models for gRNAde
    β”œβ”€β”€ trainer.py                  # Training loop
    |
    └── data                        # Data-related code
        β”œβ”€β”€ clustering_utils.py     # Methods for clustering by sequence and structural similarity
        β”œβ”€β”€ data_utils.py           # Methods for loading PDB files and handling coordinates
        β”œβ”€β”€ dataset.py              # Dataset and batch sampler class
        β”œβ”€β”€ featurizer.py           # Featurizer class
        └── sec_struct_utils.py     # Methods for secondary structure prediction and determination

Downloading Data

gRNAde is trained on all RNA structures from the PDB at ≀4A resolution (12K 3D structures from 4.2K unique RNAs) downloaded via RNASolo with date cutoff: 31 October 2023. If you would like to train your own models from scratch, download and extract the raw .pdb files via the following script into the data/raw/ directory (or another location indicated by the DATA_PATH environment variable in your .env file).

❗️ Alternatively to the instructions below, you can download a pre-processed .pt file and .csv metadata, and place them into the data/ directory.

# Download structures in pdb format
mkdir ~/geometric-rna-design/data/raw
cd ~/geometric-rna-design/data/raw
curl -O https://rnasolo.cs.put.poznan.pl/media/files/zipped/bunches/pdb/all_member_pdb_4_0__3_300.zip
unzip all_member_pdb_4_0__3_300.zip
rm all_member_pdb_4_0__3_300.zip

Manual download link: https://rnasolo.cs.put.poznan.pl/archive. Select the following for creating the download: 3D (PDB) + all molecules + all members + res. ≀4.0

Next, process the raw PDB files into our ML-ready format, which will be saved under data/processed.pt.

# Process raw data into ML-ready format (this may take several hours)
cd ~/geometric-rna-design/
python data/process_data.py

Each RNA will be processed into the following format (most of the metadata is optional for simply using gRNAde):

{
    'sequence'                   # RNA sequence as a string
    'id_list'                    # list of PDB IDs
    'coords_list'                # list of structures, i.e. 3D coordinates of shape ``(length, 27, 3)``
    'sec_struct_list'            # list of secondary structure strings in dotbracket notation
    'sasa_list'                  # list of per-nucleotide SASA values
    'rfam_list'                  # list of RFAM family IDs
    'eq_class_list'              # list of non-redundant equivalence class IDs
    'type_list'                  # list of structure types (RNA-only, RNA-protein complex, etc.)
    'rmsds_list'                 # dictionary of pairwise C4' RMSD values between structures
    'cluster_seqid0.8'           # cluster ID of sequence identity clustering at 80%
    'cluster_structsim0.45'      # cluster ID of structure similarity clustering at 45%
}

We have provided the splits used in our experiments in the data/ directory:

  • Single-state split from Das et al., 2010: data/das_split.pt (called the Das split for compatibility with older code)
  • Multi-state split of structurally flexible RNAs: data/structsim_split.pt

The precise procedure for creating the splits (which can be used to modify and customise them) can be found in the notebooks/ directory.

Citation

@article{joshi2023grnade,
  title={gRNAde: Geometric Deep Learning for 3D RNA inverse design},
  author={Joshi, Chaitanya K. and Jamasb, Arian R. and Vi{\~n}as, Ramon and Harris, Charles and Mathis, Simon and Morehead, Alex and Li{\`o}, Pietro},
  journal={arXiv preprint},
  year={2023},
}

About

gRNAde: Geometric Deep Learning for 3D RNA inverse design

https://arxiv.org/abs/2305.14749

License:MIT License


Languages

Language:Jupyter Notebook 79.5%Language:Python 20.5%