libxsmm / tpp-pytorch-extension

Intel® Tensor Processing Primitives extension for Pytorch*

Intel(R) Tensor Processing Primitives extension for PyTorch*

Copyright (c) Intel corp.

Pre-requisite

gcc v8.3.0 or higher

Installation

Setup conda environment using utils/setup_conda.sh

# Create new conda env 
# It creates an env.sh script for activating conda env
$bash utils/setup_conda.sh [-p <conda_install_path>]

Install the extension:

# Source the env.sh and install the extension
$source env.sh
$git submodule update --init
$python setup.py install

For multi-node runs:

(Optional) install torch_ccl module:

$bash utils/install_torch_ccl.sh

Examples

BERT

• BERT SQuAD Fine-tuning
• BERT MLPerf pre-training

GNN

• GraphSage
• Graph Attention Network (GAT)