intel / intel-extension-for-deepspeed

Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note XPU is already supported in stock DeepSpeed (upstream).

Intel® Extension for DeepSpeed*

Intel® Extension for DeepSpeed* is an extension that brings Intel GPU (XPU) support to DeepSpeed(https://github.com/Microsoft/DeepSpeed). It comes with the following components:

1. DeepSpeed Accelerator Interface implementation
2. DeepSpeed op builder implementation for XPU
3. DeepSpeed op builder kernel code

DeepSpeed would automatically use Intel® Extension for DeepSpeed* when it is installed as a python package. After installation, models ported for DeepSpeed Accelerator Interface that run on DeepSpeed could run on Intel GPU device.

Installation

1. Install Intel® Extension for PyTorch* following Installation Guide

2. Install Intel® Extension for DeepSpeed*

pip install intel-extension-for-deepspeed

Or, you can build from source:

source ${DPCPPROOT}/env/vars.sh
python setup.py install

Generally, DPCPPROOT is /opt/intel/oneapi/compiler/latest for root account, ${HOME}/intel/oneapi/compiler/latest for other accounts.

3. Install DeepSpeed

pip install deepspeed

Get Started

Refer to examples

Security Policy

Please report security issues or vulnerabilities to the Intel Security Center.

For more information on how Intel works to resolve security issues, see Vulnerability Handling Guidelines.