Roger Feng's repositories
DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Language:PythonApache-2.0000
DeepSpeedExamples
Example models using DeepSpeed
Language:PythonApache-2.0000
intel-extension-for-deepspeed
Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note XPU is already supported by stock DeepSpeed.
Language:C++MIT000
intel-extension-for-transformers
Extending Hugging Face transformers APIs for Transformer-based models and improve the productivity of inference deployment. With extremely compressed models, the toolkit can greatly improve the inference efficiency on Intel platforms.
Language:C++Apache-2.0000
training_policies
Issues related to MLPerf™ training policies, including rules and suggested changes
Language:PythonNOASSERTION000
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Language:PythonApache-2.0000