megatron

There are 0 repository under megatron topic.

modelscope / ms-swift
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 500+ LLMs (Qwen3, Qwen3-MoE, Llama4, GLM4.5, InternLM3, DeepSeek-R1, ...) and 200+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, Llava, GLM4v, Phi4, ...) (AAAI 2025).
deepseek-r1 embedding grpo internvl liger llama llama4 llm lora megatron moe multimodal open-r1 peft qwen3 qwen3-next qwen3-omni qwen3-vl reranker sft
Language:Python 10939
eyaadh / megadlbot_oss
Megatron was a telegram file management bot that helped a lot of users, specially movie channel managers to upload their files to telegram by just providing a link to it. The project initially started as roanuedhuru_bot which lately retired and came back as Megatron which was a side project of the famous Maldivian Telegram community - @Baivaru until it retired.
megadlbot megatron pyrogram telegram tgcrypto aiofiles aiohttp pymongo ffmpeg ffprobe mongodb bot youtube-dl seedr google-python-api
Language:Python 187
xrsrke / pipegoose
Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
megatron megatron-lm transformers 3d-parallelism data-parallelism pipeline-parallelism tensor-parallelism model-parallelism zero-1 large-scale-language-modeling huggingface-transformers distributed-optimizers mixture-of-experts moe sequence-parallelism
Language:Python 87
MoFHeka / LLaMA-Megatron
A LLaMA1/LLaMA12 Megatron implement.
llama llama2 llm llm-training megatron megatron-lm pytorch
Language:Python 28
liangyuwang / Tiny-Megatron
Tiny-Megatron, a minimalistic re-implementation of the Megatron library
deep-learning distributed-computing gpt large-language-models megatron
Language:Python 16
janelu9 / EasyLLM
Running Large Language Model easily.
deepspeed fine-tuning pretrain llama npu qwen qwen-vl deepseek rlhf megatron vllm
Language:Python 10
Sh-Jil / megadlbot
Megatron was a telegram file management bot that helped a lot of users, specially movie channel managers to upload their files to telegram by just providing a link to it. The project initially started as roanuedhuru_bot which lately retired and came back as Megatron which was a side project of the famous Maldivian Telegram community -
bot mongodb telegram ffmpeg youtube-dl ffprobe pyrogram megatron google-python-api seedr megadlbot tgcrypto
Language:Python 3
future-wd / course-hugo-bootstrap-introduction
A course which takes you through the entire process of setting up a Hugo project with Bootstrap. It also teaches you the basics of bootstrap to get you up and running.
tutorial hugo bootstrap footer copyright hero megatron html css pagination
Language:HTML 1
Dikhudu / megaTRON
Java implementation of the Tron whitepaper
megatron
Language:Java 0
0-1CxH / megatron-wrap
Wrapped Megatron: As User-Friendly as HuggingFace, As Powerful as Megatron-LM | Megatron封装：和HuggingFace一样方便，和Megatron-LM一样强大
deepspeed gpt huggingface-transformers llama llm llm-training megatron megatron-lm sft simplification transformer wrap wrapper
Language:Python
mihirkudale / Megatron-NLP-Project
natural-language-processing megatron
Language:JavaScript

megatron

modelscope / ms-swift

eyaadh / megadlbot_oss

xrsrke / pipegoose

MoFHeka / LLaMA-Megatron

liangyuwang / Tiny-Megatron

janelu9 / EasyLLM

Sh-Jil / megadlbot

future-wd / course-hugo-bootstrap-introduction

Dikhudu / megaTRON

0-1CxH / megatron-wrap

mihirkudale / Megatron-NLP-Project