Shubham Pachori's starred repositories
Baichuan-13B
A 13B large language model developed by Baichuan Intelligent Technology
Baichuan-7B
A large-scale 7B pretraining language model developed by BaiChuan-Inc.
PyTorch-Distributed-Training
Example of PyTorch DistributedDataParallel
pytorch-disttrain
A simple demo of distributed training in Pytorch
BERT-PyTorch
BERT for Distributed PyTorch + AMP Training
Pytorch-DistributedDataParallel-Training-Tricks
A guide that integrates Pytorch DistributedDataParallel, Apex, warmup, learning rate scheduler, also mentions the set-up of early-stopping and random seed.
pytorch-distributed
A quickstart and benchmark for pytorch distributed training.
pytorch-distributed-training
Simple tutorials on Pytorch DDP training
distributed-pytorch
Distributed, mixed-precision training with PyTorch
causal_discovery_for_time_series
Causal discovery for time series
flutter_paytm_clone
A sample application to show Paytm Flutter Clone.
Ecommerce-Application-Flutter-Firebase-Firestore
Developed supplement ordering mobile application using flutter and backend with firebase database. In this application user first need signup and then he/she can login after authentication. User can select several types of supplement and he/she can add to cart and remove it. In this application I use firebase for database part.
DeepSpeedExamples
Example models using DeepSpeed
Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2
zero-shot-reward-models
ZYN: Zero-Shot Reward Models with Yes-No Questions
Document-Classification-using-LayoutLM
This PyTorch implementation of LayoutLM paper by Microsoft demonstrate the SequenceClassfication task using HuggingFaceTransformers to classify types of Documents.
DeepAnt_timeseries_anomaly
Academic Project around DeepAnt : A Deep Learning Approach for Unsupervised Anomaly Detection in Time Series