nebuly-ai / optimate

A collection of libraries to optimise AI model performances

https://www.nebuly.com/

Repository from Github https://github.comnebuly-ai/optimate

nebuly-ai/optimate Issues

Does This Fine-tuning code doesn't work in single A6000 GPU for LLaMA-2-7B with LoRA?
Updated 5 months ago
Dimension dismatch on AlphaTensor
Updated 8 months ago2
[Chatllama] Evaluation Function and Loop with metrics
Updated a year ago
nebullvm LICENSE and commercial use?
Updated a year ago
[Speedster] optimize_model took 10 hours, and it's not over yet
Updated 2 years ago
Forward Forward Algorithm Questions
Updated 2 years ago2
[Speedster] TensorRt OSError: [WinError 127] The specified procedure could not be found
Updated 2 years ago
[ Speedster] With Hugging Face notebook code on nebulydocker/nebullvm container: RuntimeError: Expected all tensors to be on the same device
Updated 2 years ago5
How to generate and perform inference for an ONNX model
Updated 2 years ago2
[speedster] _dl_check_map_versions assertion error with optimize_model and ONNX compilers
Updated 2 years ago3
Yolov8-Pose Model
Updated 2 years ago
torch2.0 support on speedster
Updated 2 years ago2
yolov8 + nebuly | AttributeError: type object 'DummyClass' has no attribute 'models'
Updated 2 years ago10
[ChatLLaMA] Training process halted
Updated 2 years ago3
[ChatLlama] Train Actor with llama-7b model Error initializing torch.distributed using env:// rendezvous:
Closed 2 years ago3
Evaluating accuracy of only the reward model
Updated 2 years ago
[Speedster] type object ‘DummyClass’ has no attribute ‘models’
Closed 2 years ago1
[Speedster] Optimization failed with PytorchBackendCompiler
Updated 2 years ago4
[chatllama]Puzzled about the update of the critic model
Updated 2 years ago
Issues with accelerate and deepspeed training
Updated 2 years ago4
[Chatllama] what's supposed to be in the Actor checkpoint dir?
Updated 2 years ago3
[Chatllama] Merge the datasets to create more insightful training data
Updated 2 years ago2
[Chatllama] KL Divergence equation
Updated 2 years ago3
[ChatLLaMA] RLHF Training: Prompt too long
Updated 2 years ago8
[chatllama]Do I need to split the llama model manully?
Updated 2 years ago2
[chatllama]How models enable inference
Updated 2 years ago1
[Chatllama] Support Inference for trained models.
Updated 2 years ago1
Support for torch 2.0
Updated 2 years ago1
[Chatllama] facebook/opt-350m is missing in rlhf/model_list.py
Closed 2 years ago2
[ChatLLaMA] RLHF Training: dimension mismatch
Updated 2 years ago3
[ChatLLaMA] Will there be online Demo about ChatLLaMA?
Updated 2 years ago1
for rlhf_accelerate branch, can't run with multiGPU
Updated 2 years ago2
[Speedster] Make Speedster optimize_model() return InferenceLearner also for StableDiffusion models
Updated 2 years ago
module not found:chatllama.rlhf.dataset
Closed 2 years ago1
Add Support for PEFT fine-tuning
Updated 2 years ago1
[ChatLLaMA] train RL on multi-gpu
Closed 2 years ago3
[Chatllama] how to reduce the CUDA memory comsumption a llama7B model
Updated 2 years ago
[Chatllama] train actor model with llama7B, the loss is nan
Updated 2 years ago
[Speedster] Running into "CUDA out of memory" on an A100
Updated 2 years ago9
[Speedster] Would nebullvm support YoloV8 segmentation soon or at all ?
Updated 2 years ago1
[Nebullvm] Add option to Nebullvm auto-installer for installing **all** libraries
Updated 2 years ago
[ChatLLaMA] No GPU Detected issue
Closed 2 years ago2
[Speedster] Speedster usage
Closed 2 years ago1
Tokenizer Issue
Closed 2 years ago3
[ChatLlama] Error in the start of OPT1.3B actor pre-training
Closed 2 years ago1
RL trainig RuntimeError: CUDA error: device-side assert triggered
Closed 2 years ago2
[Chatllama] discounted_rewards with PPO
Closed 2 years ago2
How to inference?
Updated 2 years ago1
[Chatllama] looks like REWARD MODEL donesn't support OPT
Closed 2 years ago2
[Speedster] - Example notebooks not working
Closed 2 years ago1