huggingface / optimum-habana

Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)

huggingface/optimum-habana Issues

make sure a match between logits and logits_dtype in evaluation_loop
Closed 2 months ago3
LlamaForCausalLM.forward() got an unexpected keyword argument 'use_flash_attention'
Updated 2 months ago9
Error while saving checkpoint with trainer
Closed 2 months ago12
Bug in Optimum Habana Examples
Updated 2 months ago6
Discussion on attention mask handling
Closed 2 months ago3
[Feature request] Mistral implementation for language modeling?
Closed 2 months ago3
ENABLE_CONSOLE disrupts version checks in examples
Closed 3 months ago2
Increase in device memory usage with peft version 0.7.0
Updated 3 months ago5
multi-node distributed training on Ray is failed.
Closed 3 months ago2
Device Aquire failed
Closed 3 months ago15
Facing issue while running the git repository for text generation
Updated 3 months ago1
run_lora_clm.py support for other datasets
Updated 3 months ago1
Text Generation runtime error
Closed 3 months ago7
Error: Getting size for given data type is not supported while fine tuning starcoder model on optimum-habana
Closed 4 months ago7
Default value of ignore_eos
Closed 4 months ago5
Eval bug for speech recognition facebook/wav2vec2-large-lv60
Closed 4 months ago2
text_generation_launcher: Waiting for shard to be ready... rank=1 forever if we pass --num-shard
Closed 5 months ago8
tgi server keeps repeating short words in the output.
Closed 5 months ago6
StableDiffusion v2.1 produces incorrect images
Closed 5 months ago3
Will Hugging Face support GLM series models (ChatGLM-6B, ChatGLM2-6B ...) in Transformers?
Closed 6 months ago2
Repo card metadata block was not found. Setting CardData to empty
Updated 6 months ago1
FileNotFoundError: Couldn't find a dataset script
Closed 6 months ago4
Several greedy search Test cases failing with KeyError: 'bucket_size'
Closed 6 months ago4
Add support for max_length in run_generation
Updated 6 months ago3
Adaptive output and contextual dialogue capabilities of text-generation-inference
Updated 6 months ago1
ImportError: No module named optimum.habana.distributed
Closed 6 months ago1
Latest version of optimum-habana does not work with transformers==4.32.1
Closed 6 months ago1
Performance is better in 1.6.1 release compared to 1.7.4 release in many models
Updated 6 months ago3
Beach search transformers test cases are failing with KeyError: 'limit_hpu_graphs'
Closed 6 months ago2
'meta-llama/Llama-2-7b-hf' tests fail with Authentication failure.
Closed 7 months ago7
Does it make sense to also provide an option of max input tokens for text generation ?
Closed 7 months ago4
gpt neox finetuning does not work(segmentaion fault) since 1.7.0
Closed 7 months ago9
accelerate llama inference in TGI
Closed 8 months ago2
htcore issue on "text-generation-inference" server with "langchain" client
Closed 8 months ago1
dock build fail in https://github.com/huggingface/optimum-habana/tree/main/text-generation-inference
Closed 8 months ago11
setup.py need to be updated to 0.22.0 for accelerate
Closed 8 months ago1
Where in the directory "/tmp/tst-summarization", is the summarization output stored?
Closed 9 months ago3
RuntimeError: Device acquire failed. in /usr/local/lib/python3.8/dist-packages/habana_frameworks/torch/hpu/__init__.py"
Closed 9 months ago9
return super().__torch_function__(func, types, new_args, kwargs) RuntimeError: [Rank:0] FATAL ERROR :: MODULE:PT_DEVMEM Allocation failed for size::3288334336 (3136)MB
Closed 9 months ago10
Enable beam_search for text-generation
Closed 10 months ago3
Bad Performance of text-generation with sampling algo
Closed a year ago9
Adding profiling
Closed a year ago4
Compute Accuracy in clip-roberta
Closed a year ago5
Can not run text-generation with bloom deepspeed?
Closed a year ago2
When loading datasets by HuggingFace datasets.load_dataset like cifar10, could it be possible to return the dataset without decoding automatically.
Closed a year ago3
GPT2 support bf16 for both training and inferecne
Closed a year ago10
No support for optimum-habana pipeline() causes error during inference for PyTorch BERT finetuned model using dtype bf16
Closed a year ago18
Fine-tuning BERT model without Trainer
Closed a year ago2
Run text-generation with non-deepspeed mode
Closed a year ago6
AttributeError: 'GaudiStableDiffusionPipeline' object has no attribute '_internal_dict'
Closed a year ago3