OpenMOSS / AnyGPT

Code for "AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling"

OpenMOSS/AnyGPT Issues

please provide a TTS prompt example for chat.
Updated 25 days ago
How to train the speech tokneizer?
Updated a month ago1
hi，when will the train code be released? && do you train image and text tokens all in autoregressive?
Updated a month ago4
About input formats for training and inference
Updated 2 months ago
GPU resources for AnyGPT instruction turning
Updated 2 months ago
Consider next version to use LLM instead of UNet
Updated 2 months ago
请教下music vocabulary size of 8192的实现
Closed 2 months ago1
关于论文中音乐tokenize和音乐生成示例的问题
Updated 2 months ago1
Loss Masking
Closed 3 months ago2
hi，when will the pre-train related codes&scripts be released?
Updated 3 months ago2
text chat is not so good.
Closed 3 months ago2
Some weights of BertLMHeadModel were not initialized from the model checkpoint at bert-base-uncased and are newly initialized
Closed 3 months ago1
can i ask the model to choose which of the voices sound more natural?
Closed 3 months ago2
RuntimeError: Error(s) in loading state_dict for SoundStorm
Updated 4 months ago1
qformer_quantizer.py missing keys: 511 unexpected keys: 146
Closed 4 months ago1
ModuleNotFoundError: No module named 'mmgpt.src'
Closed 4 months ago1
huggingface_hub.utils._validators.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': '/mnt/petrelfs/zhanjun.p/mllm/models/bert-base-uncased'. Use `repo_type` argument if needed.
Closed 4 months ago1
how many a100 it cost in training and if i want to train on v100 what is the number needed ?
Closed 4 months ago3
Question about training stage and dataset
Closed 4 months ago3
Collaboration request
Closed 4 months ago
When will code, dataset and checkpoints be released?
Closed 4 months ago1
Is there any evaluation on VQA datasets?
Closed 5 months ago1
code/dataset/model
Closed 5 months ago1