Hyperparameters
ekurtulus opened this issue · comments
What are the hyperparameters for replicating SeaLLMs/SeaLLM-7B-v1 and SeaLLMs/SeaLLM-7B-v2 ?
@ekurtulus Hi there.
The models are trained on close-sourced data, so I'm not sure if it is replicable.
Cheers.
@ekurtulus Hi there.
The models are trained on close-sourced data, so I'm not sure if it is replicable.
Cheers.
Similar size and quality datasets can still be curated. That's why I believe the community would be interested in hyperparameters.