Giters

ml-jku / helm

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

testing different language models

alstn7 opened this issue · comments

commented

Hi, thanks for the great work!
I am interested in your work and want to test out different language models.
What part of the code should I tweak to make the adjustment?

Thank you

commented

Thank you for your interest in our work!
The language model is instantiated here:

helm/model.py

Line 106 in 33d566e

self.model = TransfoXLModel.from_pretrained('transfo-xl-wt103', config=config)

You can find the available models in huggingface here:

https://huggingface.co/models

Be aware, however, that the handling of the language encoder may differ, due to memory register, etc.

commented

Thank you for your interest in our work! The language model is instantiated here:

helm/model.py

Line 106 in 33d566e

self.model = TransfoXLModel.from_pretrained('transfo-xl-wt103', config=config)

You can find the available models in huggingface here:

https://huggingface.co/models

Be aware, however, that the handling of the language encoder may differ, due to memory register, etc.

Thank you for your reply!