Input your own gen_top_p, gen_top_k parameters
YukiSakuma opened this issue · comments
In the replicate demo you are already able to manually input the seed but I would like also to be able to input your own gen_top_p, gen_top_k parameters. For example for the same seed and prompt I want to be able to try different gen_top_p, gen_top_k values and compare the results.
Yeah that makes sense. Right now it's arbitrarily set at k=50. Do you have any intuition on what varying k would do?
You can now input your own top_k value