neulab / lti-llm-deployment

neulab/lti-llm-deployment Issues

How to fix this error
Updated a year ago2
Add code to batch request across different users on the server side
Updated a year ago1
Add client side tests
Updated a year ago
Add server side tests
Updated a year ago
`num_beams > 1` is not working unless using also `do_sample`
Closed a year ago2
Removing padding from output scores / hidden states
Updated 2 years ago
Porting OPT-175B to this framework
Updated 2 years ago
Add support for returning attention distributions
Updated 2 years ago