Cannot automatically convert prediction head of model class RobertaAdapterModel to flex head.

Question

Cannot automatically convert prediction head of model class RobertaAdapterModel to flex head.

swoldemichael opened this issue 4 months ago · comments

I was trying to try out my adapter model on the serverless inference API on Hugging Face, but the prediction head can not be converted to flex head. This would be good for prototyping. Perhaps, consider conversion for all models supported by adapters.

calpt · Answer 1 · Tue Apr 09 2024 03:02:13 GMT+0800 (China Standard Time)

Thanks for bringing this up, I think the inference API has not been updated to the new library yet, we will look into this!

calpt · Answer 2 · Fri May 10 2024 19:21:28 GMT+0800 (China Standard Time)

This is being fixed in huggingface/api-inference-community#422.

calpt · Answer 3 · Thu Jun 27 2024 03:38:15 GMT+0800 (China Standard Time)

Should be fixed now with merge of the PR mentioned.