Api Server Example

Question

Api Server Example

e253 opened this issue a year ago · comments

I made an example rocket.rs api server https://github.com/aurelianai/aurelian_server if anyone is interested.

Tommy van der Vorst · Answer 1 · Sat Sep 09 2023 20:40:39 GMT+0800 (China Standard Time)

I might have a more elaborate project utilizing rustformers/llm for a server that could be open sourced. Let me know if there is interest. It exposes WebSocket/SSE interfaces as well as endpoints for embedding, configurable sets of prompts and more.

Ethan Steere · Answer 2 · Sun Sep 10 2023 01:25:14 GMT+0800 (China Standard Time)

Would love to see it and contribute!

Tommy van der Vorst · Answer 3 · Sat Sep 30 2023 17:53:43 GMT+0800 (China Standard Time)

Would love to see it and contribute!

It took a bit longer than expected, but here it is: https://github.com/pixelspark/poly 🎉 let me know what you think @e253

Tommy van der Vorst · Answer 4 · Sat Sep 30 2023 17:54:03 GMT+0800 (China Standard Time)

@philpax you might like it too

Philpax · Answer 5 · Sat Oct 21 2023 06:25:29 GMT+0800 (China Standard Time)

That's awesome! Sorry, I was very behind on my emails. I've added it to the README - shame I couldn't mention it at the talk.