Does onnxruntime or onnxruntime_genai support tool_calling?
jivaniyash opened this issue · comments
Discussed in #542
Originally posted by jivaniyash May 29, 2024
I am looking to use phi-3 model (using ONNX runtime) to integrate function_calling / tool_calling? Is there any documentation/API to add tool_calling along the prompt? Also, how can I change the system prompt?
Could you share more details on the tool_calling functionality? Any open-source document/code where this is done?
Will close this. We can continue discussion in the discussions thread.