langchain-ai / auto-evaluator

https://autoevaluator.langchain.com/

langchain-ai/auto-evaluator Issues

Can I add my local LLM model in Model list in application (https://autoevaluator.langchain.com/)?
Updated 6 months ago
Labelstudio integration
Updated 10 months ago
Server error when using online Playground
Updated a year ago9
Isolated evaluation of retrieval
Updated a year ago
Same questions are being generated
Updated a year ago
Support for more document types (HTML, CSV, etc)
Updated a year ago
Python + Node versions are missing
Updated a year ago
Replicat Vicuna API returning empty response
Updated a year ago
How generalizable is this framework?
Updated a year ago
disable sidebar when the experiment is running
Updated a year ago
Chunk size is always larger than allowed, even put the chunk size to '500' which is smallest in parameter list
Updated a year ago1
look into hosting vicuna 13B on EC2
Updated a year ago
make demo environment mobile friendly
Updated a year ago
Back-end crashing
Updated a year ago
OpenAI invalid API key error
Updated a year ago1
Anthropic model appears to be deprecated
Updated a year ago
Missing logging / alert when back-end crashes
Updated a year ago
API continues to run after connection to client is closed / refreshed
Updated a year ago
Catch server errors and return alert to the user
Closed a year ago2
Analytics
Closed a year ago
Remove HF embeddings (slow) and HF fallback in the event of illegal token
Closed a year ago
Experiment numbers are not refreshing correctly
Closed a year ago
Add 50MB file limit and single file
Closed a year ago
Remove the Insight panel (not sure it is correct and uses subjective weighting)
Closed a year ago
File transfer and reading time is slow in prod
Updated a year ago
Write-up on learnings / opportunities
Closed a year ago
Fix SVM in prod
Closed a year ago
Prod (likely) hitting OOM
Closed a year ago1
Unbreak
Closed a year ago1
Remove Doppler dep
Closed a year ago2
Move API Key
Closed a year ago2
horizontal scroll is needed on Summary table
Closed a year ago
Add Langchain logo to top left and make brain emoji the favicon
Closed a year ago4
The Test Dataset does not match what is shown in Experiment Results when app is first opened
Closed a year ago5
Past experimental results should be cleared when eval set changes
Closed a year ago1
Show intermediate states in the loading bar
Closed a year ago2
Expt numbering is wrong after we start w/ 3 examples
Closed a year ago1
Anthropic model is failing on prod
Closed a year ago1
[Nit] Change link in repo to new app (https://autoevaluator.langchain.com/)
Closed a year ago1
[mega request] Caching on back-end of index so it does not re-generate each expt
Closed a year ago
Make all side panels drop-down lists
Closed a year ago2
Add instructions to the demo landing page
Closed a year ago
Create "default" page w/ pre-populated data (from Karpathy pod) and "playground"
Closed a year ago
current menu item should be underlines
Closed a year ago
disable adding test data by default in the playground environment
Closed a year ago
update labels in graph to match the axis labels
Closed a year ago
add a file to the demo envioronment
Closed a year ago
Add sidebar scrolling
Closed a year ago
[backlog] App re-generating index when it does not need to
Closed a year ago
Bug in the FAST scoring
Closed a year ago