pretergeek's starred repositories
introspection_self_prediction
Code for experiments on self-prediction as a way to measure introspection in LLMs
Entropy-ABF
Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
lm-evaluation-harness
A framework for few-shot evaluation of language models.
llm-decontaminator
Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
LLMTest_NeedleInAHaystack
Doing simple retrieval from LLM models at various context lengths to measure accuracy
llm-autoeval
Automatically evaluate your LLMs in Google Colab
persona-hub
Official repo for the paper "Scaling Synthetic Data Creation with 1,000,000,000 Personas"
Lucid_Vision
This extension enhances the capabilities of textgen-webui by integrating advanced vision models, allowing users to have contextualized conversations about images with their favorite language models; and allowing direct communication with vision models.
deep-text-corrector
Deep learning models trained to correct input errors in short, message-like text
autocorrect
Spelling corrector in python
openchat-ui
An open source UI for OpenChat models
Megatron-LM
Ongoing research training transformer models at scale
tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
FlagEmbedding
Retrieval and Retrieval-augmented LLMs