SII-OpenMOSS's repositories
SpeechGPT-2.0-preview
GPT-4o-level, real-time spoken dialogue system.
Language-Model-SAEs
For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.
Say-I-Dont-Know
[ICML'2024] Can AI Assistants Know What They Don't Know?
Thus-Spake-Long-Context-LLM
a survey of long-context LLMs from four perspectives, architecture, infrastructure, training, and evaluation
ReAttention
[ICLR2025] ReAttention, a training-free approach to break the maximum context length in length extrapolation
Ultra-Innerthought
Ultra-Innerthought is a bilingual (Chinese and English) open-domain R1/o1 style SFT dataset.
TransformerLens
A library for mechanistic interpretability of GPT-style language models
Language:PythonMIT000