Zen's starred repositories
RWKV-LM
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
StructuredLM_RTDT
A library for building hierarchical text representation and corresponding downstream applications.
Causal-Proxy-Model
The Codebase for Causal Proxy Model
awesome-ai-research-intern-list
List of AI Internships
csGraduateFellowships
A curated list of fellowships for graduate students in Computer Science and related fields.
Causal-Distill
The Codebase for Causal Distillation for Language Models (NAACL '22)
Causal-Distill-XXS
The Codebase for Causal Distillation for Task-Specific Models
ReaSCAN-Causal
Causal Abstraction of Neural Models Trained to Solve ReaSCAN
Interchange-Intervention-Training
The codebase for Inducing Causal Structure for Interpretable Neural Networks
arxiv-latex-cleaner
arXiv LaTeX Cleaner: Easily clean the LaTeX code of your paper to submit to arXiv
Reason-SCAN
ReaSCAN is a synthetic navigation task that requires models to reason about surroundings over syntactically difficult languages. (NeurIPS '21)
NLP-progress
Repository to track the progress in Natural Language Processing (NLP), including the datasets and the current state-of-the-art for the most common NLP tasks.
limits-cross-domain-transfer
Toolkit for a systematic exploration of how much transfer occurs when models are denied any information about word identity via random scrambling. Codebase for "Identifying the Limits of Cross-Domain Knowledge Transfer for Pretrained Models".
Aspect-Based-Sentiment-Analysis
A paper list for aspect based sentiment analysis.
ARC_synthetic_extend
Synthetic examples created as an extension of The Abstraction and Reasoning Corpus (ARC)
Quasi-Attention-ABSA
The Codebase for Quasi-Attention BERT Model for TABSA Tasks (AAAI '21)
Pragmatic-Color-Generation
Pragmatically Informative Color Generation by Grounding Contextual Modifiers
LAT-for-Transformer
Structured Self-Attention Weights Encode Semantics in Sentiment Analysis
Multiplayer-Communication
A Node.js based real-time multiplayer communication game platform.