Iftitahu Ni'mah's repositories
metric-preference-checklist
Code implementation and Datasets for the ACL2023 Paper "NLG Evaluation Metrics Beyond Correlation Analysis: An Empirical Metric Preference Checklist"
awesome-instruction-dataset
A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)
Book_RL4NLP
Online Book: Representation Learning for Natural Language Processing
inimah.github.io
Academic personal website
PaLM-rlhf-pytorch
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
ctc-gen-eval
EMNLP 2021 - CTC: A Unified Framework for Evaluating Natural Language Generation
DataICL
Data Valuation on In-Context Examples
dataset_difficulty
"Understanding Dataset Difficulty with V-Usable Information" (ICML 2022, long talk)
Diffusion-LM
Diffusion-LM
FacEval
EMNLP 2022: Analyzing and Evaluating Faithfulness in Dialogue Summarization
Great-Deep-Learning-Tutorials
A Great Collection of Deep Learning Tutorials and Repositories
hh-rlhf
Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"
ICE
ACL Findings '23 - ICE: Multi-dimensional Evaluation of Text Summarization with In-Context Learning
inimah
Config files for my GitHub profile.
inimah_old.github.io
My PhD journal
interpreting-ml-models-course
Course for Interpreting ML Models
langchain
⚡ Building applications with LLMs through composability ⚡
LLMsPracticalGuide
A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)
Multimodal-Toolkit-Customized
Multimodal model for text and tabular data with HuggingFace transformers as building block for text data
nnd_evaluation
Code for the EMNLP 2022 paper: Near-Negative Distinction
Open-Assistant
OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.
OpenPrompt
An Open-Source Framework for Prompt-Learning.
ParlAI
A framework for training and evaluating AI models on a variety of openly available dialogue datasets.
summarize-from-feedback
Code for "Learning to summarize from human feedback"
TextRL
Implementation of ChatGPT RLHF (Reinforcement Learning with Human Feedback) on any generation model in huggingface's transformer (blommz-176B/bloom/gpt/bart/T5/MetaICL)
transformers-mod
Modified version of HuggingFace Transformers
trl
Train transformer language models with reinforcement learning.
trlx
A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)
UniEval
Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation
usr
Code for ACL 2020 paper: USR: An Unsupervised and Reference Free Evaluation Metric for Dialog Generation (https://arxiv.org/pdf/2005.00456)