factuality

There are 1 repository under factuality topic.

• stanford-oval / WikiChat

  WikiChat stops the hallucination of large language models by retrieving data from Wikipedia.

  language-modelnatural-language-processingchatbotnlpfactualityemnlp2023
  Language:Python 941

• Libr-AI / OpenFactVerification

  Loki: Open-source solution designed to automate the process of verifying factuality

  aifactualityhallucination
  Language:Python 930

• google-deepmind / long-form-factuality

  Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".

  benchmarkdatasetevaluationfactualitylanguagelanguage-modelinglarge-language-modelsmetrics
  Language:Python 508

• voidism / DoLa

  Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"

  factualityhallucinationslarge-language-models
  Language:Python 384

• shmsw25 / FActScore

  A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation"

  factualitylanguagelanguage-modelingevaluationemnlp2023
  Language:Python 253

• amazon-science / RefChecker

  RefChecker provides automatic checking pipeline and benchmark dataset for detecting fine-grained hallucinations generated by Large Language Models.

  factualityhallucinationllms
  Language:Python 234

• chaitanyamalaviya / ExpertQA

  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers

  attributionexpertfactuality
  Language:Python 117

• voidism / Lookback-Lens

  Official implementation for the paper "Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps"

  factualityhallucination-detectionhallucinationslarge-language-modelstext-generation
  Language:Python 87

• salesforce / factualNLG

  Code for the arXiv paper: "LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond"

  nlpfactual-consistencyfactualitylarge-language-modelsllmsummarization
  Language:Jupyter Notebook 58

• amazon-science / fact-graph

  Implementation of the paper "FactGraph: Evaluating Factuality in Summarization with Semantic Graph Representations (NAACL 2022)"

  factualityabstractive-summarization
  Language:Python 46

• dmis-lab / OLAPH

  OLAPH: Improving Factuality in Biomedical Long-form Question Answering

  biomedical-researchfactualityhallucinationquestion-answering
  Language:Python 31

• ChanLiang / CONNER

  The implementation for EMNLP 2023 paper ”Beyond Factuality: A Comprehensive Evaluation of Large Language Models as Knowledge Generators“

  llm-evaluationhallucinationsemnlp2023large-language-modelsfactualitynlg-evaluationchatgptllama
  Language:Python 29

• pphuc25 / distil-cd

  Distillation Contrastive Decoding: Improving LLMs Reasoning with Contrastive Decoding and Distillation

  decodingnlppapercontrastive-cot-promptingcontrastive-decodingdistillation-contrastive-decodingarithmetic-reasoningfactuality
  Language:Python 28

• khuangaf / CHOCOLATE

  Code and data for the ACL 2024 Findings paper "Do LVLMs Understand Charts? Analyzing and Correcting Factual Errors in Chart Captioning"

  chart-captioningchart-summarizationchart-understandingfactualityfaithfulnesslarge-vision-language-models
  Language:Jupyter Notebook 23

• amazon-science / abstractive-factual-tradeoff

  Code and data for the Dreyer et al (2023) paper on abstractiveness and factuality in abstractive summarization

  abstractiveabstractive-summarizationfactualityfactuality-checkingmetricssummarizationsummarization-dataset
  Language:Python 11
• COVID-19-disinformation

  firojalam / COVID-19-disinformation

  Dataset: Fighting the COVID-19 Infodemic: Modeling the Perspective of Journalists, Fact-Checkers, Social Media Platforms, Policy Makers, and the Society

  datasetdisinformationfactualityfact-checkingmultitask-learningmultitaskmultilingualmultilingual-modelsmultilingual-learningcheck-worthynessfact-checktwittertweetstweets-classificationsocial-mediasocial-media-analysissocial-media-mining
  Language:Jupyter Notebook 11

• Yottaxx / T-LSTM

  Event factuality prediction.Trigger state LSTM

  lstmeventfactualitygcngraph-neural-networksdeep-learningnatural-language-processingdatasets
  Language:Python 8

• amazon-science / factual-confidence-of-llms

  Code for paper "Factual Confidence of LLMs: on Reliability and Robustness of Current Estimators"

  confidencefactualfactualityllmllmsrobustness
  Language:Python 3

• firojalam / covid19-infodemic-demo

  API Services: Fighting the COVID-19 Infodemic: Modeling the Perspective of Journalists, Fact-Checkers, Social Media Platforms, Policy Makers, and the Society

  multilingualsocial-media-analysissocial-media-miningapi-clientfact-checkingdisinformationcheck-worthynessfactualityapi-services
  Language:Jupyter Notebook 2

• seinecle / umibench

  Testbench for sentiment and factuality in texts.

  benchmarkingfactualitynlpopinion-miningsentiment-analysissubjectivity-analysis
  Language:Roff 2

• Nana2929 / RAG

  Retrieval-augmented Generation (2024 Google Project Submodules)

  factualityllmprompt-engineeringtext-generation
  Language:Python