mattm / llm-knowledge-cutoff

A Jupyter notebook you can use to evaluate the accuracy of an LLM's knowledge over time

LLM Knowledge Cutoff Analysis

Introduction

This repository contains a Jupyter Notebook titled "LLM Knowledge Cutoff" that was used to evaluate the quality of GPT-4 Turbo's knowledge of celebrity deaths as we approach its knowledge cutoff.

Usage

To view and run the notebook:

Open Jupyter Notebook in the repository directory:

jupyter notebook

Navigate to "LLM Knowledge Cutoff.ipynb" and open it.

Contributing

Contributions to this project are welcome! If you have a suggestion for improving the script or have found a bug, please open an issue or submit a pull request.

License

This project is licensed under the MIT License.