zyzisastudyreallyhardguy / Awesome-Large-Language-Models-for-Science

Latest Papers on Large Language Models for Science

Awesome Large Language Models for Science (LLM4Science)

A curated list of science-focused large language model resources: LLM4Science.

Keep Updating! 💡💡💡 Please let us know if papers are missing.

Highlight 🔆

Title	Venue	Date(D/M/Y)	Code	Note
Large Language Models for Scientific Synthesis, Inference and Explanation	arxiv	12/10/2023	GitHub	automatic scientific discovery

General Science

Title	Venue	Date(D/M/Y)	Code	Note
Large Language Models for Scientific Synthesis, Inference and Explanation	arxiv	12/10/2023	GitHub	automatic scientific discovery
Emergent autonomous scientific research capabilities of large language models	arxiv	11/04/2023	-	automatic scientific experiments
SciEval: A Multi-Level Large Language Model Evaluation Benchmark for Scientific Research.	arXiv	25/08/2023	-	-
Scibench: Evaluating college-level scientific problem-solving abilities of large language models.	arXiv	20/07/2023	-	-
Sci-CoT: Leveraging Large Language Models for Enhanced Knowledge Distillation in Small Models for Scientific QA	arxiv	09/08/2023	-	-
SCITUNE: Aligning Large Language Models with Scientific Multimodal Instructions	arxiv	03/07/2023	-	-
Science in the age of large language models	nature review physics	26/04/2023	-	-
Towards the ultimate brain: Exploring scientific discovery with ChatGPT AI	AI magazine	26/08/2023	-	-

Pretrained Large Language Models

Title	Venue	Date(D/M/Y)	Code	Note
Galactica: A large language model for science	arxiv	16/11/2022	GitHub	-
SciBERT: A Pretrained Language Model for Scientific Text	arxiv	26/03/2019	GitHub	-

Biology/Chemistry/Molecules

Title	Venue	Date(D/M/Y)	Code	Note
CodonBERT: Large Language Models for mRNA design and optimization	bioRxiv	12/09/2023	-	-
ChatGPT, GPT-4, and Other Large Language Models: The Next Revolution for Clinical Microbiology?	Clinical Infectious Diseases	03/07/2023	-	-
Large language model for molecular chemistry	nature computational science	23/01/2023	-	-
Do Large Language Models Understand Chemistry? A Conversation with ChatGPT	Journal of Chemical Information and Modeling	03/2023	-	-
Empowering Molecule Discovery for Molecule-Caption Translation with Large Language Models: A ChatGPT Perspective	arXiv	11/06/2023	-	-
Is GPT-3 all you need for low-data discovery in chemistry?	chemRxiv	14/02/2023	GitHub	-
Translation between Molecules and Natural Language	EMNLP	25/04/2022	GitHub	-
LLMs can generate robotic scripts from goal-oriented instructions in biological laboratory automation.	arXiv	18/04/2023	-	-
14 examples of how LLMs can transform materials science and chemistry: a reflection on a large language model hackathon. Digital Discovery, 2(5), 1233-1250.	Digital Discovery	12/06/2023	-	-
GIT-Mol: A Multi-modal Large Language Model for Molecular Science with Graph, Image, and Text	arXiv	14/08/2023	-	-
Comparative Performance Evaluation of Large Language Models for Extracting Molecular Interactions and Pathway Knowledge	arxiv	17/07/2023	-	-
Automated Extraction of Molecular Interactions and Pathway Knowledge using Large Language Model, Galactica: Opportunities and Challenges	ACL	2023	-	-
From Artificially Real to Real: Leveraging Pseudo Data from Large Language Models for Low-Resource Molecule Discovery	arxiv	11/09/2023	-	-
Exploring the potential of GPT-4 in biomedical engineering: the dawn of a new era	Annals of Biomedical Engineering	28/04/2023	-	-
A GPT-4 Reticular Chemist for Guiding MOF Discovery	Angewandte Chemie International Edition	05/10/2023	-	-
Is GPT-3 all you need for machine learning for chemistry?	NeurIPS 2022 Workshop AI4Mat	22/11/2022	-	-
The future of chemistry is language	Nature Reviews Chemistry	19/05/2023	-	-
What indeed can GPT models do in chemistry? A comprehensive benchmark on eight tasks	arxiv	27/05/2023	-	-
ChemCrow: Augmenting large-language models with chemistry tools	arxiv	11/04/2023	-	-
Prompt engineering of GPT-4 for chemical research: what can/cannot be done?	chemRxiv	05/06/2023	-	-
Fine-tuning GPT-3 for machine learning electronic and functional properties of organic molecules	chemRxiv	23/08/2023	-	-

Medicine/Radiology/Clinical Science

Title	Venue	Date(D/M/Y)	Code	Note
Large language models in medicine	nature medicine(review)	-	-	-
The shaky foundations of large language models and foundation models for electronic health records	npj Digital Medicine	-	-	-
Large language models encode clinical knowledge	nature	12/07/2023	-	-
Evaluating large language models for radiology natural language processing	arXiv	25/07/2023	-	-
Artificial Intelligence in Sports Medicine: Could GPT-4 Make Human Doctors Obsolete?	Annals of Biomedical Engineering	25/04/2023	-	-
Revolutionizing radiology with GPT-based models: Current applications, future possibilities and limitations of ChatGPT	Diagnostic and Interventional Imaging	June 2023	-	-
GPT-4 in Radiology: Improvements in Advanced Reasoning	Radiology	16/05/2023	-	-

Physics

Title	Venue	Date(D/M/Y)	Code	Note
PhysNLU: A Language Resource for Evaluating Natural Language Understanding and Explanation Coherence in Physics	arXiv	02/06/2023	-	-
Evaluating large language models on a highly-specialized topic, radiation oncology physics	arxiv	01/04/2023	-	-
Advances in apparent conceptual physics reasoning in GPT-4	arxiv	29/03/2023	-	-
Using Large Language Model to Solve and Explain Physics Word Problems Approaching Human Level	arxiv	20/09/2023	-	-
MeLM, a generative pretrained language modeling framework that solves forward and inverse mechanics problems	Journal of the Mechanics and Physics of Solids	23/09/2023	-	-
Perspective: Large Language Models in Applied Mechanics	Jouranl of Applied Mechanics	17/07/2023	-	-
Evaluating Large Language Models on a Highly-specialized Topic, Radiation Oncology Physics	arXiv	01/04/2023	-	-

Material Science

Title	Venue	Date(D/M/Y)	Code	Note
Large Language Models as Master Key: Unlocking the Secrets of Materials Science with GPT	arxiv	05/04/2023	-	-
14 examples of how LLMs can transform materials science and chemistry: a reflection on a large language model hackathon	Digital Discovery	12/06/2023	-	-
Accelerated materials language processing enabled by GPT	arxiv	18/08/2023	-	-
Benefits, limits, and risks of GPT-4 as an AI chatbot for medicine	The New England journal of medicine	30/03/2023	-	-
BioinspiredLLM: Conversational Large Language Model for the Mechanics of Biological and Bio-inspired Materials	arxiv	15/09/2023	-	-
MatSciBERT: A materials domain language model for text mining and information extraction	computational materials	03/05/2022	-	-
Material transformers: deep learning language models for generative materials design	Machine Learning: Science and Technology	05/01/2021	-	-

Math

Title	Venue	Date(D/M/Y)	Code	Note
Large language model for science: A study on P vs. NP.	arXiv	11/09/2023	-	-
Can GPT-4 formulate and test a novel hypothesis? Yes and no	TechRxiv	07/04/2023	-	-

Plant Science

Title	Venue	Date(D/M/Y)	Code	Note
One hundred important questions facing plant science derived using a large language model	Trends in Plant Science	2023	Elsevier	-