Junzh821

cc_net

Tools to download and cleanup Common Crawl data

GLM-4

GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型

LLMs-from-scratch

Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step

marker

Convert PDF to markdown quickly with high accuracy

gpt_academic

为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss等。

yolov10

YOLOv10: Real-Time End-to-End Object Detection

LLM-from-scratch

一些 LLM 方面的从零复现笔记

Pix2Text

An Open-Source Python3 tool for recognizing layouts, tables, math formulas (LaTeX), and text in images, converting them into Markdown format. A free alternative to Mathpix, empowering seamless conversion of visual content into text-based representations. 80+ languages are supported.

scaling_laws_data_filtering

Phi-3CookBook

This is a Phi-3 book for getting started with Phi-3. Phi-3, a family of open AI models developed by Microsoft. Phi-3 models are the most capable and cost-effective small language models (SLMs) available, outperforming models of the same size and next size up across a variety of language, reasoning, coding, and math benchmarks.

ollama-python

Ollama Python library

llama.cpp

LLM inference in C/C++

open-instruct

llama3-from-scratch

llama3 implementation one matrix multiplication at a time

InternVL

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4V. 接近GPT-4V表现的可商用开源多模态对话模型

llama3.np

llama3.np is a pure NumPy implementation for Llama 3 model.

screenshot-to-code

Drop in a screenshot and convert it to clean code (HTML/Tailwind/React/Vue)

marker-api

Easily deployable 🚀 API to convert PDF to markdown quickly with high accuracy.

LLaMA-Factory

Unify Efficient Fine-Tuning of 100+ LLMs

QuRating

[ICML 2024] Selecting High-Quality Data for Training Language Models

llama-moe

⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training

Awesome-Chinese-LLM

整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。

ragflow

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

DeepSeek-V2

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

extractnet

A fork of Dragnet that also extract author, headline, date, keywords from context, as well as built in metadata extraction all in one package

SWE-agent

SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It solves 12.47% of bugs in the SWE-bench evaluation set and takes just 1 minute to run.

gpt-prompt-engineer

Open-Sora

Open-Sora: Democratizing Efficient Video Production for All

data-selection-survey

A Survey on Data Selection for Language Models

lean-side-bussiness

精益副业：程序员如何优雅地做副业