hantek

Jonathan Zhouhan LIN's starred repositories

COAT

A CommonSense Reasoning Dataset pertaining to Physical Commonsense affordance of objects.

800

OpenAI 接口管理 & 分发系统，支持 Azure、Anthropic Claude、Google PaLM 2 & Gemini、智谱 ChatGLM、百度文心一言、讯飞星火认知、阿里通义千问、360 智脑以及腾讯混元，可用于二次分发管理 key，仅单可执行文件，已打包好 Docker 镜像，一键部署，开箱即用. OpenAI key management & redistribution system, using a single API for all LLMs, and features an English UI.

Language:JavaScriptMIT1833500

pg19

Apache-2.022600

ragas

Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines

Language:PythonApache-2.0683700

video-subtitle-extractor

视频硬字幕提取，生成srt文件。无需申请第三方API，本地实现文本识别。基于深度学习的视频字幕提取框架，包含字幕区域检测、字幕内容提取。A GUI tool for extracting hard-coded subtitle (hardsub) from videos and generating srt files.

Language:PythonApache-2.0585500

unarXive

A data set based on all arXiv publications, pre-processed for NLP, including structured full-text and citation network

Language:PythonMIT25800

k2

Code and datasets for paper "K2: A Foundation Language Model for Geoscience Knowledge Understanding and Utilization" in WSDM-2024

Language:PythonApache-2.016800

faiss

A library for efficient similarity search and clustering of dense vectors.

Language:C++MIT3084500

SnakeGame

A Snake Game in c++ and Qt for cs1605 homework

Language:C++200

long_tail_knowledge

Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"

Language:Python7200

EasySpider

A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。

Language:JavaScriptNOASSERTION3483500

ProteinMPNN

Code for the ProteinMPNN paper

Language:Jupyter NotebookMIT96800

CBook-150K

中文图书语料MD5链接

Language:PythonApache-2.021000

JARVIS

JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf

Language:PythonMIT2359600

Chinese-LLaMA-Alpaca

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

Language:PythonApache-2.01825500

wikiextractor

A tool for extracting plain text from Wikipedia dumps

Language:PythonAGPL-3.0374200

LoRA

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

Language:PythonMIT1046100

BELLE

BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）

Language:HTMLApache-2.0785100

MNBVC

MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。

MIT342700