songkq's repositories
AI-Writer
Alwrity. AI Content generation & Automation. Web Researched factual content, SEO optimised, high quality AI content. Generate blog Images. Complete AI-Powered Content suite for Marketing teams.
aider
aider is AI pair programming in your terminal
awesome-ai-agents
A list of AI autonomous agents
Awesome-LLM-Eval
Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, learderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表，主要面向大型语言模型评测（例如ChatGPT、LLaMA、GLM、Baichuan等）.
Cherry_LLM
[NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other models
crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
dataverse
The Universe of Data. All about data, data science, and data engineering
EasySpider
A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。
evals
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
evalverse
The Universe of Evaluation. All about the evaluation for LLMs.
fundus
A very simple news crawler with a funny name
haystack
:mag: LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.
lilac
Curate better data for LLMs
llama2.c
Inference Llama 2 in one file of pure C
llama3-from-scratch
llama3 implementation one matrix multiplication at a time
llm-comparator
LLM Comparator is an interactive data visualization tool for evaluating and analyzing LLM responses side-by-side, developed by the PAIR team.
llm-datasets
High-quality datasets, tools, and concepts for LLM fine-tuning.
llm.c
LLM in simple, raw C/CUDA
multi-review-fusion-in-context
multi-review-fusion benchmark
openlit
OpenLIT is an open-source GenAI and LLM observability platform native to OpenTelemetry with traces and metrics in a single application 🔥 🖥 . 👉 Open source GenAI and LLM Application Performance Monitoring (APM) & Observability tool
phidata
Build AI Agents with memory, knowledge and tools.
reader
Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/
restai
RestAI is an AIaaS (AI as a Service) open-source platform. Built on top of LlamaIndex, Ollama and HF Pipelines. Supports any public LLM supported by LlamaIndex and any local LLM suported by Ollama. Precise embeddings usage and tuning.
RTranslator
Open source real-time translation app for Android that runs locally
scrapper
Web scraper with a simple REST API living in Docker and using a Headless browser and Readability.js for parsing.
so-large-lm
大模型基础: 一文了解大模型基础知识
wechatArticleDownload
微信公众号文章批量下载工具，支持图片、评论下载，支持保存html/md/pdf/docx文件