datasets

There are 89 repositories under datasets topic.

awesomedata / awesome-public-datasets
A topic-centric list of HQ open datasets.
aaron-swartz awesome-public-datasets datasets opendata
66973
label-studio
HumanSignal / label-studio
Label Studio is a multi-type data labeling and annotation tool with standardized output format
computer-vision deep-learning image-annotation annotation-tool annotation labeling labeling-tool image-labeling image-labelling-tool boundingbox image-classification annotations semantic-segmentation dataset datasets label-studio data-labeling text-annotation yolo mlops
Language:JavaScript 24725
datasets
huggingface / datasets
🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools
nlp datasets pytorch tensorflow pandas numpy natural-language-processing computer-vision machine-learning deep-learning speech ai artificial-intelligence llm dataset-hub
Language:Python 20647
akshare
akfamily / akshare
AKShare is an elegant and simple financial data interface library for Python, built for human beings! 开源财经数据接口库
academic akshare asset-pricing bond currency data data-analysis data-science datasets economic-data economics finance finance-api financial-data fundamental futures option quant stock
Language:Python 13455
tonybeltramelli / pix2code
pix2code: Generating Code from a Graphical User Interface Screenshot
datasets deep-learning deep-neural-networks front-end-development graphical-user-interface
Language:Python 12040
cleanlab / cleanlab
Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
weak-supervision data-cleaning data-quality data-science noisy-labels data-centric-ai out-of-distribution-detection outlier-detection active-learning data-labeling data-profiling data-validation labeling data-curation annotation dataops dataquality llms datasets exploratory-data-analysis
Language:Python 10893
datasette
simonw / datasette
An open source multi-tool for exploring and publishing data
sqlite python datasets json docker datasette automatic-api asgi csv datasette-io sql
Language:Python 10327
doccano / doccano
Open source annotation tool for machine learning practitioners.
annotation-tool data-labeling dataset datasets machine-learning natural-language-processing nuxt nuxtjs python text-annotation vue vuejs
Language:Python 10273
techniques
satellite-image-deep-learning / techniques
Techniques for deep learning with satellite & aerial imagery
deep-learning deep-neural-networks satellite-imagery pytorch python machine-learning sentinel satellite-images dataset remote-sensing datasets convolutional-neural-networks image-classification satellite-data earth-observation object-detection
9698
activeloopai / deeplake
Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai
ai computer-vision cv data-science datalake datasets deep-learning image-processing langchain large-language-models llm machine-learning ml mlops multi-modal python pytorch tensorflow vector-database vector-search
Language:Python 8816
fl_chart
imaNNeo / fl_chart
FL Chart is a highly customizable Flutter chart library that supports Line Chart, Bar Chart, Pie Chart, Scatter Chart, Radar Chart and Candlestick Chart.
flutter-widget flutter chart charts fl-chart graph linechart barchart piechart datasets radar-chart scatter-chart scatter-plot radar-graphs hacktoberfest candlestick candlestick-chart candlesticks
Language:Dart 7281
phoenix
Arize-ai / phoenix
AI Observability & Evaluation
llmops ai-monitoring ai-observability llm-eval aiengineering datasets agents llms prompt-engineering anthropic evals llm-evaluation openai langchain llamaindex smolagents
Language:Jupyter Notebook 6963
liuruoze / EasyPR
(CGCSTCD'2017) An easy, flexible, and accurate plate recognition project for Chinese licenses in unconstrained situations. CGCSTCD = China Graduate Contest on Smart-city Technology and Creative Design
artificial-intelligence artificial-neural-networks chinese-characters computer-vision datasets machine-learning opencv opencv3 plate-recognition supervised-learning support-vector-machines unconstrained-situation
Language:C++ 6412
tensorflow / datasets
TFDS is a collection of datasets ready to use with TensorFlow, Jax, ...
tensorflow machine-learning data datasets numpy jax dataset
Language:Python 4481
CLUEbenchmark / CLUEDatasetSearch
搜索所有中文NLP数据集，附常用英文NLP数据集
nlp datasets chinese ner qa match text-classification machine-translation knowledge-graph corpus machine-reading-comprehension sentiment-analysis text-similarity text-summarization
Language:Python 4369
jdorfman / awesome-json-datasets
A curated list of awesome JSON datasets that don't require authentication.
json-dataset json awesome awesome-list list data dataset datasets
Language:JavaScript 3484
roapi / roapi
Create full-fledged APIs for slowly moving datasets without writing a single line of code.
sql graphql arrow rest-api analytics query columnar rust in-memory-database datafusion blob-storage cloud-native parquet query-frontends datasets static-datasets s3 delta-lake
Language:Rust 3340
microsoft / torchgeo
TorchGeo: datasets, samplers, transforms, and pre-trained models for geospatial data
computer-vision datasets deep-learning earth-observation geospatial models pytorch remote-sensing satellite-imagery torchvision transforms
Language:Python 3319
codefuse-ai / Awesome-Code-LLM
[TMLR] A curated list of language modeling researches for code (and other software engineering activities), plus related datasets.
datasets llm papers software-engineering survey ai awesome nlp tmlr
2880
zhulf0804 / 3D-PointCloud
Papers and Datasets about Point Cloud.
point-cloud registration segmentation classification completion detection autonomous-driving generation papers datasets monocular
Language:Python 2798
RUC-NLPIR / FlashRAG
⚡FlashRAG: A Python Toolkit for Efficient RAG Research (WWW2025 Resource)
benchmark datasets large-language-models retrieval-augmented-generation
Language:Python 2703
justinzm / gopup
数据接口：百度、谷歌、头条、微博指数,宏观数据，利率数据，货币汇率，千里马、独角兽公司，新闻联播文字稿，影视票房数据，高校名单，疫情数据…
data-analysis covid19-data index-data economic-data datasets gopup python data-science data
Language:Python 2556
colour
colour-science / colour
Colour Science for Python
color color-science color-space color-spaces colorspace colorspaces colour colour-science colour-space colour-spaces colourspace colourspaces data dataset datasets python spectral-data spectral-dataset spectral-datasets
Language:Python 2389
github / CodeSearchNet
Datasets, tools, and benchmarks for representation learning of code.
deep-learning natural-language-processing programming-language-theory machine-learning tensorflow datasets data-science machine-learning-on-source-code representation-learning neural-networks python ml open-data data cnn rnn self-attention bert nlp nlp-machine-learning
Language:Jupyter Notebook 2371
FreedomIntelligence / Medical_NLP
Medical NLP Competition, dataset, large models, paper
collection datasets list medical models nlp
2265
jsbroks / coco-annotator
:pencil2: Web-based image segmentation tool for object detection, localization, and keypoints
machine-learning coco datasets annotate-images computer-vision deep-learning image-labeling coco-annotator image-annotation image-segmentation coco-format detection label
Language:Vue 2238
Open3D-ML
isl-org / Open3D-ML
An extension of Open3D to address 3D Machine Learning tasks
3d-perception datasets pretrained-models lidar rgbd tensorflow pytorch visualization semantic-segmentation object-detection 3d-object-detection
Language:Python 2127
pytorch-cpp
prabhuomkar / pytorch-cpp
C++ Implementation of PyTorch Tutorials for Everyone
cplusplus artificial-intelligence machine-learning pytorch torch tensors neural-network autograd libtorch recurrent-neural-network tutorial generative-adversarial-network convolutional-neural-network language-model interactive-tutorials colab datasets scriptmodule-files
Language:C++ 2079
logpai / loghub
A large collection of system log datasets for AI-driven log analytics [ISSRE'23]
logs unstructured-logs log-analysis log-parsing datasets anomaly-detection log-intelligence
2050
WLiK / LLM4Rec-Awesome-Papers
A list of awesome papers and resources of recommender system on large language model (LLM).
awesome datasets large-language-models llm4rec recommender-system survey
2035
jim-schwoebel / voice_datasets
🔊 A comprehensive list of open-source datasets for voice and sound computing (95+ datasets).
voice-dataset voice-datasets audio-dataset audio-datasets datasets dataset voice data voice-computing voice-control voice-synthesis voice-commands voice-assistant voice-recognition voice-chat voice-activity-detection voice-conversion noise
2014
snap-stanford / ogb
Benchmark datasets, data loaders, and evaluators for graph machine learning
datasets deep-learning graph-machine-learning graph-neural-networks
Language:Python 1995
eosphoros-ai / DB-GPT-Hub
A repository that contains models, datasets, and fine-tuning techniques for DB-GPT, with the purpose of enhancing model performance in Text-to-SQL
sql text2sql gpt llm text-to-sql datasets nl2sql database fine-tuning hacktoberfest
Language:Python 1893
diffgram
diffgram / diffgram
The AI Datastore for Schemas, BLOBs, and Predictions. Use with your apps or integrate built-in Human Supervision, Data Workflow, and UI Catalog to get the most value out of your AI Data.
annotation annotation-tool training-data video-annotation data-annotation kubernetes data-science data-analytics image-annotation machine-learning deep-learning data annotations datasets labeling datastore
Language:Python 1881
JuliaData / DataFrames.jl
In-memory tabular data in Julia
data data-frame dataframes datasets hacktoberfest julia tabular-data
Language:Julia 1784
ChineseGLUE / ChineseGLUE
Language Understanding Evaluation benchmark for Chinese: datasets, baselines, pre-trained models,corpus and leaderboard
glue language-understanding bert pre-trained-model chinese-corpus nlp albert datasets
Language:Python 1781