data

There are 1,828 repositories under data topic.

query
TanStack / query
🤖 Powerful asynchronous state management, server-state utilities and data fetching for the web. TS/JS, React Query, Solid Query, Svelte Query and Vue Query.
async cache data fetch graphql hooks query react rest stale stale-while-revalidate update
Language:TypeScript 40044
metabase / metabase
The simplest, fastest way to get business intelligence and analytics to everyone in your company :yum:
analytics businessintelligence dashboard reporting slack clojure database metabase postgres postgresql mysql bi visualization data data-analysis sql-editor data-visualization business-intelligence
Language:Clojure 36726
sheetjs
SheetJS / sheetjs
📗 SheetJS Spreadsheet Data Toolkit -- New home https://git.sheetjs.com/SheetJS/sheetjs
xlsx excel spreadsheet data xml csv database nodejs html5 javascript ios json react vue angular table html grid deno bun
34546
run-llama / llama_index
LlamaIndex is a data framework for your LLM applications
agents application data fine-tuning framework llamaindex llm rag vector-database
Language:Python 31627
swr
vercel / swr
React Hooks for Data Fetching
react hook data-fetching swr suspense react-native fetch vercel stale-while-revalidate hooks nextjs data cache
Language:TypeScript 29534
fivethirtyeight / data
Data and code behind the articles and graphics at FiveThirtyEight
data
Language:Jupyter Notebook 16647
presto
prestodb / presto
The official home of the Presto distributed SQL query engine for big data
big-data data hadoop hive java lakehouse presto query sql
Language:Java 15619
PrefectHQ / prefect
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines
python workflow data-engineering data-science workflow-engine prefect infrastructure ml-ops data-ops automation orchestration data observability pipeline
Language:Python 14793
airbytehq / airbyte
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
data pipeline data-analysis data-engineering java python etl change-data-capture data-collection data-integration elt bigquery redshift snowflake data-pipeline mssql mysql postgresql s3 self-hosted
Language:Python 14238
oxnr / awesome-bigdata
A curated list of awesome big data frameworks, ressources and other awesomeness.
awesome awesome-list bigdata data data-analytics data-science data-stream data-visualization data-warehouse database distributed-database series-database stream-processing streaming-data visualize-data
12832
faker-js / faker
Generate massive amounts of fake data in the browser and node.js
browser data fake faker javascript nodejs
Language:TypeScript 11857
Sinaptik-AI / pandas-ai
Chat with your database (SQL, CSV, pandas, polars, mongodb, noSQL, etc). PandasAI makes data analysis conversational using LLMs (GPT 3.5 / 4, Anthropic, VertexAI) and RAG.
ai csv data data-analysis data-science database datalake gpt-3 gpt-4 llm pandas sql
Language:Python 11152
pwxcoo / chinese-xinhua
:orange_book: 中华新华字典数据库。包括歇后语，成语，词语，汉字。
data scraper chinese-traditional python3 chinese chinese-characters chinese-nlp chinese-language chinese-simplified json-dataset json json-data
Language:Python 10667
apple / pkl
A configuration as code language with rich validation and tooling.
config configuration data functional java json kotlin language object-oriented pkl programming-language properties propertylist validation xml yaml
Language:Java 9637
prql
PRQL / prql
PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement
data pipeline sql
Language:Rust 9470
DataExpert-io / data-engineer-handbook
This is a repo with links to everything you'd ever want to learn about data engineering
apachespark awesome bigdata data dataengineering sql
8676
rawgraphs-app
rawgraphs / rawgraphs-app
A web interface to create custom vector-based visualizations on top of RAWGraphs core
svg vector-graphics data-visualization rawgraphs d3js data ddj design visualization
Language:JavaScript 8578
akshare
akfamily / akshare
AKShare is an elegant and simple financial data interface library for Python, built for human beings! 开源财经数据接口库
futures financial-data data-science quant fundamental akshare option stock data datasets bond asset-pricing academic currency finance finance-api economic-data economics data-analysis
Language:Python 8464
Bogus
bchavez / Bogus
:card_index: A simple fake data generator for C#, F#, and VB.NET. Based on and ported from the famed faker.js.
fake data generator dotnet csharp faker c-sharp bogus poco data-access-layer database seed test-data data-generator
Language:C# 8348
machine-learning-roadmap
mrdbourke / machine-learning-roadmap
A roadmap connecting many of the most important concepts in machine learning, how to learn them and what tools to use to perform them.
data data-science deep-learning machine-learning
7276
mage-ai / mage-ai
🧙 Build, run, and manage data pipelines for integrating and transforming data.
artificial-intelligence data data-engineering data-integration data-pipelines data-science dbt elt etl machine-learning orchestration pipeline pipelines python reverse-etl spark sql transformation
Language:Python 7131
snowplow
snowplow / snowplow
The enterprise-grade behavioral data engine (web, mobile, server-side, webhooks), running cloud-natively on AWS and GCP
analytics data data-collection data-pipeline marketing-analytics product-analytics snowplow snowplow-events snowplow-pipeline
Language:Scala 6750
kestra
kestra-io / kestra
Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
workflow workflow-engine orchestration scheduler data-pipeline elt etl data data-engineering data-orchestration data-orchestrator low-code data-integration reverse-etl data-quality pipeline
Language:Java 6586
olifolkerd / tabulator
Interactive Tables and Data Grids for JavaScript
tabulator javascript table grid grid-layout grid-system data widget cdnjs json ajax list sort jquery react tabulator-table
Language:JavaScript 6228
dformoso / machine-learning-mindmap
A mindmap summarising Machine Learning concepts, from Data Analysis to Deep Learning.
machine learning data science python jupyter cheatsheet mindmap machine-learning
6040
Parsr
axa-group / Parsr
Transforms PDF, Documents and Images into Enriched Structured Data
parsr pdf images extraction data typescript python ocr document nlp hacktoberfest
Language:JavaScript 5661
cloudquery
cloudquery / cloudquery
The open source high performance ELT framework powered by Apache Arrow
aws gcp azure sql data-integration elt etl etl-framework bigquery data-collection data-engineering kubernetes data airbyte github-api data-analysis google go cspm attack-surface-management
Language:Go 5606
Countly / countly-server
Countly is a product analytics platform that helps teams track, analyze and act-on their user actions and behaviour on mobile, web and desktop applications.
analytics coppa crash-analytics crash-reports dashboard data data-ownership data-privacy feature-flags gdpr hipaa insights mobile-analytics product-analytics product-management push-notifications remote-configuration tracking user-feedback web-analytics
Language:JavaScript 5476
airbnb / knowledge-repo
A next-generation curated knowledge sharing platform for data scientists and other technical professions.
data data-analysis data-science knowledge
Language:Python 5441
flyte
flyteorg / flyte
Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
data data-analysis data-science dataops declarative fine-tuning flyte golang grpc kubernetes kubernetes-operator llm machine-learning mlops orchestration-engine production production-grade python scale workflow
Language:Go 4838
browser-compat-data
mdn / browser-compat-data
This repository contains compatibility data for Web technologies as displayed on MDN
compatibility compat data dataset json
Language:JSON 4803
cue-lang / cue
The home of the CUE language! Validate and define text-based and dynamic configuration
data validation configuration kubernetes
Language:Go 4771
superduperdb
SuperDuperDB / superduperdb
🔮 SuperDuperDB: Bring AI to your database! Build, deploy and manage any AI application directly with your existing data infrastructure, without moving your data. Including streaming inference, scalable model training and vector search.
ai mlops torch transformers mongodb python pytorch ml database data inference distributed-ml llm-inference pretrained-models chatbot semantic-search llm-serving llmops vector-search rag
Language:Python 4397
lk-geimfari / mimesis
Mimesis is a robust data generator for Python that can produce a wide range of fake data in multiple languages.
mimesis fake data generator fixtures dummy schema testing python json-generator mock synthetic-data datascience dataframe pandas syntetic polars pytest-plugin factory factory-boy
Language:Python 4310
ckan / ckan
CKAN is an open-source DMS (data management system) for powering data hubs and data portals. CKAN makes it easy to publish, share and use data. It powers catalog.data.gov, open.canada.ca/data, data.humdata.org among many other sites.
api catalog ckan ckanext data digitalpublicgoods dpg open-data python sdg16
Language:Python 4271
brianvoe / gofakeit
Random fake data generator written in go
go data generator random fake golang seed
Language:Go 4243

data

TanStack / query

metabase / metabase

SheetJS / sheetjs

run-llama / llama_index

vercel / swr

fivethirtyeight / data

prestodb / presto

PrefectHQ / prefect

airbytehq / airbyte

oxnr / awesome-bigdata

faker-js / faker

Sinaptik-AI / pandas-ai

pwxcoo / chinese-xinhua

apple / pkl

PRQL / prql

DataExpert-io / data-engineer-handbook

rawgraphs / rawgraphs-app

akfamily / akshare

bchavez / Bogus

mrdbourke / machine-learning-roadmap

mage-ai / mage-ai

snowplow / snowplow

kestra-io / kestra

olifolkerd / tabulator

dformoso / machine-learning-mindmap

axa-group / Parsr

cloudquery / cloudquery

Countly / countly-server

airbnb / knowledge-repo

flyteorg / flyte

mdn / browser-compat-data

cue-lang / cue

SuperDuperDB / superduperdb

lk-geimfari / mimesis

ckan / ckan

brianvoe / gofakeit

Related Topics