data

There are 1,842 repositories under data topic.

query
TanStack / query
🤖 Powerful asynchronous state management, server-state utilities and data fetching for the web. TS/JS, React Query, Solid Query, Svelte Query and Vue Query.
async cache data fetch graphql hooks query react rest solid stale stale-while-revalidate svelte typescript update vue
Language:TypeScript 42805
metabase / metabase
The simplest, fastest way to get business intelligence and analytics to everyone in your company :yum:
analytics bi business-intelligence businessintelligence clojure dashboard data data-analysis data-visualization database metabase mysql postgres postgresql reporting slack sql-editor visualization
Language:Clojure 39006
run-llama / llama_index
LlamaIndex is a data framework for your LLM applications
agents application data fine-tuning framework llamaindex llm multi-agents rag vector-database
Language:Python 37150
sheetjs
SheetJS / sheetjs
📗 SheetJS Spreadsheet Data Toolkit -- New home https://git.sheetjs.com/SheetJS/sheetjs
angular bun csv data database deno excel grid html html5 ios javascript json nodejs react spreadsheet table vue xlsx xml
35223
swr
vercel / swr
React Hooks for Data Fetching
react hook data-fetching swr suspense react-native fetch vercel stale-while-revalidate hooks nextjs data cache
Language:TypeScript 30654
DataExpert-io / data-engineer-handbook
This is a repo with links to everything you'd ever want to learn about data engineering
apachespark awesome bigdata data dataengineering sql
Language:Jupyter Notebook 22505
mendableai / firecrawl
🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.
ai ai-scraping crawler data html-to-markdown llm markdown rag scraper scraping web-crawler webscraping
Language:TypeScript 19405
PrefectHQ / prefect
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
automation data data-engineering data-ops data-science infrastructure ml-ops observability orchestration pipeline prefect python workflow workflow-engine
Language:Python 17684
fivethirtyeight / data
Data and code behind the articles and graphics at FiveThirtyEight
data
Language:Jupyter Notebook 16873
airbytehq / airbyte
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
bigquery change-data-capture data data-analysis data-collection data-engineering data-integration data-pipeline elt etl java mssql mysql pipeline postgresql python redshift s3 self-hosted snowflake
Language:Python 16374
presto
prestodb / presto
The official home of the Presto distributed SQL query engine for big data
big-data data hadoop hive java lakehouse presto query sql
Language:Java 16087
Sinaptik-AI / pandas-ai
Chat with your database (SQL, CSV, pandas, polars, mongodb, noSQL, etc). PandasAI makes data analysis conversational using LLMs (GPT 3.5 / 4, Anthropic, VertexAI) and RAG.
ai csv data data-analysis data-science database datalake gpt-3 gpt-4 llm pandas sql
Language:Python 13632
oxnr / awesome-bigdata
A curated list of awesome big data frameworks, ressources and other awesomeness.
awesome bigdata data-warehouse data-analytics data-visualization data-stream database data-science data awesome-list distributed-database series-database stream-processing streaming-data visualize-data
13293
faker-js / faker
Generate massive amounts of fake data in the browser and node.js
faker data fake nodejs browser javascript
Language:TypeScript 13101
pwxcoo / chinese-xinhua
:orange_book: 中华新华字典数据库。包括歇后语，成语，词语，汉字。
chinese chinese-characters chinese-language chinese-nlp chinese-simplified chinese-traditional data json json-data json-dataset python3 scraper
Language:Python 10971
apple / pkl
A configuration as code language with rich validation and tooling.
config configuration data functional java json kotlin language object-oriented pkl programming-language properties propertylist validation xml yaml
Language:Java 10408
prql
PRQL / prql
PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement
data pipeline sql
Language:Rust 9990
akshare
akfamily / akshare
AKShare is an elegant and simple financial data interface library for Python, built for human beings! 开源财经数据接口库
academic akshare asset-pricing bond currency data data-analysis data-science datasets economic-data economics finance finance-api financial-data fundamental futures option quant stock
Language:Python 9660
Bogus
bchavez / Bogus
:card_index: A simple fake data generator for C#, F#, and VB.NET. Based on and ported from the famed faker.js.
bogus c-sharp csharp data data-access-layer data-generator database dotnet fake faker generator poco seed test-data
Language:C# 8904
rawgraphs-app
rawgraphs / rawgraphs-app
A web interface to create custom vector-based visualizations on top of RAWGraphs core
d3js data data-visualization ddj design rawgraphs svg vector-graphics visualization
Language:JavaScript 8686
mage-ai / mage-ai
🧙 Build, run, and manage data pipelines for integrating and transforming data.
artificial-intelligence data data-engineering data-integration data-pipelines data-science dbt elt etl machine-learning orchestration pipeline pipelines python reverse-etl spark sql transformation
Language:Python 8009
machine-learning-roadmap
mrdbourke / machine-learning-roadmap
A roadmap connecting many of the most important concepts in machine learning, how to learn them and what tools to use to perform them.
data data-science deep-learning machine-learning
7562
snowplow
snowplow / snowplow
The leader in Next-Generation Customer Data Infrastructure
analytics data data-collection data-pipeline marketing-analytics product-analytics snowplow snowplow-events snowplow-pipeline
Language:Scala 6852
olifolkerd / tabulator
Interactive Tables and Data Grids for JavaScript
ajax cdnjs data grid grid-layout grid-system javascript jquery json list react sort table tabulator tabulator-table widget
Language:JavaScript 6793
dformoso / machine-learning-mindmap
A mindmap summarising Machine Learning concepts, from Data Analysis to Deep Learning.
machine learning data science python jupyter cheatsheet mindmap machine-learning
6139
cloudquery
cloudquery / cloudquery
The open source high performance ELT framework powered by Apache Arrow
airbyte attack-surface-management aws azure bigquery cspm data data-analysis data-collection data-engineering data-integration elt etl etl-framework gcp github-api go google kubernetes sql
Language:Go 5896
Parsr
axa-group / Parsr
Transforms PDF, Documents and Images into Enriched Structured Data
data document extraction hacktoberfest images nlp ocr parsr pdf python typescript
Language:JavaScript 5861
flyte
flyteorg / flyte
Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
data data-analysis data-science dataops declarative fine-tuning flyte golang grpc hacktoberfest kubernetes kubernetes-operator llm machine-learning mlops orchestration-engine production python scale workflow
Language:Go 5829
Countly / countly-server
Countly is a product analytics platform that helps teams track, analyze and act-on their user actions and behaviour on mobile, web and desktop applications.
analytics coppa crash-analytics crash-reports dashboard data data-ownership data-privacy feature-flags gdpr hipaa insights mobile-analytics product-analytics product-management push-notifications remote-configuration tracking user-feedback web-analytics
Language:JavaScript 5605
airbnb / knowledge-repo
A next-generation curated knowledge sharing platform for data scientists and other technical professions.
data data-analysis data-science knowledge
Language:Python 5487
cue-lang / cue
The home of the CUE language! Validate and define text-based and dynamic configuration
configuration data kubernetes validation
Language:Go 5158
browser-compat-data
mdn / browser-compat-data
This repository contains compatibility data for Web technologies as displayed on MDN
compat compatibility data dataset json
Language:JSON 5021
superduper
superduper-io / superduper
Superduper: Build end-to-end AI applications and agent workflows on your existing data infrastructure and preferred tools - without migrating your data.
ai mlops torch transformers mongodb python pytorch ml database data inference distributed-ml llm-inference pretrained-models chatbot semantic-search llm-serving llmops vector-search rag
Language:Python 4845
brianvoe / gofakeit
Random fake data generator written in go
data fake generator go golang random seed
Language:Go 4602
ckan / ckan
CKAN is an open-source DMS (data management system) for powering data hubs and data portals. CKAN makes it easy to publish, share and use data. It powers catalog.data.gov, open.canada.ca/data, data.humdata.org among many other sites.
api catalog ckan ckanext data digitalpublicgoods dpg open-data python sdg16
Language:Python 4493
lk-geimfari / mimesis
Mimesis is a robust data generator for Python that can produce a wide range of fake data in multiple languages.
data dataframe datascience dummy factory factory-boy fake fixtures generator json-generator mimesis mock pandas polars pytest-plugin python schema syntetic synthetic-data testing
Language:Python 4452

data

TanStack / query

metabase / metabase

run-llama / llama_index

SheetJS / sheetjs

vercel / swr

DataExpert-io / data-engineer-handbook

mendableai / firecrawl

PrefectHQ / prefect

fivethirtyeight / data

airbytehq / airbyte

prestodb / presto

Sinaptik-AI / pandas-ai

oxnr / awesome-bigdata

faker-js / faker

pwxcoo / chinese-xinhua

apple / pkl

PRQL / prql

akfamily / akshare

bchavez / Bogus

rawgraphs / rawgraphs-app

mage-ai / mage-ai

mrdbourke / machine-learning-roadmap

snowplow / snowplow

olifolkerd / tabulator

dformoso / machine-learning-mindmap

cloudquery / cloudquery

axa-group / Parsr

flyteorg / flyte

Countly / countly-server

airbnb / knowledge-repo

cue-lang / cue

mdn / browser-compat-data

superduper-io / superduper

brianvoe / gofakeit

ckan / ckan

lk-geimfari / mimesis

Related Topics