data-centric

There are 2 repositories under data-centric topic.

ludwig
ludwig-ai / ludwig
Low-code framework for building custom LLMs, neural networks, and other AI models
deep-learning deeplearning deep learning machine-learning machinelearning natural-language-processing natural-language computer-vision data-centric data-science pytorch neural-network ml llm llm-training fine-tuning llama mistral llama2
Language:Python 10862
lancedb / lance
Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..
machine-learning computer-vision data-format deep-learning python apache-arrow duckdb mlops data-analysis data-analytics data-science dataops data-centric embeddings rust llms
Language:Rust 3331
data-centric-AI
daochenzha / data-centric-AI
A curated, but incomplete, list of data-centric AI resources.
artificial-intelligence data-centric-ai ai machine-learning data-curation data-centric data-centric-machine-learning data-science data-quality data-engineering
992
encord-team / encord-active
The toolkit to test, validate, and evaluate your models and surface, curate, and prioritize the most valuable data for labeling.
computer-vision data data-science data-validation deep-learning machine-learning ml mlops python active-learning annotations data-centric data-cleaning data-quality label-errors model-quality noisy-labels label-quality object-detection
Language:Python 423
hkust-nlp / deita
Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]
alignment data-centric instruction-tuning large-language-models
Language:Python 365
CLUEbenchmark / DataCLUE
DataCLUE: 数据为中心的NLP基准和工具包
data-centric nlp chinese classification-algorithm ai human-in-the-loop
Language:Python 145
dust-dds
s2e-systems / dust-dds
Rust implementation of the Data Distribution Service (DDS)
data-centric dds middleware rust udp dcps
Language:Rust 55
ChandlerBang / GTrans
[ICLR'23] Implementation of "Empowering Graph Representation Learning with Test-Time Graph Transformation"
adversarial-attacks data-centric distribution-shift graph-neural-networks out-of-distribution robustness test-time-adaptation
Language:Python 51
Acharya
astutic / Acharya
A Data Centric NER annotation tool for your Named Entity Recognition projects
mlops data-centric ai named-entity-recognition ner machine-learning natural-language-processing datasets annotation-tool text-annotation text-annotation-tool data-labeling data-labeling-tools annota annotation-processing data-centric-ai data-quality data-quality-monitoring
47
vuejs-form
zhorton34 / vuejs-form
Vue Form with Laravel Inspired Validation and Simply Enjoyable Error Messages Api. (Form Api, Validator Api, Rules Api, Error Messages Api)
vue js reactivity data-centric javascript react reactjs
Language:JavaScript 41
PrincetonUniversity / muchiSim
Simulator framework for analysis of performance, energy consumption, area and cost of multi-node multi-chiplet tile-based manycore designs
cost-model data-centric data-local energy-model execution manycore multi-chip multi-chiplet network performance-modeling-and-analysis pgas simulation simulator
Language:C++ 27
Maksims / mr-Observer
An observer is a wrapper over JSON data, that provides an interface to know when data is changed, with a focus on performance and memory efficiency.
observer object-proxying data-proxy json-proxy data-centric
Language:JavaScript 23
kennethleungty / Data-Centric-AI-Competition
Codes for a Top 5% finish in the Data-Centric AI Competition organized by Andrew Ng and DeepLearning.AI
ai andrew-ng data-centric data-centric-ai data-science deep-learning machine-learning
Language:Jupyter Notebook 20
openlayer-ai / examples-gallery
Sample notebooks that use the Openlayer Python API
ai data-centric machine-learning machine-learning-operations ml ml-infrastructure mlops model-deployment model-explainability synthetic-dataset-generation tensorflow unbox
Language:Jupyter Notebook 18
minnesotanlp / infoVerse
Jaehyung Kim et al's ACL 2023 paper on "infoVerse: A Universal Framework for Dataset Characterization with Multidimensional Meta-information"
active-learning data-annotation data-centric dpp nlp data-pruning
Language:Python 16
stoney95 / pypely
From local functions to cloud deployed pipelines
functional-programming pipeline pipe readability testability data data-centric mlops
Language:Python 16
seedatnabeel / Data-IQ
Data-IQ: Characterizing subgroups with heterogeneous outcomes in tabular data (NeurIPS 2022)
data-centric data-centric-ai data-centric-machine-learning data-quality data-quality-assessment data-science deep-learning machine-learning responsible-ai trustworthy-ai
Language:Jupyter Notebook 13
mdbloice / Labeller
Quickly set up an image labelling web application for manually tagging images for machine learning tasks.
data-centric machine-learning-library data-centric-ai
Language:Python 9
seedatnabeel / Data-SUITE
Data-SUITE: Data-centric identification of in-distribution incongruous examples (ICML 2022)
data-centric data-centric-ai data-centric-machine-learning data-quality data-quality-monitoring data-science machine-learning responsible-ai trustworthy-machine-learning
Language:Jupyter Notebook 9
NileDB / com.niledb.core
Open-source Data Backend written in Java and based on PostgreSQL & GraphQL.
graphql-api database data-centric tutorial discussion iot sql postgresql deeplearning4j feedback-appreciated deep-learning api-first headless backend data-security mqtt model-driven nifi data-flow graphql-server
Language:JavaScript 8
rajive / doma
Data-Oriented Microservices Architecture Framework using DDS
dds microservices cpp11 cpp lua data-centric data-oriented
Language:Shell 6
justincpresley / ndn-hydra
ndn-hydra: A Python-coded NDN distributed repository with five focused attributes: resiliency, scalability, usability, efficiency, and security.
data-centric distributed distributed-database distributed-systems files filesystem hydra information-centric-network named-data-networking ndn-hydra network networking noc python python3 repository resilience resiliency security
Language:Python 4
NileDB / com.niledb.dataflow
A series of NiFi processors that facilitate ingestion of data into NileDB Core platform.
graphql-api graphql-shcema database data-centric tutorial discussion iot sql postgresql deeplearning4j feedback-appreciated deep-learning api-first headless backend data-security mqtt model-driven nifi data-flow
Language:Java 3
datacentricorg / datacentric-cpp
Data-centric core services library in C++. For the version supporting multiple languages, see datacentric repo.
cpp data-centric
Language:C++ 2
cadmiumkitty / dcaf-2020-provo
Demo code for my talk at Data-Centric Architecture Forum 2020 about data provenance and PROV ontology.
data-centric data-provenance kafka prov
Language:Java 1
datacentricorg / datacentric
Data-centric, cross-platform, multi-language core services library for C++, C#, Python, and Java. This repository includes all languages. Each language also has its own repository, e.g. datacentric-cpp.
cpp csharp data-centric java python
Language:C# 1
datacentricorg / datacentric-cs
Data-centric core services library in C#. For the version supporting multiple languages, see datacentric repo.
csharp data-centric
Language:C# 1
datacentricorg / datacentric-py
Data-centric core services library in Python. For the version supporting multiple languages, see datacentric repo.
data-centric python
Language:Python 1
nikimacm / trailmixers-project3
Python and Data Centric Development: A full-stack site that allows users to add, edit, delete and search hiking trails in the Province of Andalucia, Spain. They can also upload photos and maps showing their trails. Each route will provide: A title, Address of the trail , Difficulty level, Description, Directions , Photos, Maps
api css data-centric html javascript mongodb python
Language:HTML 1
rajive / doma-skel
DOMA Skeleton - Document and Setup a DOMA Repository - Clone Me!
architecture dds repository-pattern architectural-patterns data-centric data-oriented data-oriented-design databus dataspace omg-dds
Language:Lua 1
datacentricorg / datacentric-java
Data-centric core services library in Java. For the version supporting multiple languages, see datacentric repo.
data-centric java
0
bryce-bowles / opioid-prescribing-rates
Semester long project working with Virginia Department of Social Services to assist in data centric reengineer useful data into VA’s major FAACT database. Tableau dashboard analysis and presentation created using data from 2016 to 2019 on Medicare Prescribing rates.
data-centric data-reengineering tableau
zenetio / Traffic-Car-Classifier
Use CNN to classify traffic signs
traffic-signs model-architecture data-centric cnn-classification computer-vision python prediction-model
Language:Jupyter Notebook

data-centric

ludwig-ai / ludwig

lancedb / lance

daochenzha / data-centric-AI

encord-team / encord-active

hkust-nlp / deita

CLUEbenchmark / DataCLUE

s2e-systems / dust-dds

ChandlerBang / GTrans

astutic / Acharya

zhorton34 / vuejs-form

PrincetonUniversity / muchiSim

Maksims / mr-Observer

kennethleungty / Data-Centric-AI-Competition

openlayer-ai / examples-gallery

minnesotanlp / infoVerse

stoney95 / pypely

seedatnabeel / Data-IQ

mdbloice / Labeller

seedatnabeel / Data-SUITE

NileDB / com.niledb.core

rajive / doma

justincpresley / ndn-hydra

NileDB / com.niledb.dataflow

datacentricorg / datacentric-cpp

cadmiumkitty / dcaf-2020-provo

datacentricorg / datacentric

datacentricorg / datacentric-cs

datacentricorg / datacentric-py

nikimacm / trailmixers-project3

rajive / doma-skel

datacentricorg / datacentric-java

bryce-bowles / opioid-prescribing-rates

zenetio / Traffic-Car-Classifier