synthetic-dataset-generation

There are 13 repositories under synthetic-dataset-generation topic.

Eladlev / AutoPrompt
A framework for prompt tuning using Intent-based Prompt Calibration
prompt-engineering prompt-tuning synthetic-dataset-generation
Language:Python 1621
Unity-Technologies / com.unity.perception
Perception toolkit for sim2real training and validation in Unity
perception object-detection detection computer-vision deep-learning synthetic-dataset-generation domain-randomization pose-estimation machine-learning segmentation
Language:C# 871
nicolas-hbt / pygraft
Configurable Generation of Synthetic Schemas and Knowledge Graphs at Your Fingertips
data-generator graph-generator knowledge-base knowledge-graph ontology schema semantic-web ontology-generation python synthetic-data synthetic-dataset-generation contributions-welcome owl rdf rdfs artificial-intelligence benchmarking linked-data machine-learning semantics
Language:Python 639
DataDreamer
datadreamer-dev / DataDreamer
DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤
deep-learning machine-learning natural-language-processing nlp nlp-library python pytorch transformers alignment fine-tuning gpt instruction-tuning llm llmops llms openai synthetic-data synthetic-dataset-generation
Language:Python 631
paulbricman / thisrepositorydoesnotexist
A curated list of awesome projects which use Machine Learning to generate synthetic content.
synthetic-data synthetic-dataset-generation synthetic-images generation-algorithms generative-adversarial-network
581
NVIDIA / Dataset_Synthesizer
NVIDIA Deep learning Dataset Synthesizer (NDDS)
computer-vision deep-learning synthetic-dataset-generation domain-randomization pose-estimation object-detection
Language:C++ 555
BatsResearch / bonito
A lightweight library for generating synthetic instruction tuning datasets for your data without GPT.
domain-adaptation gpt llm synthetic-data synthetic-dataset-generation task-adaptation zero-shot-learning
Language:Python 466
Unity-Technologies / SynthDet
SynthDet - An end-to-end object detection pipeline using synthetic data
object-detection detection computer-vision deep-learning synthetic-data synthetic-dataset synthetic-dataset-generation domain-randomization pose-estimation machine-learning
Language:C# 350
augraphy
sparkfish / augraphy
Augmentation pipeline for rendering synthetic paper printing, faxing, scanning and copy machine processes
data-augmentation crappification deep-neural-networks training-data machine-learning data-pipeline image-processing augmentation-pipeline synthetic-data synthetic-dataset-generation computer-vision
Language:Python 299
tirthajyoti / pydbgen
Random dataframe and database table generator
database random-generation pandas-dataframe sqlite3 sqlite python synthetic-data data-science generator data-generation fake-data synthetic-dataset-generation
Language:Python 292
PeopleSansPeople
Unity-Technologies / PeopleSansPeople
Unity's privacy-preserving human-centric synthetic data generator
owner-machine-learning billing-5160 applied-ml-research computer-vision human-centric-ml deep-learning synthetic-data synthetic-data-generation synthetic-datasets synthetic-dataset-generation human-pose-estimation human-activity-recognition perception unity unity3d labeling icml-2022 object-detection pose-estimation transfer-learning
Language:C# 292
fjxmlzn / DoppelGANger
[IMC 2020 (Best Paper Finalist)] Using GANs for Sharing Networked Time Series Data: Challenges, Initial Promise, and Open Questions
dataset-generation privacy time-series timeseries gan gans generative-adversarial-network synthetic-data synthetic-dataset-generation synthetic-data-generation synthetic-data-generator doppelganger fidelity datasets
Language:Python 275
firmai / datagene
DataGene - Identify How Similar TS Datasets Are to One Another (by @firmai)
dataset-generation synthetic-data synthesizers synthetic-dataset-generation distance-measures decomposition encoding finance data-structures predictive-maintenance model-checking testing-framework similarity-measures similarity-score dataset-similarity transformation-recipes data-transformations distance-calculations
Language:Jupyter Notebook 191
worldbank / REaLTabFormer
A suite of auto-regressive and Seq2Seq (sequence-to-sequence) transformer models for tabular and relational synthetic data generation.
data-generation deep-learning gpt gpt-2 seq2seq-model synthetic-data synthetic-dataset-generation tabular-data transformers
Language:Jupyter Notebook 178
DeFMO
rozumden / DeFMO
[CVPR 2021] DeFMO: Deblurring and Shape Recovery of Fast Moving Objects
fast-moving-objects temporal-super-resolution deblurring deep-learning semi-supervised-learning synthetic-dataset-generation motion-blur disentangled-representations cvpr2021 dataset
Language:Python 165
NVIDIA / Dataset_Utilities
NVIDIA Dataset Utilities (NVDU)
deep-learning synthetic-dataset-generation pose-estimation visualization
Language:Python 125
ViLab-UCSD / OpenRooms
This is the dataset and code release of the OpenRooms Dataset. For more information, please refer to our webpage below. Thanks a lot for your interest in our research!
inverse-rendering synthetic-dataset-generation scene-understanding robotics
121
PerceivingSystems / bedlam_render
BEDLAM (CVPR 2023) render pipeline tools
synthetic-dataset-generation unreal-engine-5 smpl-x synthetic-images
Language:Python 115
isarandi / synthetic-occlusion
Synthetic Occlusion Augmentation
occlusion computer-vision synthetic-dataset-generation data-augmentation python
Language:Python 113
firmai / mtss-gan
MTSS-GAN: Multivariate Time Series Simulation with Generative Adversarial Networks (by @firmai)
time-series synthetic-dataset-generation synthetic-data generative-adversarial-network multivariate-data multivariate-timeseries simulation finance adverserial stress-test model-validation similarity-measures
91
jtheiner / LegoBrickClassification
Repository to identify Lego bricks automatically only using images
image-classification synthetic-dataset-generation lego dataset transfer-learning
Language:Python 90
SqueezeAILab / LLM2LLM
LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement
data-augmentation llama llama2 llm llms natural-language-processing nlp synthetic-dataset-generation transformer
Language:Python 86
netsharecmu / NetShare
(SIGCOMM '22) Practical GAN-based Synthetic IP Header Trace Generation using NetShare
gan gans gans-models generative-adversarial-network netflow netflow-data netflow-v9 pcap pcap-generator synthetic-data synthetic-data-generator synthetic-dataset-generation time-series differential-privacy differential-privacy-deep-learning privacy privacy-preserving synthetic-data-generation machine-learning tensorflow
Language:Python 70
VinAIResearch / Dataset-Diffusion
Dataset Diffusion: Diffusion-based Synthetic Data Generation for Pixel-Level Semantic Segmentation (NeurIPS2023)
diffusion-models semantic-segmentation synthetic-dataset-generation
Language:Jupyter Notebook 69
remyxai / VQASynth
Compose multimodal datasets 🎹
data-pipeline data-processing dataset-generation multimodal-datasets multimodal-deep-learning synthetic-dataset-generation
Language:Python 66
privateai / deid-examples
Examples scripts that showcase how to use Private AI Text to de-identify, redact, hash, tokenize, mask and synthesize PII in text.
redaction redact de-identification de-identify tokenize masking synthetic-data synthetic-dataset-generation synthetic-data-generator deidentification hipaa anonymization data-anonymization dlp data-loss-prevention text-anonymization cpra gdpr data-masking privacy-tools
Language:Jupyter Notebook 65
discus-labs / discus
A data-centric AI package for ML/AI. Get the best high-quality data for the best results. Discord: https://discord.gg/t6ADqBKrdZ
llms synthetic-data synthetic-dataset-generation fine-tuning llm-datasets llm-training fine-tuning-llm gpt gpt-4 huggingface-transformers large-language-models ner-data openai python
Language:Python 62
nbsynthetic
NextBrain-ai / nbsynthetic
nbsynthetic is simple and robust tabular synthetic data generation library for small and medium size datasets
data-augmentation data-centric-ai gan generative-adversarial-network synthetic-data synthetic-dataset-generation
Language:Jupyter Notebook 55
921kiyo / 3d-dl
Synthetic Dataset Generation for Object-to-model Deep Learning
computer-vision deep-learning machine-learning synthetic-data synthetic-dataset-generation
Language:Python 53
astorfi / cor-gan
:unlock: COR-GAN: Correlation-Capturing Convolutional Neural Networks for Generating Synthetic Healthcare Records
deep-learning generative-adversarial-network pytorch python healthcare synthetic-dataset-generation
Language:Python 50
wormpose
iteal / wormpose
WormPose: Image synthesis and convolutional networks for pose estimation in C. elegans
python machine-learning deep-learning pose-estimation animal-pose-estimation tensorflow tensorflow2 c-elegans worm synthetic-dataset-generation synthetic-images neural-network tierpsy behavior-analysis elegans wormpose computer-vision
Language:Python 45
Abdullah-Abuolaim / recurrent-defocus-deblurring-synth-dual-pixel
Reference github repository for the paper "Learning to Reduce Defocus Blur by Realistically Modeling Dual-Pixel Data". We propose a procedure to generate realistic DP data synthetically. Our synthesis approach mimics the optical image formation found on DP sensors and can be applied to virtual scenes rendered with standard computer software. Leveraging these realistic synthetic DP images, we introduce a new recurrent convolutional network (RCN) architecture that can improve defocus deblurring results and is suitable for use with single-frame and multi-frame data captured by DP sensors.
defocus-blur defocus-deblurring dual-pixel depth-of-field autofocus deep-neural-networks recurrent-neural-networks deeplearning dataset synthetic-data synthetic-dataset-generation computational-photography deep-learning datasets computer-vision
Language:Python 44
Abdullah-Abuolaim / multi-task-defocus-deblurring-dual-pixel-nimat
Reference github repository for the paper "Improving Single-Image Defocus Deblurring: How Dual-Pixel Images Help Through Multi-Task Learning". We propose a single-image deblurring network that incorporates the two sub-aperture views into a multitask framework. Specifically, we show that jointly learning to predict the two DP views from a single blurry input image improves the network’s ability to learn to deblur the image. Our experiments show this multi-task strategy achieves +1dB PSNR improvement over state-of-the-art defocus deblurring methods. In addition, our multi-task framework allows accurate DP-view synthesis (e.g., ~ 39dB PSNR) from the single input image. These high-quality DP views can be used for other DP-based applications, such as reflection removal. As part of this effort, we have captured a new dataset of 7,059 high-quality images to support our training for the DP-view synthesis task.
deep-neural-networks computer-vision deep-learning dataset deeplearning datasets computational-photography autofocus synthetic-data depth-of-field synthetic-dataset-generation defocus-blur defocus-deblurring dual-pixel image-motion nimat-effect
Language:Python 42
replicAnt
evo-biomech / replicAnt
replicAnt - generating annotated images of animals in complex environments with Unreal Engine
blender deeplabcut synthetic-data synthetic-dataset-generation unreal-engine-5 yolo mask-rcnn pose-estimation mmseg deep-learning
Language:Python 41
Baukebrenninkmeijer / On-the-Generation-and-Evaluation-of-Synthetic-Tabular-Data-using-GANs
Repository for the results of my master thesis, about the generation and evaluation of synthetic data using GANs
synthetic-data synthetic-dataset-generation gan generative-adversarial-networks tabular-data data-synthesis data-evaluation
Language:Jupyter Notebook 39
arkanivasarkar / EEG-Data-Augmentation-using-Variational-Autoencoder
Improving performance of motor imagery classification using variational-autoencoder and synthetic EEG signals
eeg-signals data-augmentation variational-autoencoder eegnet keras-tensorflow keras synthetic-dataset-generation motor-imagery-classification
Language:Jupyter Notebook 30

synthetic-dataset-generation

Eladlev / AutoPrompt

Unity-Technologies / com.unity.perception

nicolas-hbt / pygraft

datadreamer-dev / DataDreamer

paulbricman / thisrepositorydoesnotexist

NVIDIA / Dataset_Synthesizer

BatsResearch / bonito

Unity-Technologies / SynthDet

sparkfish / augraphy

tirthajyoti / pydbgen

Unity-Technologies / PeopleSansPeople

fjxmlzn / DoppelGANger

firmai / datagene

worldbank / REaLTabFormer

rozumden / DeFMO

NVIDIA / Dataset_Utilities

ViLab-UCSD / OpenRooms

PerceivingSystems / bedlam_render

isarandi / synthetic-occlusion

firmai / mtss-gan

jtheiner / LegoBrickClassification

SqueezeAILab / LLM2LLM

netsharecmu / NetShare

VinAIResearch / Dataset-Diffusion

remyxai / VQASynth

privateai / deid-examples

discus-labs / discus

NextBrain-ai / nbsynthetic

921kiyo / 3d-dl

astorfi / cor-gan

iteal / wormpose

Abdullah-Abuolaim / recurrent-defocus-deblurring-synth-dual-pixel

Abdullah-Abuolaim / multi-task-defocus-deblurring-dual-pixel-nimat

evo-biomech / replicAnt

Baukebrenninkmeijer / On-the-Generation-and-Evaluation-of-Synthetic-Tabular-Data-using-GANs

arkanivasarkar / EEG-Data-Augmentation-using-Variational-Autoencoder