reproducibility

There are 23 repositories under reproducibility topic.

dvc
iterative / dvc
🦉 ML Experiments and Data Management with Git
data-science machine-learning reproducibility data-version-control git developer-tools collaboration ai python hacktoberfest
Language:Python 13099
wandb
wandb / wandb
🔥 A tool for visualizing and tracking your machine learning experiments. This repo contains the CLI and Python API.
machine-learning experiment-track deep-learning keras tensorflow pytorch hyperparameter-search reinforcement-learning mlops data-science collaboration hyperparameter-optimization reproducibility hyperparameter-tuning data-versioning model-versioning ml-platform jax
Language:Python 8185
IDSIA / sacred
Sacred is a tool to help you configure, organize, log and reproduce experiments developed at IDSIA.
python machine-learning infrastructure reproducible-research reproducibility reproducible-science mongodb
Language:Python 4156
ashleve / lightning-hydra-template
PyTorch Lightning + Hydra. A very user-friendly template for ML experimentation. ⚡🔥⚡
pytorch-lightning project-structure config deep-learning hydra template pytorch reproducibility best-practices mlops
Language:Python 3654
catalyst-team / catalyst
Accelerated deep learning R&D
computer-vision deep-learning distributed-computing image-classification image-processing image-segmentation information-retrieval infrastructure machine-learning metric-learning natural-language-processing object-detection python pytorch recommender-system reinforcement-learning reproducibility research text-classification text-segmentation
Language:Python 3222
snakemake / snakemake
This is the development home of the workflow management system Snakemake. For general information, see
snakemake reproducibility workflow-management
Language:HTML 2106
rlworkgroup / garage
A toolkit for reproducible reinforcement learning research.
rl-algorithms reproducibility pytorch tensorflow
Language:Python 1811
clementchadebec / benchmark_VAE
Unifying Variational Autoencoder (VAE) implementations in Pytorch (NeurIPS 2022)
vae benchmarking beta-vae comparison normalizing-flows pixel-cnn pytorch reproducibility reproducible-research vae-gan vae-implementation vae-pytorch variational-autoencoder vq-vae wasserstein-autoencoder
Language:Python 1677
Cloud-CV / EvalAI
:cloud: :rocket: :bar_chart: :chart_with_upwards_trend: Evaluating state of the art in AI
ai ai-challenges angular7 angularjs artificial-intelligence challenge django docker evalai evaluation leaderboard machine-learning python reproducibility reproducible-research
Language:Python 1677
MLReef / mlreef
The collaboration workspace for Machine Learning
mlops mlops-environment artificial-intelligence machine-learning machine-learning-algorithms deep-learning deeplearning models tensorflow pytorch data-science mxnet reproducibility
Language:Kotlin 1438
joedicastro / vps-comparison
A comparison between some VPS providers. It uses Ansible to perform a series of automated benchmark tests over the VPS servers that you specify. It allows the reproducibility of those tests by anyone that wanted to compare these results to their own. All the tests results are available in order to provide independence and transparency.
vps ansible comparison python hosting reproducibility transparency independence cloud
Language:Python 1402
ropensci / drake
An R-focused pipeline toolkit for reproducibility and high-performance computing
reproducibility high-performance-computing r data-science drake makefile pipeline workflow reproducible-research rstats r-package ropensci peer-reviewed
Language:R 1330
MaurizioFD / RecSys2019_DeepLearning_Evaluation
This is the repository of our article published in RecSys 2019 "Are We Really Making Much Progress? A Worrying Analysis of Recent Neural Recommendation Approaches" and of several follow-up studies.
recommender-system recommendation-system recommendation-algorithms deep-learning evaluation-framework neural-network collaborative-filtering content-based-recommendation hybrid-recommender-system reproducibility reproducible-research knn matrix-factorization matrix-completion bpr bprmf bprslim funksvd slimelasticnet hyperparameters
Language:Python 980
gtsummary
ddsjoberg / gtsummary
Presentation-Ready Data Summary and Analytic Result Tables
r summary-tables statistics rstats r-package gt html5 easy-to-use summary-statistics reproducible-research reproducibility regression-models tableone table1
Language:R 940
torch-fidelity
toshas / torch-fidelity
High-fidelity performance metrics for generative models in PyTorch
pytorch metrics gan generative-model evaluation inception-score frechet-inception-distance kernel-inception-distance perceptual-path-length precision reproducibility reproducible-research
Language:Python 870
targets
ropensci / targets
Function-oriented Make-like declarative workflows for R
reproducibility high-performance-computing r data-science pipeline rstats r-package workflow targets reproducible-research make r-targetopia peer-reviewed
Language:R 865
nix-community / dream2nix
Simplified nix packaging for various programming language ecosystems [maintainer=@DavHau]
nix nixos lang2nix dream-to-nix 2nix package-management reproducibility nodejs rust hacktoberfest nix-community-buildbot
Language:Nix 857
mach-nix
DavHau / mach-nix
Create highly reproducible python environments
mach-nix python-packages python-environment nix-expression nix nixos reproducibility nixpkgs python-deps python
Language:Python 827
reprex
tidyverse / reprex
Render bits of R code for sharing, e.g., on GitHub or StackOverflow.
r rmarkdown stackoverflow github reproducibility
Language:R 727
openwdl / wdl
Workflow Description Language - Specification and Implementations
wdl workflow cromwell bioinformatics reproducible-science reproducibility cloud openwdl
723
the-nix-way / dev-templates
Dev environments for numerous languages based on Nix flakes [maintainer=@lucperkins]
flakes nix reproducibility
Language:Nix 677
benmarwick / rrtools
rrtools: Tools for Writing Reproducible Research in R
r reproducible-research reproducibility reproducible-science research-project research-paper research-tool reproducible-paper research-compendium quarto quarto-template
Language:R 661
grok-ai / nn-template
Generic template to bootstrap your PyTorch project.
pytorch template pytorch-lightning wandb dvc hydra research deep-learning best-practices reproducibility project-structure weights-and-biases streamlit mkdocs github-actions best-practises pre-commit cookiecutter huggingface-datasets
Language:Python 612
kwotsin / mimicry
[CVPR 2020 Workshop] A PyTorch GAN library that reproduces research results for popular GANs.
generative-adversarial-networks gans reproducibility pytorch generative-models machine-learning gan sngan sngan-projection wgan-gp ssgan dcgan infomax-gan cgan cvpr python cvpr2020 cvpr20
Language:Python 601
tweag / jupyenv
Declarative and reproducible Jupyter environments - powered by Nix
jupyterlab nix jupyter jupyter-notebooks reproducibility
Language:Nix 598
henripal / labnotebook
LabNotebook is a tool that allows you to flexibly monitor, record, save, and query all your machine learning experiments.
machine-learning reproducibility reproducible-research python postgresql webapp vuejs experimental-data postgres experiment-manager
Language:Jupyter Notebook 533
understandable-machine-intelligence-lab / Quantus
Quantus is an eXplainable AI toolkit for responsible evaluation of neural network explanations
machine-learning explainable-ai quantification-evaluation-methods deep-learning pytorch tensorflow interpretability xai reproducibility
Language:Jupyter Notebook 499
minerva-ml / open-solution-home-credit
Open solution to the Home Credit Default Risk challenge :house_with_garden:
machine-learning deep-learning kaggle pipeline feature-engineering reproducible-experiments reproducibility pipeline-framework lightgbm xgboost neptune competition credit-scoring credit-risk open-source python python3 python35
Language:Python 444
NVIDIA / framework-reproducibility
Providing reproducibility in deep learning frameworks
gpu-determinism deterministic-ops gpu-support deep-learning ngc pytorch tensorflow determinism atomics frameworks noise noise-reduction reproducibility seed seeder variance-reduction d9m fwr13y r13y
Language:Python 417
datmo / datmo
Open source production model management tool for data scientists
machine-learning reproducibility version-control artificial-intelligence deep-learning data-science
Language:Python 346
bwplotka / bingo
Like `go get` but for Go tools! CI Automating versioning of Go binaries in a nested, isolated Go modules.
golang go gomodules modules versioning packages pin thanos reproducibility
Language:Go 324
snakemake-workflows / rna-seq-star-deseq2
RNA-seq workflow using STAR and DESeq2
snakemake sciworkflows reproducibility gene-expression-analysis deseq2
Language:Python 307
getpopper / popper
Container-native task automation engine.
reproducibility cli devops sciops containers workflows docker singularity podman automation-engine
Language:Python 299
reprozip
VIDA-NYU / reprozip
ReproZip is a tool that simplifies the process of creating reproducible experiments from command-line executions, a frequently-used common denominator in computational science.
reprozip computational-science reprounzip python reproducibility linux science scientific-computing archiving reproducible-research reproducible-science ptrace docker vagrant nyu hacktoberfest
Language:Python 295
awesome-reproducible-research
leipzig / awesome-reproducible-research
A curated list of reproducible research case studies, projects, tutorials, and media
awesome-list awesome reproducibility reproducible-research reproducible-science reproducible-analysis reproducible-workflows
Language:Python 294
plynx-team / plynx
PLynx is a domain agnostic platform for managing reproducible experiments and data-oriented workflows.
data-science machine-learning reproducibility collaboration experiments distributed workflow plynx
Language:JavaScript 291