experimentation

There are 6 repositories under experimentation topic.

growthbook
growthbook / growthbook
Open Source Feature Flagging and A/B Testing Platform
ab-testing abtest abtesting analytics bigquery clickhouse continuous-delivery data-analysis data-engineering data-science experimentation feature-flagging feature-flags mixpanel redshift remote-config snowflake split-testing statistics
Language:TypeScript 5934
uptrain-ai / uptrain
UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.
autoevaluation evaluation experimentation hallucination-detection jailbreak-detection llm-eval llm-prompting llm-test llmops machine-learning monitoring openai-evals prompt-engineering root-cause-analysis
Language:Python 2147
dotnet / corefxlab
This repo is for experimentation and exploring new ideas that may or may not make it into the main corefx repo.
dotnet corefx experimentation c-sharp
Language:C# 1463
shadow / shadow
Shadow is a discrete-event network simulator that directly executes real application code, enabling you to simulate distributed systems with thousands of network-connected processes in realistic and scalable private network experiments using your laptop, desktop, or server running Linux.
emulation simulation networking experimentation tor science-research scientific-computing scalability realism control
Language:Rust 1424
featbit / featbit
A feature flags service written in .NET
dotnet feature-management remote-config csharp python typescript ab-testing experimentation feature-flags continuous-delivery feature-toggles release-as-code self-hosted entitlement ab-test asp-net-core progressive-delivery feature
Language:C# 1394
go-feature-flag
thomaspoignant / go-feature-flag
GO Feature Flag is a simple, complete and lightweight self-hosted feature flag solution 100% Open Source. 🎛️
feature-flags feature-toggles feature-flag feature-toggle feature-toggling devops continuous-delivery continuous-deployment continuous-testing variants toggles experiments beginner-friendly help-wanted golang-library experimentation go golang go-feature-flag
Language:Go 1239
tysam-code / hlb-CIFAR10
Train to 94% on CIFAR-10 in <6.3 seconds on a single A100. Or ~95.79% in ~110 seconds (or less!)
cifar10 deep-learning experimentation language-models-are-next machine-learning neural-network responsive-to-issue-tickets speedyconvnet7-1-0 world-record
Language:Python 1210
hyperparameter_hunter
HunterMcGushion / hyperparameter_hunter
Easy hyperparameter optimization and automatic result saving across machine learning algorithms and libraries
artificial-intelligence machine-learning hyperparameter-optimization hyperparameter-tuning neural-network keras scikit-learn xgboost lightgbm catboost deep-learning data-science python rgf sklearn optimization experimentation feature-engineering ai ml
Language:Python 702
featurevisor / featurevisor
Feature flags, experiments, and remote config management with version control
experimentation experiments feature flags javascript nodejs segmentation feature-flags feature-management feature-toggles toggles ab-testing gitops react reactjs vue vuejs
Language:TypeScript 611
zalando / expan
Open-source Python library for statistical analysis of randomised control trials (A/B tests)
ab-testing abtest abtesting causal-inference experimentation python statistical-analysis statistics
Language:Python 330
mead-ml / mead-baseline
Deep-Learning Model Exploration and Development for NLP
deep-learning nlp pytorch tensorflow keras seq2seq convolutional-neural-networks recurrent-neural-networks language-model visdom classification deep-learning-architectures baseline nlp-tasks transformers bert experimentation machine-learning hacktoberfest
Language:Python 243
microsoft / llmops-promptflow-template
LLMOps with Prompt Flow is a "LLMOps template and guidance" to help you build LLM-infused apps using Prompt Flow. It offers a range of features including Centralized Code Hosting, Lifecycle Management, Variant and Hyperparameter Experimentation, A/B Deployment, reporting for all runs and experiments and so on.
azuremachinelearning llmops aml largelanguagemodels llm prompt promptengineering promptflow azure cloud docker machine-learning mlops orchestration python evaluation experimentation genai aistudio mlops-template
Language:Python 235
pipelinex
Minyus / pipelinex
PipelineX: Python package to build ML pipelines for experimentation with Kedro, MLflow, and more
data-engineering data-science deep-learning experimentation machine-learning pipeline
Language:Python 221
justeat / JustTweak
JustTweak is a feature flagging framework for iOS apps.
ios experimentation feature flagging experiments optimizely firebase
Language:Swift 203
eugeneyan / papermill-mlflow
🧪 Simple data science experimentation & tracking with jupyter, papermill, and mlflow.
python jupyter papermill mlflow experimentation
Language:Jupyter Notebook 172
omnitool-ai / omnitool
Official Omnitool repository
generative-ai-tools education advocacy laboratory experimentation ai local-development
Language:TypeScript 123
mint-metrics / mojito
🧪 Source-controlled split testing stack for building, launching and analysing A/B tests.
experimentation javascript snowplow-analytics r knitr mojito analytics split-testing ab-testing
67
tinkrmind / programmable-air
A hardware kit to experiment with inflatable and vacuum based soft robotics.
experimentation inflatables hardware pcb soft robotics pressure sensor
Language:C 59
moverseai / moai
moai is a PyTorch-based AI Model Development Kit (MDK) created to improve data-driven model workflows, design and reproducibility.
pytorch mdk deep-learning cnn computer-vision human-pose-estimation object-pose-estimation vae vae-pytorch depth-estimation reproducible-research reproducibility data-driven artificial-intelligence neural-network convolutional-neural-networks experimentation hydra
Language:Python 51
mab
stitchfix / mab
Library for multi-armed bandit selection strategies, including efficient deterministic implementations of Thompson sampling and epsilon-greedy.
multiarmed-bandits golang go experimentation data-science reinforcement-learning thompson-sampling multi-armed-bandit multi-armed-bandits thompson
Language:Go 49
ukriish / shelf
A list of self curated blogposts, videos and exercises on various technologies that I find interesting
clojure distributed-systems experimentation go knowledge-base org-mode postgresql redis
45
georgian-io-archive / hydra
A cloud-agnostic ML Platform that will enable Data Scientists to run multiple experiments, perform hyper parameter optimization, evaluate results and serve models (batch/realtime) while still maintaining a uniform development UX across cloud environments
mlops ml-platform python cloud-agnostic experimentation hydra
Language:HCL 43
elehcimd / mltraq
Track and Collaborate on ML & AI Experiments.
data-analysis data-science machine-learning experimentation ai ml mlops experiments
Language:Jupyter Notebook 39
sigopt / sigopt-server
Open Source version of SigOpt API, performing hyperparameter optimization and visualization
experimentation hyperparameter-optimization optimization visualization
Language:Python 35
google-marketing-solutions / feedx
Transparent, robust and trustworthy A/B experimentation for Shopping feeds.
ab-testing experimentation python shopping data-science
Language:Jupyter Notebook 33
CausalInferenceLab / CausalInferenceLab.github.io
가짜연구소 인과추론팀 블로그입니다!
causal-inference data-science decision-making experimentation
Language:HTML 30
CausalInferenceLab / Experimentation-platform-materials
실험 플랫폼에 대한 자료를 정리한 저장소입니다.
ab-testing experimentation online-controlled-experiments
29
leodido / demo-cloud-native-ebpf-day
Various eBPF programs for tracing network connections
ebpf bpf lsm tracepoints security talk demo experimentation attack defense prevention auditing tracing kernel lsm-hooks enforcement
Language:C 29
samelogic / docs
Documentation website for Samelogic Platform, APIs, and SDKs
feedback feedback-loop product-management experimentation lean-experiments lean
Language:JavaScript 29
UCY-LINC-LAB / fogify
A Fog Computing Emulation Framework
fog-computing edge-computing experimentation jupyter fog-topology
Language:SCSS 27
Unleash / unleash-client-nextjs
Unleash SDK for Next.js
continuous-delivery continuous-deployment javascript nextjs node node-js sdk typescript unleash vercel ab-testing abtesting experimentation feature-flags server-rendering server-side-rendering hacktoberfest
Language:TypeScript 27
rwxrob / lab
Learning happens in the lab, not the lecture hall. This repo contains various different coding and technical lab experiments, exercises, and explorations. I refer to these during Beginner Boost a lot.
lab labs learning exercises exploration codebook experimentation examples recepies self-assessment education educational
Language:Shell 25
catseye / NaNoGenLab
Experiments conducted for NaNoGenMo 2014
nanogenmo experiments experimentation lab-equipment generative-text generated-novel
Language:Python 24
webis-de / ir_axioms
↕️ Intuitive axiomatic retrieval experimentation.
information-retrieval axioms experimentation re-ranking pyterrier terrier pyserini anserini
Language:Python 23
PostHog / posthog-node
Official PostHog Node library
node node-js event-tracking feature-flags experimentation
21
PostHog / posthog-go
Official PostHog Go library
event-tracking experimentation feature-flags go golang official posthog
Language:Go 20