benchmark-framework

There are 7 repositories under benchmark-framework topic.

graphdeeplearning / benchmarking-gnns
Repository for benchmarking graph neural networks (JMLR 2023)
benchmark-framework deep-learning dgl graph-deep-learning graph-neural-networks graph-representation-learning pytorch
Language:Jupyter Notebook 2579
phpbench / phpbench
PHP Benchmarking framework
benchmark-framework benchmarking performance performance-testing
Language:PHP 1958
myzhan / boomer
A better load generator for locust, written in golang.
benchmark benchmark-framework boomer locust performance performance-testing
Language:Go 1202
fuzzbench
google / fuzzbench
FuzzBench - Fuzzer benchmarking as a service.
fuzzing benchmarking benchmark-framework evaluation security
Language:Python 1141
google / swift-benchmark
A swift library to benchmark code snippets.
swift benchmark-framework benchmarking swiftpm swiftpackage
Language:Swift 929
OATML / bdl-benchmarks
Bayesian Deep Learning Benchmarks
bayesian-deep-learning benchmark-framework diabetic-retinopathy
Language:Jupyter Notebook 670
JohnSnowLabs / langtest
Deliver safe & effective language models
ai-safety ai-testing artificial-intelligence benchmark-framework benchmarks ethics-in-ai large-language-models llm llm-as-evaluator llm-evaluation-toolkit llm-test llm-testing ml-safety ml-testing mlops model-assessment nlp responsible-ai trustworthy-ai
Language:Python 516
thu-ml / ares
A Python library for adversarial machine learning focusing on benchmarking adversarial robustness.
adversarial-machine-learning benchmark-framework adversarial-attacks adversarial-robustness fgsm bim mi-fgsm deepfool nes spsa boundary evolutionary mmlda distillation hgd pca
Language:Python 514
RLE-Foundation / rllte
Long-Term Evolution Project of Reinforcement Learning
benchmark-framework long-term-project machine-learning reinforcement-learning robotics deep-learning gym huggingface phasic-policy-gradient drq-v2 procgen pybullet augmentation ppo deepmind-control-suite intrinsic-reward
Language:Python 473
ordo-one / package-benchmark
Swift benchmark runner with many performance metrics and great CI support
benchmark-framework swift swift-package-manager-plugin benchmarks benchmark performance performance-metrics swift-package ordo-core-package server-side-swift
Language:Swift 389
chronoxor / CppBenchmark
Performance benchmark framework for C++ with nanoseconds measure precision
benchmark-framework benchmarks microbenchmarks performance
Language:C++ 294
sosy-lab / benchexec
BenchExec: A Framework for Reliable Benchmarking and Resource Measurement
resource-measurement python cgroups linux benchmarking benchmark-framework benchmark
Language:Python 252
langchain-ai / langchain-benchmarks
🦜💯 Flex those feathers!
benchmark-framework benchmarking langchain langchain-python llm llms
Language:Python 244
iMeanAI / WebCanvas
All-in-one Web Agent framework for post-training. Start building with a few clicks!
agent benchmark-framework llm-agent llm-evaluation
Language:Python 242
sheredom / ubench.h
⏱️ single header benchmark framework for C and C++
benchmark benchmark-framework c cpp
Language:C++ 237
JieyuZ2 / wrench
[NeurIPS 2021] WRENCH: Weak supeRvision bENCHmark
weak-supervision weakly-supervised-learning data-programming data-centric-ai benchmark-framework machine-learning dataset nlp sequence-labeling deep-learning robust-learning
Language:Python 224
ziyadedher / evm-bench
🚀🪑 evm-bench is a suite of Ethereum Virtual Machine stress tests and benchmarks.
benchmark benchmark-framework ethereum ethereum-contract evm evm-bytecode smart-contracts
Language:Solidity 214
CeLuigi / models-comparison.pytorch
Code for the paper Benchmark Analysis of Representative Deep Neural Network Architectures
deep-neural-networks convolutional-neural-networks benchmark-framework imagenet pytorch
Language:Python 164
spcl / serverless-benchmarks
SeBS: serverless benchmarking suite for automatic performance analysis of FaaS platforms.
benchmark-framework benchmarking faas performance-analysis serverless
Language:Python 161
python-benchmark-harness
JoeyHendricks / python-benchmark-harness
A micro/macro benchmark framework for the Python programming language that helps with optimizing your software.
performance testing test-automation testing-tools performance-testing performance-analysis performance-monitoring profiling python python-library flame-graphs decorator performance-bottleneck intrusive-testing profiler visualization benchmarking benchmark benchmark-framework
Language:Python 157
ivafanas / sltbench
C++ benchmark tool. Practical, stable and fast performance testing framework.
benchmark benchmark-framework benchmarking performance cplusplus cpp cpp-library testing-tools test-framework testing open-source
Language:C++ 150
uber / bayesmark
Benchmark framework to easily compare Bayesian optimization methods on real machine learning tasks
bayesian-optimization benchmark-framework machine-learning sklearn
Language:Python 144
Picovoice / wake-word-benchmark
wake word engine benchmark framework
wake-word benchmark benchmark-framework keyword-spotting wake-word-detection
Language:Python 143
vanatka / pulkovo
Kotlin friendly library to measure elapsed time for methods, code blocks, RxJava chains
kotlin kotlin-an kotlin-library benchmarking benchmark-framework elapsedtime elapsed-time
Language:Kotlin 125
TimeEval / TimeEval
Evaluation Tool for Anomaly Detection Algorithms on Time Series
time-series time-series-analysis benchmark-framework benchmarking time-series-anomaly-detection distributed dask dask-distributed pandas numpy python3 jupyter-notebooks anomaly-detection
Language:Jupyter Notebook 121
ConduitIO / benchi
Benchmark any tool from the CLI
benchmark benchmark-framework
Language:Go 112
EvalNE
Dru-Mara / EvalNE
Source code for EvalNE, a Python library for evaluating Network Embedding methods.
benchmark benchmark-framework data-mining evaluation graph-algorithms graph-api graph-embedding graph-representation-learning graphs library link-prediction multilabel-classification network-embedding network-reconstruction networks node-classification python representation-learning research-tool sign-prediction
Language:Python 106
arturjordao / WearableSensorData
This repository provides the codes and data used in our paper "Human Activity Recognition Based on Wearable Sensor Data: A Standardization of the State-of-the-Art", where we implement and evaluate several state-of-the-art approaches, ranging from handcrafted-based methods to convolutional neural networks.
wearable-devices sensor-data human-activity-recognition state-of-the-art benchmark-framework
Language:Python 102
microsoft / VirtualClient
Benchmarking and monitoring automation, designed for cloud, built with .NET.
ab-testing benchmark-framework cloud-testing monitoring performance workload-automation
Language:C# 100
Infleqtion / client-superstaq
https://superstaq.readthedocs.io
quantum-computing benchmark-suite benchmark-framework quantum-mechanics quantum-algorithms
Language:Python 94
NyanKiyoshi / pytest-django-queries
Generate performance reports from your django database performance tests.
pytest pytest-plugin pytest-django performance-monitoring benchmark benchmarking benchmark-framework benchmark-suite
Language:Python 83
pyRDDLGym
pyrddlgym-project / pyRDDLGym
A toolkit for auto-generation of OpenAI Gym environments from RDDL description files.
gym-environments model-based rddl reinforcement-learning gym gymnasium planning simulator simulation rddl-domains benchmark-framework benchmarking benchmarking-framework evaluation-framework visualisation visualization visualizer planning-domain-definition-language planner planners
Language:Python 83
Bodigrim / tasty-bench
Featherlight benchmark framework, drop-in replacement for criterion and gauge.
benchmark-framework criterion gauge performance-testing performance-analysis performance-measurement benchmark benchmark-suite benchmarking benchmarking-suite benchmarks haskell
Language:Haskell 81
myzhan / locust4j
Locust4j is a load generator for locust, written in Java.
locust performance performance-testing benchmark benchmark-framework
Language:Java 81
ibmcb / cbtool
Cloud Rapid Experimentation and Analysis Toolkit
cloud benchmark-framework benchmarking stress-testing openstack ec2 workload-generator python27 libvirt docker lxc azure gce digitalocean kubernetes
Language:Python 79
MatheusRich / benchable
Write benchmarks without the hassle.
ruby benchmark benchmark-framework hacktoberfest
Language:Ruby 75