benchmark-framework

There are 7 repositories under benchmark-framework topic.

graphdeeplearning / benchmarking-gnns
Repository for benchmarking graph neural networks (JMLR 2023)
benchmark-framework deep-learning dgl graph-deep-learning graph-neural-networks graph-representation-learning pytorch
Language:Jupyter Notebook 2634
phpbench / phpbench
PHP Benchmarking framework
benchmark-framework benchmarking performance performance-testing
Language:PHP 1966
myzhan / boomer
A better load generator for locust, written in golang.
locust boomer performance benchmark benchmark-framework performance-testing
Language:Go 1220
fuzzbench
google / fuzzbench
FuzzBench - Fuzzer benchmarking as a service.
fuzzing benchmarking benchmark-framework evaluation security
Language:Python 1158
google / swift-benchmark
A swift library to benchmark code snippets.
swift benchmark-framework benchmarking swiftpm swiftpackage
Language:Swift 935
OATML / bdl-benchmarks
Bayesian Deep Learning Benchmarks
bayesian-deep-learning benchmark-framework diabetic-retinopathy
Language:Jupyter Notebook 672
Pacific-AI-Corp / langtest
Deliver safe & effective language models
benchmarks ethics-in-ai large-language-models ml-safety ml-testing mlops model-assessment nlp responsible-ai llm-test ai-safety ai-testing artificial-intelligence benchmark-framework llm llm-as-evaluator llm-evaluation-toolkit llm-testing trustworthy-ai
Language:Python 545
thu-ml / ares
A Python library for adversarial machine learning focusing on benchmarking adversarial robustness.
adversarial-machine-learning benchmark-framework adversarial-attacks adversarial-robustness fgsm bim mi-fgsm deepfool nes spsa boundary evolutionary mmlda distillation hgd pca
Language:Python 517
RLE-Foundation / rllte
Long-Term Evolution Project of Reinforcement Learning
benchmark-framework long-term-project machine-learning reinforcement-learning robotics deep-learning gym huggingface phasic-policy-gradient drq-v2 procgen pybullet augmentation ppo deepmind-control-suite intrinsic-reward
Language:Python 475
ordo-one / package-benchmark
Swift benchmark runner with many performance metrics and great CI support
benchmark-framework swift swift-package-manager-plugin benchmarks benchmark performance performance-metrics swift-package ordo-core-package server-side-swift
Language:Swift 399
chronoxor / CppBenchmark
Performance benchmark framework for C++ with nanoseconds measure precision
benchmark-framework benchmarks microbenchmarks performance
Language:C++ 315
pathwaycom / pathway-benchmarks
Benchmarks for data processing systems: Pathway, Spark, Flink, Kafka Streams
benchmark-framework flink latency pathway spark-streaming streaming streaming-data kafka-streams pagerank wordcount
Language:Python 310
iMeanAI / WebCanvas
All-in-one Web Agent framework for post-training. Start building with a few clicks!
agent benchmark-framework llm-agent llm-evaluation
Language:Python 273
sosy-lab / benchexec
BenchExec: A Framework for Reliable Benchmarking and Resource Measurement
resource-measurement python cgroups linux benchmarking benchmark-framework benchmark
Language:Python 273
langchain-ai / langchain-benchmarks
🦜💯 Flex those feathers!
benchmark-framework benchmarking langchain langchain-python llm llms
Language:Python 252
sheredom / ubench.h
⏱️ single header benchmark framework for C and C++
benchmark-framework benchmark c cpp
Language:C++ 239
JieyuZ2 / wrench
[NeurIPS 2021] WRENCH: Weak supeRvision bENCHmark
weak-supervision weakly-supervised-learning data-programming data-centric-ai benchmark-framework machine-learning dataset nlp sequence-labeling deep-learning robust-learning
Language:Python 225
ziyadedher / evm-bench
🚀🪑 evm-bench is a suite of Ethereum Virtual Machine stress tests and benchmarks.
benchmark benchmark-framework ethereum ethereum-contract evm evm-bytecode smart-contracts
Language:Solidity 218
spcl / serverless-benchmarks
SeBS: serverless benchmarking suite for automatic performance analysis of FaaS platforms.
benchmark-framework benchmarking faas performance-analysis serverless
Language:Python 178
CeLuigi / models-comparison.pytorch
Code for the paper Benchmark Analysis of Representative Deep Neural Network Architectures
benchmark-framework convolutional-neural-networks deep-neural-networks imagenet pytorch
Language:Python 164
ConduitIO / benchi
Benchmark any tool from the CLI
benchmark benchmark-framework
Language:Go 160
python-benchmark-harness
JoeyHendricks / python-benchmark-harness
A micro/macro benchmark framework for the Python programming language that helps with optimizing your software.
benchmark benchmark-framework benchmarking decorator flame-graphs intrusive-testing performance performance-analysis performance-bottleneck performance-monitoring performance-testing profiler profiling python python-library test-automation testing testing-tools visualization
Language:Python 156
uber / bayesmark
Benchmark framework to easily compare Bayesian optimization methods on real machine learning tasks
bayesian-optimization benchmark-framework machine-learning sklearn
Language:Python 154
ivafanas / sltbench
C++ benchmark tool. Practical, stable and fast performance testing framework.
benchmark benchmark-framework benchmarking performance cplusplus cpp cpp-library testing-tools test-framework testing open-source
Language:C++ 151
Picovoice / wake-word-benchmark
wake word engine benchmark framework
benchmark benchmark-framework keyword-spotting wake-word wake-word-detection
Language:Python 146
TimeEval / TimeEval
Evaluation Tool for Anomaly Detection Algorithms on Time Series
time-series time-series-analysis benchmark-framework benchmarking time-series-anomaly-detection distributed dask dask-distributed pandas numpy python3 jupyter-notebooks anomaly-detection
Language:Jupyter Notebook 143
vanatka / pulkovo
Kotlin friendly library to measure elapsed time for methods, code blocks, RxJava chains
kotlin kotlin-an kotlin-library benchmarking benchmark-framework elapsedtime elapsed-time
Language:Kotlin 124
EvalNE
Dru-Mara / EvalNE
Source code for EvalNE, a Python library for evaluating Network Embedding methods.
link-prediction evaluation graph-embedding graphs networks network-embedding data-mining python library research-tool benchmark benchmark-framework representation-learning graph-representation-learning graph-algorithms graph-api network-reconstruction node-classification multilabel-classification sign-prediction
Language:Python 106
Infleqtion / client-superstaq
https://superstaq.readthedocs.io
quantum-computing benchmark-suite benchmark-framework quantum-mechanics quantum-algorithms
Language:Python 106
microsoft / VirtualClient
Benchmarking and monitoring automation, designed for cloud, built with .NET.
benchmark-framework ab-testing cloud-testing monitoring performance workload-automation
Language:C# 105
arturjordao / WearableSensorData
This repository provides the codes and data used in our paper "Human Activity Recognition Based on Wearable Sensor Data: A Standardization of the State-of-the-Art", where we implement and evaluate several state-of-the-art approaches, ranging from handcrafted-based methods to convolutional neural networks.
wearable-devices sensor-data human-activity-recognition state-of-the-art benchmark-framework
Language:Python 104
tudelft / AvoidBench
AvoidBench
benchmark-framework drone obstacle-avoidance
Language:C++ 90
pyRDDLGym
pyrddlgym-project / pyRDDLGym
A toolkit for auto-generation of OpenAI Gym environments from RDDL description files.
gym-environments model-based rddl reinforcement-learning gym gymnasium planning simulator simulation rddl-domains benchmark-framework benchmarking benchmarking-framework evaluation-framework visualisation visualization visualizer planning-domain-definition-language planner planners
Language:Python 85
myzhan / locust4j
Locust4j is a load generator for locust, written in Java.
locust performance performance-testing benchmark benchmark-framework
Language:Java 84
NyanKiyoshi / pytest-django-queries
Generate performance reports from your django database performance tests.
pytest pytest-plugin pytest-django performance-monitoring benchmark benchmarking benchmark-framework benchmark-suite
Language:Python 83
Bodigrim / tasty-bench
Featherlight benchmark framework, drop-in replacement for criterion and gauge.
benchmark-framework criterion gauge performance-testing performance-analysis performance-measurement benchmark benchmark-suite benchmarking benchmarking-suite benchmarks haskell
Language:Haskell 81