benchmarking-framework
There are 2 repositories under benchmarking-framework topic.
- Language:Python 252
dice-group / gerbil
GERBIL - General Entity annotatoR Benchmark
Language:Java 230neurosim / DNN_NeuroSim_V2.1
Benchmark framework of compute-in-memory based accelerators for deep neural network (on-chip training chip focused)
Language:C++ 172eXascaleInfolab / PyExPool
Python Multi-Process Execution Pool: concurrent asynchronous execution pool with custom resource constraints (memory, timeouts, affinity, CPU cores and caching), load balancing and profiling capabilities of the external apps on NUMA architecture
Language:Python 168- Language:Python 165
- Language:Python 89
- pyRDDLGym
pyrddlgym-project / pyRDDLGym
A toolkit for auto-generation of OpenAI Gym environments from RDDL description files.
Language:Python 85 HewlettPackard / dc-rl
SustainDC is a set of Python environments for Data Center simulation and control using Heterogeneous Multi Agent Reinforcement Learning. Includes customizable environments for workload scheduling, cooling optimization, and battery management, with integration into Gymnasium.
battery-managementbenchmarkbenchmarking-frameworkenergy-efficiencymachine-learningmulti-agent-reinforcement-learningpythonsustainable-computingcooling-optimizationdata-center-managementheterogeneous-reinforcement-learningworkload-schedulingbenchmarkingcarbon-footprintdata-centergymnasiumsustainabilityreinforcement-learningmulti-agent-systemsgymnasium-environmentLanguage:HTML 81Benchmark framework of compute-in-memory based accelerators for deep neural network (on-chip training chip focused)
Language:C++ 53KumarRobotics / kr_mp_design
A guidance for the design and evaluation of motion planners for quadrotors in Environments with Varying Complexities
UVA-LavaLab / PIMeval-PIMbench
PIMeval simulator and PIMbench suite
Language:C++ 36ArlineQ / arline_benchmarks
Arline Benchmarks platform allows to benchmark various algorithms for quantum circuit mapping/compression against each other on a list of predefined hardware types and target circuit classes
Language:Python 32aallan / benchmarking-ml-on-the-edge
Benchmarking machine learning inferencing on embedded hardware.
Language:Python 23- laravel-kata
HendrikPrinsZA / laravel-kata
The greatest collection of the worst code
Language:PHP 23 tonyredondo / timeitsharp
Command execution time meter
Language:C# 23Benchmark framework of compute-in-memory based accelerators for deep neural network (inference engine focused)
Language:C++ 22- Language:Python 19
- Language:Python 19
dejurin / php-micro-router-framework-benchmark
PHP Micro & Router Framework Benchmark
Language:PHP 13- Language:Smalltalk 13
optiprofiler / optiprofiler
Benchmarking optimization solvers.
Language:MATLAB 9emanzione / MHLab.Benchmark
A library to measure and profile some metrics of your code (execution time, average execution time, garbage collections)
Language:C# 7graalvm / CLAMH
CLAMH (Cross-LAnguage Microbenchmark Harness) is a language-independent benchmark harness design and the implementation of that design for different languages.
Language:C++ 7sandeep-krishnamurthy / dl-operator-benchmark
Framework for benchmarking deep learning operators for Apache MXNet
Language:Python 6hhu-bsinfo / observatory
Observatory is an extensible Java framework for benchmarking InfiniBand verbs implementations.
Language:C++ 5- Language:C++ 4
Ark0N / -CS2-Benchmark-Automation
Consistent, repeatable CS2 benchmarks – Automated CapFrameX capture with precise timing for reliable, comparable results every run.
Language:AutoHotkey 3- Language:Python 2
aichingm / cbench
Cbench is a header only micro micro-benchmarking toolkit for c. Designed to remain in the code base, by being eliminated during compile time when not enabled.
Language:C 1alambertini01 / Crossbar_Models_Comparison
Crossbar Parasitics Simulator – A tool for benchmarking parasitic resistance models in RRAM crossbars and evaluating neural networks under realistic hardware constraints.
Language:Python 1cs16b004 / dpdk-benchmarks
A client-server code to bench-mark dpdk in different configurations
Language:C++ 1redblock-ai / parrot-python
PARROT (Performance Assessment of Reasoning and Responses On Trivia) is a novel benchmarking framework designed to evaluate Large Language Models (LLMs) on real-world, complex, and ambiguous QA tasks.
Language:Python 1- Language:Java 1
- Language:Java 0
Jefino9488 / Lost-in-the-Middle-Analyzer
A lightweight benchmarking and visualization framework to analyze long-context failures in large language models (LLMs) using synthetic datasets, retrieval-augmented methods, and evaluation metrics.
Language:PythonPytest-with-Eric / pytest-benchmark-example
How To Measure And Improve Code Efficiency with Pytest Benchmark (The Ultimate Guide)
Language:Python
