benchmarking-framework

There are 1 repository under benchmarking-framework topic.

Psycoy / MixEval
The official evaluation suite and dynamic data release for MixEval.
benchmark benchmark-mixture benchmarking-framework benchmarking-suite evaluation evaluation-framework foundation-models large-language-model large-language-models large-multimodal-models llm-evaluation llm-evaluation-framework llm-inference mixeval
Language:Python 230
dice-group / gerbil
GERBIL - General Entity annotatoR Benchmark
benchmarking benchmarking-framework entity-annotation entity-linking named-entity-recognition
Language:Java 224
eXascaleInfolab / PyExPool
Python Multi-Process Execution Pool: concurrent asynchronous execution pool with custom resource constraints (memory, timeouts, affinity, CPU cores and caching), load balancing and profiling capabilities of the external apps on NUMA architecture
application-framework benchmarking-framework cache-control execution-pool in-memory-computations load-balancing monitoring-server multiprocessing numa parallel-computing parallel-processing task-queue
Language:Python 163
microsoft / MLOS
MLOS is a project to enable autotuning for systems.
performance-engineering optimize-systems infrastructure data-science autotuning benchmarking benchmarking-framework
Language:Python 146
neurosim / DNN_NeuroSim_V2.1
Benchmark framework of compute-in-memory based accelerators for deep neural network (on-chip training chip focused)
dnn-neurosim benchmarking-framework memory-accelerators chip-training xiaochen-peng
Language:C++ 128
spcl / npbench
NPBench - A Benchmarking Suite for High-Performance NumPy
benchmarking-framework benchmarking-suite numpy python
Language:Python 75
pyRDDLGym
pyrddlgym-project / pyRDDLGym
A toolkit for auto-generation of OpenAI Gym environments from RDDL description files.
gym-environments model-based rddl reinforcement-learning gym gymnasium planning simulator simulation rddl-domains benchmark-framework benchmarking benchmarking-framework evaluation-framework visualisation visualization visualizer planning-domain-definition-language planner planners
Language:Python 74
neurosim / DNN_NeuroSim_V2.0
Benchmark framework of compute-in-memory based accelerators for deep neural network (on-chip training chip focused)
dnn-neurosim benchmarking-framework memory-accelerators chip-training xiaochen-peng
Language:C++ 46
KumarRobotics / kr_mp_design
A guidance for the design and evaluation of motion planners for quadrotors in Environments with Varying Complexities
benchmarking-framework motion-planning
39
HewlettPackard / dc-rl
SustainDC is a set of Python environments for Data Center simulation and control using Heterogeneous Multi Agent Reinforcement Learning. Includes customizable environments for workload scheduling, cooling optimization, and battery management, with integration into Gymnasium.
battery-management benchmark benchmarking-framework energy-efficiency machine-learning multi-agent-reinforcement-learning python sustainable-computing cooling-optimization data-center-management heterogeneous-reinforcement-learning workload-scheduling benchmarking carbon-footprint data-center gymnasium sustainability reinforcement-learningmulti-agent-systems gymnasium-environment
Language:HTML 36
ArlineQ / arline_benchmarks
Arline Benchmarks platform allows to benchmark various algorithms for quantum circuit mapping/compression against each other on a list of predefined hardware types and target circuit classes
quantum-computing quantum python benchmarks quantum-benchmarks benchmark benchmarking benchmarking-framework
Language:Python 31
laravel-kata
HendrikPrinsZA / laravel-kata
The greatest collection of the worst code
benchmarking benchmarking-framework laravel laravel-eloquent mysql performance performance-analysis redis
Language:PHP 23
aallan / benchmarking-ml-on-the-edge
Benchmarking machine learning inferencing on embedded hardware.
benchmark benchmarking-framework coral-tpu jetson-nano machine-learning movidius raspberry-pi tiny-ml small-ai
Language:Python 22
neurosim / DNN_NeuroSim_V1.1
Benchmark framework of compute-in-memory based accelerators for deep neural network (inference engine focused)
dnn-neurosim xiaochen-peng benchmarking-framework iedm
Language:C++ 21
hsnlab / tipsy
Telco pIPeline benchmarking SYstem
ovs openvswitch moongen dpdk lagopus bess vpp benchmarking benchmarking-framework
Language:Python 19
dunnkers / fseval
Benchmarking framework for Feature Selection and Feature Ranking algorithms 🚀
benchmarks feature-rankers feature-selection wandb hydra machine-learning python feature-ranking benchmarking benchmarking-framework scikit-learn automl
Language:Python 18
tonyredondo / timeitsharp
Command execution time meter
benchmark benchmarking-framework performance performance-testing
Language:C# 18
smarr / SMark
Write Benchmarks like Tests
pharo smalltalk squeak benchmarking-framework benchmarks
Language:Smalltalk 13
dejurin / php-micro-router-framework-benchmark
PHP Micro & Router Framework Benchmark
benchmark benchmark-framework benchmark-scripts benchmarking-framework micro-framework php php-framework router routing
Language:PHP 12
emanzione / MHLab.Benchmark
A library to measure and profile some metrics of your code (execution time, average execution time, garbage collections)
benchmark benchmarking-framework dotnet dotnetcore measure
Language:C# 7
graalvm / CLAMH
CLAMH (Cross-LAnguage Microbenchmark Harness) is a language-independent benchmark harness design and the implementation of that design for different languages.
benchmarking-framework benchmark-framework benchmarking microbenchmarking performance-testing performance java cpp cplusplus c-plus-plus
Language:C++ 7
optiprofiler / optiprofiler
Benchmarking optimization solvers.
benchmark benchmark-framework benchmark-suite benchmarking-framework benchmarking-suite benchmarks blackbox-optimization constrained-optimization derivative-free-optimization nonlinear-optimization numerical-optimization optimization optimization-tools unconstrained-optimization zeroth-order-optimization
Language:Python 7
sandeep-krishnamurthy / dl-operator-benchmark
Framework for benchmarking deep learning operators for Apache MXNet
benchmarking-framework deep-learning performance apache-mxnet
Language:Python 6
courros / hnco
Optimization of black box functions defined on bit vectors
benchmarking-framework bit-vectors blackbox-optimization evolutionary-algorithm metaheuristics random-search-heuristics discrete-optimization
Language:C++ 4
hhu-bsinfo / observatory
Observatory is an extensible Java framework for benchmarking InfiniBand verbs implementations.
benchmarking benchmarking-framework infiniband java
Language:C++ 4
pwwang / benchwork
A framework for benchmarking in python
benchmark-framework benchmarking benchmarking-framework benchmarking-suite python testing
Language:Python 2
cs16b004 / dpdk-benchmarks
A client-server code to bench-mark dpdk in different configurations
benchmarking-framework dpdk userspace-networking
Language:C++ 1
N3v1 / Swift-Benchmarking
An open-source benchmarking library for swift
benchmarking benchmarking-framework swift6
1
redblock-ai / parrot-python
PARROT (Performance Assessment of Reasoning and Responses On Trivia) is a novel benchmarking framework designed to evaluate Large Language Models (LLMs) on real-world, complex, and ambiguous QA tasks.
benchmarking-framework llm-benchmarking llm-datasets llm-inference llm-qa-document
Language:Python 1
VTUL / mw-benchmark
benchmarking benchmarking-framework react web-services webservices
Language:Java 1
dhuny / RUBBoS
RUBBoS for microservers like RPI64Box
benchmarking benchmarking-framework microservers performance-testing rpi rpi3 rpi4 rpi64box web web-performance web-performance-testing rubbis rubbos
Language:Java 0
jracevedob / Latency-measurements-cpp
In network latency measurement for C++ applications
latency benchmarking-framework network-programming cpp python-wrapper
Language:C++
Pytest-with-Eric / pytest-benchmark-example
How To Measure And Improve Code Efficiency with Pytest Benchmark (The Ultimate Guide)
benchmark benchmarking-framework pytest-benchmark python-benchmark
Language:Python
svenssonjoel / Emacs-Bencher
Use Emacs to run benchmarks and to collect data
emacs benchmarking-framework benchmarking csv
Language:Emacs Lisp

benchmarking-framework

Psycoy / MixEval

dice-group / gerbil

eXascaleInfolab / PyExPool

microsoft / MLOS

neurosim / DNN_NeuroSim_V2.1

spcl / npbench

pyrddlgym-project / pyRDDLGym

neurosim / DNN_NeuroSim_V2.0

KumarRobotics / kr_mp_design

HewlettPackard / dc-rl

ArlineQ / arline_benchmarks

HendrikPrinsZA / laravel-kata

aallan / benchmarking-ml-on-the-edge

neurosim / DNN_NeuroSim_V1.1

hsnlab / tipsy

dunnkers / fseval

tonyredondo / timeitsharp

smarr / SMark

dejurin / php-micro-router-framework-benchmark

emanzione / MHLab.Benchmark

graalvm / CLAMH

optiprofiler / optiprofiler

sandeep-krishnamurthy / dl-operator-benchmark

courros / hnco

hhu-bsinfo / observatory

pwwang / benchwork

cs16b004 / dpdk-benchmarks

N3v1 / Swift-Benchmarking

redblock-ai / parrot-python

VTUL / mw-benchmark

dhuny / RUBBoS

jracevedob / Latency-measurements-cpp

Pytest-with-Eric / pytest-benchmark-example

svenssonjoel / Emacs-Bencher