precision

There are 2 repositories under precision topic.

shopspring / decimal
Arbitrary-precision fixed-point decimal numbers in Go
bignumber decimals go golang money precision
Language:Go 7026
torch-fidelity
toshas / torch-fidelity
High-fidelity performance metrics for generative models in PyTorch
pytorch metrics gan generative-model evaluation inception-score frechet-inception-distance kernel-inception-distance perceptual-path-length precision reproducibility reproducible-research
Language:Python 1138
johnmcfarlane / cnl
A Compositional Numeric Library for C++
arithmetic cmake cpp deterministic embedded fixed-point multiprecision precision safe simulation
Language:C++ 674
egtwobits / mesh_mesh_align_plus
Precisely align, move, and measure+match objects and mesh parts in your 3D scenes.
blender 3d cad transformations alignment precision rotation addon python 3dprinting extension
Language:Python 618
Alexhuszagh / rust-lexical
Fast numeric to- and from-string conversion routines.
string-conversion std no-std precision floating-point rust parsing encoding
Language:Rust 343
eobermuhlner / big-math
Advanced Java BigDecimal math functions (pow, sqrt, log, sin, ...) using arbitrary precision.
arbitrary-precision big-math bigdecimal complex-numbers mathematical-functions newton-raphson precision taylor-series
Language:Java 341
rexmex
AstraZeneca / rexmex
A general purpose recommender metrics library for fair evaluation.
deep-learning machine-learning coverage personalization mrr ranking rank recall precision rsquared evaluation metrics recsys recommender recommender-system metric
Language:Python 278
clovaai / generative-evaluation-prdc
Code base for the precision, recall, density, and coverage metrics for generative models. ICML 2020.
deep-learning generative-adversarial-network evaluation-metrics precision recall machine-learning generative-model fidelity diversity evaluation icml icml-2020 icml2020
Language:Python 265
guillaumegenthial / tf_metrics
Multi-class metrics for Tensorflow
f1 metrics multiclass precision recall tensorflow tensorflow-estimator
Language:Python 223
tpoisonooo / HuixiangDou2
[ACL2025 demo track] ROGRAG: A Robustly Optimized GraphRAG Framework
knowledge-base knowledge-graph knownledge-augmented-generation llm precision retrieval-augmented-generation
Language:Python 180
JuliaMath / DoubleFloats.jl
math with more good bits
julia math floating-point accuracy precision performance extended-precision doubledouble
Language:Julia 168
royNiladri / js-big-decimal
Work with large numbers on the client side with high precision.
arithmetic bigdecimal decimal digit digits javascript money operations precision typescript
Language:TypeScript 166
uncodead / BrewUNO
High precision and accuracy, open source, online, extensible and low cost homebrew automation on top of ESP8266 microchip.
platformio ota react ntp precision accuracy esp8266 arduino esp8266-arduino cplusplus synchronization wifi-configurations homebrew pid pid-controller pid-control beer brewbeer
Language:C++ 100
Dominik-Workshop / electronic-load
Digitally controlled electronic load, 2022
atmega328p diy load precision programmable qtcreator qtdesigner electronics
Language:HTML 96
mauriciopoppe / interval-arithmetic
An implementation of an algebraically closed interval system of the extended real number set
interval-arithmetic interval interval-arithmetic-evaluator math precision
Language:TypeScript 95
verificarlo / verificarlo
A tool for debugging and assessing floating point precision and reproducibility.
montecarlo-arithmetic mpfr precision floating-point tool numerical-analysis llvm mixed-precision
Language:C 88
apache / commons-numbers
Apache Commons Numbers
java math complex quaternion fraction prime angle combinatorics gamma floating-point precision
Language:Java 80
suvojit-0x55aa / mixed-precision-pytorch
Training with FP16 weights in PyTorch
artificial-intelligence artificial-neural-networks computer-vision deep-learning gradient gradients-underflow mixed-precision model-weights nueral-networks overflow precision precision-training pytorch weight
Language:Python 80
ml-tool-wear
tvhahn / ml-tool-wear
Anomaly detection on the UC Berkeley milling data set using a disentangled-variational-autoencoder (beta-VAE). Replication of results as described in article "Self-Supervised Learning for Tool Wear Monitoring with a Disentangled-Variational-Autoencoder"
deep-learning masc-thesis machinery-condition-monitoring tool-wear-monitoring anomaly-detection beta-vae tool-condition-monitoring advanced-manufacturing latent-spaces milling recall trend precision
Language:Jupyter Notebook 74
JordanRL / Fermat
A library providing math and statistics operations for numbers of arbitrary size.
precision fermat math php biginteger bignumber bigint bignum statistics poisson-distribution gaussian-distribution arbitrary-precision trigonometry science scientific-computations matrices matrix-calculations matrix-functions complex-numbers php8
Language:PHP 66
karliuka / m2.Price
Magento2. Rounding Price to Prettier Value for Multi-Currency Stores.
magento2 price precision round magento2-extension magento2-module magento2-extension-free magento-extension magento-2 magento-2-extension magento-2-module magento-2-extension-free magento2-free-extension magento2-free-modules price-format currency-format
Language:PHP 63
wangzhe0623 / Object-Detection-Evaluation-Tool
Object Detection Evaluation Tools
object-detection map-calculation precision detection-algorithm
Language:Python 62
alpacahq / alpacadecimal
Arbitrary-precision fixed-point decimal numbers in go. Similar and compatible with shopspring's decimal.Decimal, but optimized for Alpaca's data sets.
currency decimals go golang math money precision trading
Language:Go 47
LaKraven / ADAPT
Advanced Developer Async Programming Toolkit
game-engine event framework async multi-threading clustering precision
Language:Pascal 45
szaghi / PENF
Portability Environment for Fortran poor people
fortran codes-portability precision
Language:Fortran 42
ttulka / as-big
AssemblyScript library for arbitrary-precision decimal arithmetic
assemblyscript big bigdecimal bigfloat bignumber decimal float math numer precision
Language:JavaScript 37
hma02 / cublasHgemm-P100
Code for testing the native float16 matrix multiplication performance on Tesla P100 and V100 GPU based on cublasHgemm
gpu precision float16 half-precision p100 cublas gemm v100
Language:Cuda 35
tc39 / proposal-amount
Numbers with precision and a unit for JavaScript
accuracy javascript measurements numbers precision units-of-measure
Language:HTML 35
jokruger / dec128
High performance 128-bit fixed-point decimal numbers in go.
bignumber decimal decimal-numbers decimals finance fixed-point go golang money precision
Language:Go 34
idsc-frazzoli / tensor
linear algebra for tensors with symbolic and numeric scalars
tensor-library precision physical-units integer-fractions scalar
Language:Java 32
hackintosh-dell-precision-3240-compact-comet-lake-opencore
weblogix / hackintosh-dell-precision-3240-compact-comet-lake-opencore
OpenCore configuration to run Mac OS on a Dell Precision 3240 Compact. Tested on Mac OS Monterey 12.3
bigsur catalina comet-lake dell dell-precision dell-precision-hackintosh efi hackintosh hackintosh-dell hackintosh-desktop hackintosh-efi macos mojave-hackintosh monterey-hackintosh opencore opencore-dell precision
Language:Shell 32
davdroman / PreciseDecimal
A Decimal type that plays nicely with literals and Decodable
decimal precision codable json jsondecoder literals double
Language:Swift 31
proin / nodeml
machine learning framework for node.js
machine-learning bayes cnn knn collaborative-filtering recommendation-engine precision recall ndcg kmeans
Language:JavaScript 31
waveshareteam / High-Pricision_AD_HAT
hat precision adc python c waveshare rpi raspberry-pi ads1263
Language:C 31
bdusell / rougescore
Python implementation of ROUGE
nlp evaluation-metrics rouge rouge-n rouge-l summarization precision recall
Language:Python 30
Daninet / gmp-wasm
Arbitrary-precision Integer, Rational and Float types based on the GMP and MPFR libraries
arbitrary-precision integer rational floating-point gmp mpfr webassembly bindings javascript fast precision biginteger bigint
Language:TypeScript 30