data-reduction

There are 4 repositories under data-reduction topic.

miller
johnkerl / miller
Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON
command-line command-line-tools csv csv-format data-cleaning data-processing data-reduction data-regression devops devops-tools json json-data miller statistical-analysis statistics streaming-algorithms streaming-data tabular-data tsv unix-toolkit
Language:Go 8739
heucoder / dimensionality_reduction_alo_codes
特征提取/数据降维:PCA、LDA、MDS、LLE、TSNE等降维算法的python实现
data-reduction feature-extraction python
Language:Python 2253
parameters
easystats / parameters
:bar_chart: Computation and processing of models' parameters
pvalues parameters beta ci confidence-intervals r easystats standardize pca fa bootstrap statistical-models regression-models feature-reduction standardized-estimates feature-extraction data-reduction robust-statistics hacktoberfest r-package
Language:R 419
cuSZ
szcompressor / cuSZ
A GPU accelerated error-bounded lossy compression for scientific data.
lossy-compression scientific-data data-reduction gpu cuda
Language:C++ 58
lgrcia / prose
Modular image processing pipelines with Python. Built for Astronomy.
astronomy astrophysics data-reduction ground-based image-processing observation photometry pipeline python reduction telescope
Language:Python 52
USCbiostats / partition
A fast and flexible framework for data reduction in R
r dimensionality-reduction data-reduction partitional-clustering
Language:HTML 34
cylammarco / ASPIRED
Automated SpectroPhotometric Image REDuction (ASPIRED)
spectroscopy astronomy astrophysics data-reduction calibration spectrophotometry
Language:Python 29
dodiku / audio_noise_clustering
https://dodiku.github.io/audio_noise_clustering/results/ ==> An experiment with a variety of clustering (and clustering-like) techniques to reduce noise on an audio speech recording.
python machine-learning scikit-learn clustering noise-reduction data-reduction speech audio-processing audio-analysis dsp
Language:Python 25
jilavsky / SAXS_IgorCode
Irena, Nika, and Indra SAXS Igor code by Jan Ilavsky
nika irena small-angle-xray-scattering data-reduction
Language:IGOR Pro 23
juliandavidmr / TrelloResume
Converts trello data into fast read information
nextjs trello data-reduction reactjs
Language:JavaScript 16
gramian / hapod
HAPOD - Hierarchical Approximate Proper Orthogonal Decomposition
model-reduction model-order-reduction pod svd pca dimension-reduction data-reduction data-driven data-science datascience hpc high-performance-computing limited-memory distributed-memory unsupervised-learning proper-orthogonal-decomposition mapreduce mapreduce-algorithm
Language:MATLAB 14
ziggy
nasa / ziggy
Ziggy, a portable, scalable infrastructure for science data processing pipelines, is the child of the Transiting Exoplanet Survey Satellite (TESS) pipeline and the grandchild of the Kepler Pipeline.
algorithm analysis arc data data-analysis data-reduction java k2 kepler linux macos nasa open-source pipeline science tess ziggy
Language:Java 13
ronnyerrmann / HiFLEx
Pipeline to reduce echelle data (taken with a single or bifurcated fiber input)
data-reduction echelle spectroscopy python wavelength-solution serval ceres terra
Language:Python 12
adonath / snakemake-workflow-fermi-lat
A Snakemake workflow for Fermi-LAT data reduction
data-reduction fermi-lat fermitools gammapy snakemake
Language:Python 11
geminiplanetimager / gpi_pipeline
Gemini Planet Imager Data Reduction Pipeline
astronomy data-reduction exoplanets geminiplanetimager idl ifs
Language:Prolog 8
go-outside-labs / interstellar
👾 𝗜𝗻𝘁𝗲𝗿𝘀𝘁𝗲𝗹𝗹𝗮𝗿 𝗗𝘂𝘀𝘁 𝗱𝗮𝘁𝗮 𝗿𝗲𝗱𝘂𝗰𝘁𝗶𝗼𝗻 𝗮𝗻𝗱 𝗮𝗻𝗮𝗹𝘆𝘀𝗶𝘀 𝗼𝗯𝘁𝗮𝗶𝗻𝗲𝗱 𝗳𝗿𝗼𝗺 𝘁𝗵𝗲 𝗦𝘁𝗼𝗻𝘆 𝗕𝗿𝗼𝗼𝗸 𝗠𝘁. 𝗧𝗲𝗹𝗲𝘀𝗰𝗼𝗽𝗲
idl clusters study light data-reduction analysis astrophysics
Language:IDL 8
YasminFathy / AMDRIoT
A prediction-based data reduction method that exploits LMS adaptive filters in the Internet of Things
data-reduction wireless-sensor-network prediction internet-of-things adaptive-filtering
Language:MATLAB 8
go-outside-labs / exolife
👾 𝗱𝗲𝘁𝗲𝗰𝘁𝗶𝗼𝗻 𝗼𝗳 𝗲𝘅𝗼𝗹𝗶𝗳𝗲 𝗶𝘀 𝗼𝗻𝗲 𝗼𝗳 𝘁𝗵𝗲 𝗺𝗼𝘀𝘁 𝗶𝗺𝗽𝗼𝗿𝘁𝗮𝗻𝘁 𝗴𝗼𝗮𝗹𝘀 𝗳𝗼𝗿 𝗳𝘂𝘁𝘂𝗿𝗲 𝘀𝗽𝗮𝗰𝗲 𝗺𝗶𝘀𝘀𝗶𝗼𝗻𝘀 - 𝗶𝗺𝗮𝗴𝗲𝘀 𝘁𝗮𝗸𝗲𝗻 𝗳𝗿𝗼𝗺 𝘁𝗵𝗲 𝗺𝗼𝗼𝗻 𝗮𝘁 𝘁𝗵𝗲 𝗠𝘁. 𝗦𝘁𝗼𝗻𝘆 𝗕𝗿𝗼𝗼𝗸
spectra idl data-reduction detection tex exoplanet space-missions
Language:TeX 7
neutronimaging / ToFImaging
Tool package for neutron time of flight analysis
tof data-reduction bragg-edge
Language:Jupyter Notebook 7
quince-science / QuinCe
QuinCe is an online tool for processing and quality control of data from scientific instruments, with a primary focus on oceanic data.
quality-control data-reduction oceanography co2-measurements near-real-time
Language:Java 7
spacetelescope / DRESSCode
DRESSCode (Data Reduction of Extended SWIFT Sources Code)
python swift data-reduction galaxies heasoft uvot uv-images
Language:Python 7
sPaMFouR / RedPipe
Python Scripts for Data Reduction and Analysis
data-reduction photometry-pipeline spectroscopy transients analysis
Language:Jupyter Notebook 7
szcompressor / CEAZ
An implementation of SZ lossy compression in Vivado HLS for Xilinx FPGAs.
data-reduction fpga hls lossy-compression
Language:C 6
jeenalee / tv1d
Total variation denoising algorithms for 1D data.
rust denoising data-reduction
Language:Rust 5
sparc4-dev / astropop
The ASTROnomical POlarimetry and Photometry pipeline
astronomy data-reduction image-processing photometry photometry-pipeline pipeline
Language:Python 5
chr-peters / efficient-probit-regression
This is the accompanying code repository for the AISTATS 2022 publication p-Generalized Probit Regression and Scalable Maximum Likelihood Estimation via Sketching and Coresets by Alexander Munteanu, Simon Omlor and Christian Peters.
coresets sketching probit data-reduction big-data python
Language:Jupyter Notebook 4
ivh / PyReduce
A Python port of the popular IDL data reduction package REDUCE.
astronomy data-reduction
Language:Python 4
mohaslani / BPLSH
A new fast instance selection method for machine learning.
big-data machine-learning-algorithms data-reduction locality-sensitive-hashing support-vector-machines instance-selection prototype-selection
Language:MATLAB 4
HoangPham3003 / RSLDA-in-Python
A Python implementation of RSLDA (paper "Robust Sparse Linear Discriminant Analysis").
data-reduction feature-extraction feature-reduction feature-selection lda linear-discriminant-analysis pca data-reconstruction robust-sparse-linear-discriminant-analysis
Language:Jupyter Notebook 3
mackerman44 / telemetyr
An R package for processing telemetry observation data.
telemetry fish wildlife data-reduction mark-recapture
Language:HTML 3
mdecleir / DRESSCode
DRESSCode (Data Reduction of Extended SWIFT Sources Code)
swift uvot galaxies uv-images data-reduction heasoft python
Language:Python 3
nejci / PRAr
Partition relevance analysis with the reduction step
clustering clustering-evaluation data-analysis data-visualization machine-learning ensemble-learning feature-selection feature-extraction data-reduction bayesian-statistics cluster-analysis cluster-validity-index
Language:MATLAB 3
bghojogh / Prototype-Selection-Matrix-Decomposition
The code for prototype selection and instance ranking using matrix decomposition and subspace learning
prototype-selection instance-ranking matrix-decomposition subspace-learning principal-component-analysis fisher-discriminant-analysis qr-decomposition nmf-decomposition dictionary-learning data-reduction
Language:Python 2
Fatemeh-ameri / Data-science-algorithms
Algorithms for Data Science
algorithms-for-data-science data-mapping data-reduction similarity-measures
Language:Python 2
Foroozani / Machine-Learning
:construction: ML algorithms, employing different approaches
regularization overfitting machine-learning-algorithms regression-models neural-networks optimization-algorithms data-visualization data-reduction clustering kaggle-competition feature-extraction pca
Language:Jupyter Notebook 2
szcompressor / kokkosSZ
Portable Accelerator Implementation of SZ Lossy Compressor for Scientific Data Using Kokkos
lossy-compression portability scientific-data high-performance-computing data-reduction
Language:C++ 2

data-reduction

johnkerl / miller

heucoder / dimensionality_reduction_alo_codes

easystats / parameters

szcompressor / cuSZ

lgrcia / prose

USCbiostats / partition

cylammarco / ASPIRED

dodiku / audio_noise_clustering

jilavsky / SAXS_IgorCode

juliandavidmr / TrelloResume

gramian / hapod

nasa / ziggy

ronnyerrmann / HiFLEx

adonath / snakemake-workflow-fermi-lat

geminiplanetimager / gpi_pipeline

go-outside-labs / interstellar

YasminFathy / AMDRIoT

go-outside-labs / exolife

neutronimaging / ToFImaging

quince-science / QuinCe

spacetelescope / DRESSCode

sPaMFouR / RedPipe

szcompressor / CEAZ

jeenalee / tv1d

sparc4-dev / astropop

chr-peters / efficient-probit-regression

ivh / PyReduce

mohaslani / BPLSH

HoangPham3003 / RSLDA-in-Python

mackerman44 / telemetyr

mdecleir / DRESSCode

nejci / PRAr

bghojogh / Prototype-Selection-Matrix-Decomposition

Fatemeh-ameri / Data-science-algorithms

Foroozani / Machine-Learning

szcompressor / kokkosSZ