data-reduction

There are 4 repositories under data-reduction topic.

miller
johnkerl / miller
Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON
command-line command-line-tools csv csv-format data-cleaning data-processing data-reduction data-regression devops devops-tools json json-data miller statistical-analysis statistics streaming-algorithms streaming-data tabular-data tsv unix-toolkit
Language:Go 9456
heucoder / dimensionality_reduction_alo_codes
特征提取/数据降维:PCA、LDA、MDS、LLE、TSNE等降维算法的python实现
python feature-extraction data-reduction
Language:Python 2357
parameters
easystats / parameters
:bar_chart: Computation and processing of models' parameters
pvalues parameters beta ci confidence-intervals r easystats standardize pca fa bootstrap statistical-models regression-models feature-reduction standardized-estimates feature-extraction data-reduction robust-statistics hacktoberfest r-package
Language:R 476
cuSZ
szcompressor / cuSZ
A GPU accelerated error-bounded lossy compression for scientific data.
lossy-compression scientific-data data-reduction gpu cuda
Language:C++ 89
lgrcia / prose
Modular image processing pipelines with Python. Built for Astronomy.
python astronomy photometry pipeline image-processing astrophysics data-reduction ground-based observation telescope reduction
Language:Python 57
USCbiostats / partition
A fast and flexible framework for data reduction in R
r dimensionality-reduction data-reduction partitional-clustering
Language:HTML 36
cylammarco / ASPIRED
Automated SpectroPhotometric Image REDuction (ASPIRED)
astronomy astrophysics calibration data-reduction spectrophotometry spectroscopy
Language:Python 30
dodiku / audio_noise_clustering
https://dodiku.github.io/audio_noise_clustering/results/ ==> An experiment with a variety of clustering (and clustering-like) techniques to reduce noise on an audio speech recording.
python machine-learning scikit-learn clustering noise-reduction data-reduction speech audio-processing audio-analysis dsp
Language:Python 26
jilavsky / SAXS_IgorCode
Irena, Nika, and Indra SAXS Igor code by Jan Ilavsky
nika irena small-angle-xray-scattering data-reduction
Language:IGOR Pro 25
ziggy
nasa / ziggy
Ziggy, a portable, scalable infrastructure for science data processing pipelines, is the child of the Transiting Exoplanet Survey Satellite (TESS) pipeline and the grandchild of the Kepler Pipeline.
algorithm analysis arc data data-analysis data-reduction java k2 kepler linux macos nasa open-source pipeline science tess ziggy
Language:Java 18
juliandavidmr / TrelloResume
Converts trello data into fast read information
nextjs trello data-reduction reactjs
Language:JavaScript 16
gramian / hapod
HAPOD - Hierarchical Approximate Proper Orthogonal Decomposition
model-reduction model-order-reduction pod svd pca dimension-reduction data-reduction data-driven data-science datascience hpc high-performance-computing limited-memory distributed-memory unsupervised-learning proper-orthogonal-decomposition mapreduce mapreduce-algorithm
Language:MATLAB 15
adonath / snakemake-workflow-fermi-lat
A Snakemake workflow for Fermi-LAT data reduction
data-reduction fermi-lat fermitools gammapy snakemake
Language:Python 12
autistic-symposium / interstellar-idl
👾 interstellar dust data reduction and analysis obtained from the stony brook mt. telescope
idl clusters study light data-reduction analysis astrophysics
Language:IDL 12
njcuk9999 / apero-drs
A PipelinE to Reduce Observations - The DRS for SPIRou (CFHT)
astrophysics data-reduction exoplanets high-resolution pipeline radial-velocity spectroscopy spirou nirps
Language:Python 12
ronnyerrmann / HiFLEx
Pipeline to reduce echelle data (taken with a single or bifurcated fiber input)
data-reduction echelle spectroscopy python wavelength-solution serval ceres terra
Language:Python 12
autistic-symposium / exolife-idl
👾 detection of exolife is one of the most important goals for future space missions - this research was performed at the mt. stony brook
spectra idl data-reduction detection tex exoplanet space-missions
Language:TeX 10
spacetelescope / DRESSCode
DRESSCode (Data Reduction of Extended SWIFT Sources Code)
python swift data-reduction galaxies heasoft uvot uv-images
Language:Python 10
geminiplanetimager / gpi_pipeline
Gemini Planet Imager Data Reduction Pipeline
idl astronomy exoplanets data-reduction geminiplanetimager ifs
Language:Prolog 9
YasminFathy / AMDRIoT
A prediction-based data reduction method that exploits LMS adaptive filters in the Internet of Things
data-reduction wireless-sensor-network prediction internet-of-things adaptive-filtering
Language:MATLAB 9
neutronimaging / ToFImaging
Tool package for neutron time of flight analysis
tof data-reduction bragg-edge
Language:Jupyter Notebook 7
pykoala / pykoala
A multi-instrument library for IFS data reduction
astronomy python data-reduction
Language:Jupyter Notebook 7
quince-science / QuinCe
QuinCe is an online tool for processing and quality control of data from scientific instruments, with a primary focus on oceanic data.
quality-control data-reduction oceanography co2-measurements near-real-time
Language:Java 7
sPaMFouR / RedPipe
Python Scripts for Data Reduction and Analysis
data-reduction photometry-pipeline spectroscopy transients analysis
Language:Jupyter Notebook 7
sparc4-dev / astropop
The ASTROnomical POlarimetry and Photometry pipeline
astronomy data-reduction image-processing photometry photometry-pipeline pipeline
Language:Python 7
szcompressor / CEAZ
An implementation of SZ lossy compression in Vivado HLS for Xilinx FPGAs.
lossy-compression data-reduction fpga hls
Language:C 6
yuguangchen1 / KcwiKit
Improving KCWI/KDERP pipeline.
astronomy astrophysics data-reduction
Language:Python 6
ivh / PyReduce
A Python port of the popular IDL data reduction package REDUCE.
astronomy data-reduction
Language:Python 5
jeenalee / tv1d
Total variation denoising algorithms for 1D data.
rust denoising data-reduction
Language:Rust 5
TLINDEN / tablizer
Manipulate tabular output of other programs
command-line csv data-processing data-reduction devops-tools tables tabular-data tsv
Language:Go 5
chr-peters / efficient-probit-regression
This is the accompanying code repository for the AISTATS 2022 publication p-Generalized Probit Regression and Scalable Maximum Likelihood Estimation via Sketching and Coresets by Alexander Munteanu, Simon Omlor and Christian Peters.
coresets sketching probit data-reduction big-data python
Language:Jupyter Notebook 4
HoganHPH / RSLDA-in-Python
A Python implementation of RSLDA (paper "Robust Sparse Linear Discriminant Analysis").
data-reduction feature-extraction feature-reduction feature-selection lda linear-discriminant-analysis pca data-reconstruction robust-sparse-linear-discriminant-analysis
Language:Jupyter Notebook 4
mohaslani / BPLSH
A new fast instance selection method for machine learning.
big-data machine-learning-algorithms data-reduction locality-sensitive-hashing support-vector-machines instance-selection prototype-selection
Language:MATLAB 4
bghojogh / Principal-Sample-Analysis
The code for Principal Sample Analysis (PSA) for prototype selection and instance ranking
principal-sample-analysis prototype-selection instance-ranking data-reduction
Language:Python 3
Fatemeh-ameri / Data-science-algorithms
Algorithms for Data Science
data-mapping data-reduction similarity-measures algorithms-for-data-science
Language:Python 3
szcompressor / kokkosSZ
Portable Accelerator Implementation of SZ Lossy Compressor for Scientific Data Using Kokkos
lossy-compression portability scientific-data high-performance-computing data-reduction
Language:C++ 3

data-reduction

johnkerl / miller

heucoder / dimensionality_reduction_alo_codes

easystats / parameters

szcompressor / cuSZ

lgrcia / prose

USCbiostats / partition

cylammarco / ASPIRED

dodiku / audio_noise_clustering

jilavsky / SAXS_IgorCode

nasa / ziggy

juliandavidmr / TrelloResume

gramian / hapod

adonath / snakemake-workflow-fermi-lat

autistic-symposium / interstellar-idl

njcuk9999 / apero-drs

ronnyerrmann / HiFLEx

autistic-symposium / exolife-idl

spacetelescope / DRESSCode

geminiplanetimager / gpi_pipeline

YasminFathy / AMDRIoT

neutronimaging / ToFImaging

pykoala / pykoala

quince-science / QuinCe

sPaMFouR / RedPipe

sparc4-dev / astropop

szcompressor / CEAZ

yuguangchen1 / KcwiKit

ivh / PyReduce

jeenalee / tv1d

TLINDEN / tablizer

chr-peters / efficient-probit-regression

HoganHPH / RSLDA-in-Python

mohaslani / BPLSH

bghojogh / Principal-Sample-Analysis

Fatemeh-ameri / Data-science-algorithms

szcompressor / kokkosSZ