information-theory

There are 9 repositories under information-theory topic.

BoltzmannEntropy / interviews.ai
It is my belief that you, the postgraduate students and job-seekers for whom the book is primarily meant will benefit from reading it; however, it is my hope that even the most experienced researchers will find it fascinating as well.
artificial-intelligence autograd bayesian-statistics convolutional-neural-networks data-science deep-learning ensemble-learning feature-extraction graduate-school information-theory interview-preparation jax jobs logistic-regression loss-functions machine-learning python pytorch pytorch-tutorial
4444
markrogoyski / math-php
Powerful modern math library for PHP: Features descriptive statistics and regressions; Continuous and discrete probability distributions; Linear algebra with matrices and vectors, Numerical analysis; special mathematical functions; Algebra
math mathematics linear-algebra statistics matrix probability distributions regression numerical-analysis information-theory number-theory vector finance combinatorics algebra php php-library
Language:PHP 2307
gregversteeg / corex_topic
Hierarchical unsupervised and semi-supervised topic models for sparse count data with CorEx
python machine-learning unsupervised-learning topic-modeling information-theory
Language:Python 627
dit / dit
Python package for information theory.
information-theory python
Language:Python 490
mapequation / infomap
Multi-level network clustering based on the Map Equation
clustering-algorithm infomap information-theory map-equation network-analysis
Language:C++ 415
gregversteeg / NPEET
Non-parametric Entropy Estimation Toolbox
python information-theory entropy estimator
Language:Python 340
gregversteeg / CorEx
CorEx or "Correlation Explanation" discovers a hierarchy of informative latent factors. This reference implementation has been superseded by other versions below.
information-theory machine-learning python unsupervised-learning
Language:Python 303
Awesome-Maths-Learning
tensorush / Awesome-Maths-Learning
😎 📜 Collection of the most awesome Maths learning resources in the form of notes, videos and cheatsheets.
math cheatsheets mathematics lecture-notes probability calculus machine-learning deep-learning linear-algebra cheatsheet group-theory awesome-list math-cheatsheets measure-theory number-theory set-theory graph-theory discrete-mathematics topology information-theory
298
ryanjgallagher / shifterator
Interpretable data visualizations for understanding how texts differ at the word level
natural-language-processing sentiment-analysis information-theory computational-social-science digital-humanities text-analysis text-as-data data-visualization
Language:Python 272
newbalancem5 / flutter_info
📚Сборник русскоязычной информации по Flutter
flutter dart bloc meetup information-theory learning bloc-flutter provider-flutter
251
jlizier / jidt
JIDT: Java Information Dynamics Toolkit for studying information-theoretic measures of computation in complex systems
information-theory transfer-entropy entropy mutual-information conditional-mutual-information conditional-transfer-entropy java python matlab octave
Language:Java 247
pwollstadt / IDTxl
The Information Dynamics Toolkit xl (IDTxl) is a comprehensive software package for efficient inference of networks and their node dynamics from multivariate time series data using information theory.
information-theory complex-systems transfer-entropy partial-information-decomposition active-information-storage
Language:Python 233
ryanchankh / mcr2
Official Implementation of Learning Diverse and Discriminative Representations via the Principle of Maximal Coding Rate Reduction (2020)
representation-learning information-theory deep-learning clustering
Language:Python 189
gregversteeg / bio_corex
A flexible version of CorEx developed for bio-data challenges that handles missing data, continuous/discrete variables, multi-CPU, overlapping structure, and includes visualizations
information-theory machine-learning python unsupervised-learning
Language:Python 137
majianthu / pycopent
Estimating Copula Entropy (Mutual Information), Transfer Entropy (Conditional Mutual Information), and the statistics for multivariate normality test and two-sample test, and change point detection in Python
copula-entropy mutual-information causal-discovery variable-selection granger-causality transfer-entropy correlation normality-test information-theory causality python copula hypothesis-testing two-sample-test conditional-independence-test conditional-mutual-information change-point-detection entropy change-detection changepoint
Language:Python 134
drostlab / philentropy
Information Theory and Distance Quantification with R
jensen-shannon-divergence information-theory similarity-measures distance-quantification distance-measures parametric-distributions statistics r
Language:R 125
EntropyHub
MattWillFlood / EntropyHub
An open-source toolkit for entropic data analysis.
chaos complexity dynamical-systems entropy information-theory julia matlab multiscale-entropy python randomness signal-analysis signal-processing time-series multivariate-entropy
Language:TeX 120
jkbren / einet
Uncertainty and causal emergence in complex networks
causal-emergence network-science information-theory scale
Language:Jupyter Notebook 96
AI-secure / InfoBERT
[ICLR 2021] "InfoBERT: Improving Robustness of Language Models from An Information Theoretic Perspective" by Boxin Wang, Shuohang Wang, Yu Cheng, Zhe Gan, Ruoxi Jia, Bo Li, Jingjing Liu
bert language-models adversarial-attacks adversarial-defense adversarial-robustness roberta information-theory
Language:Python 82
choasma / HSIC-bottleneck
The HSIC Bottleneck: Deep Learning without Back-Propagation
deep-learning hsic information-bottleneck-theory information-theory pytorch
Language:Python 77
rwnobrega / komm
An open-source library for Python 3 providing tools for analysis and simulation of analog and digital communication systems.
communications error-control block-coding convolutional-coding modulation pulse-formatting sequences source-coding information-theory
Language:Python 77
frites
brainets / frites
Framework for Information Theoretical analysis of Electrophysiological data and Statistics
information-theory electrophysiological-data statistics group-level rfx ffx gaussian-copula cluster-based neurophysiological-data functional-connectivity brainweb brainhack institut-neurosciences-timone brainhack-marseille
Language:Python 73
Blunde1 / agtboost
Adaptive and automatic gradient boosting computations.
machine-learning gradient-boosting information-theory adaptive-learning
Language:R 66
srogatch / ProbQA
Probabilistic question-asking system: the program asks, the users answer. The minimal goal of the program is to identify what the user needs (a target), even if the user is not aware of the existence of such a thing/product/service.
artificial-intelligence agi neuron neural-network bayesian-inference machine-learning statistics matrix strong-ai search expert-system human-computer-interaction algorithms-datastructures parallel-computing fuzzy-search fuzzy-logic classification binary-search entropy information-theory
Language:C++ 64
sts10 / tidy
Combine and clean word lists
rust-lang wordlist-processing rust wordlist-technique wordlist-generator wordlist entropy information-theory
Language:Rust 64
affeldt-aist / infotheo
A Coq formalization of information theory and linear error-correcting codes
convexity error-correcting-codes information-theory math-comp mathcomp probability ssreflect
Language:Coq 61
phuijse / P4J
Periodic time series analysis tools based on information theory
astronomy information-theory light-curves period-detection time-series
Language:Python 50
kxytechnologies / kxy-python
A toolkit to boost the productivity of machine learning engineers.
machine-learning machine-learning-library information-theory python feature-engineering feature-selection model-compression
Language:Python 48
gregversteeg / LinearCorex
Fast, linear version of CorEx for covariance estimation, dimensionality reduction, and subspace clustering with very under-sampled, high-dimensional data
python machine-learning unsupervised-learning information-theory factor-analysis covariance-matrix clustering
Language:Python 43
google-research / pisac
Tensorflow 2 source code for the PI-SAC agent from "Predictive Information Accelerates Learning in RL" (NeurIPS 2020)
reinforcement-learning robotics deep-learning machine-learning deep-reinforcement-learning information-theory vision
Language:Python 41
adityashrm21 / information-theory-deep-learning
Resources and Implementations (PyTorch) for Information Theoretical concepts in Deep Learning
deep-learning deep-neural-networks information-theory neural-networks pytorch
Language:Jupyter Notebook 40
hrayrhar / limit-label-memorization
Improving generalization by controlling label-noise information in neural network weights.
information-theory neural-network generalization memorization
Language:Jupyter Notebook 39
ucla-vision / information-dropout
Implementation of Information Dropout
deep-learning information-theory machine-learning representation-learning
Language:Python 39
majianthu / copent
R package for estimating copula entropy (mutual information), transfer entropy (conditional mutual information), and the statistic for multivariate normality test and two-sample test
copula entropy estiamtion mutualinf copula-entropy causal-discovery variable-selection transfer-entropy granger-causality correlation normality-test information-theory mutual-information r machine-learning causality two-sample-test conditional-independence-test conditional-mutual-information
Language:R 38
hrayrhar / T-CorEx
Implementation of linear CorEx and temporal CorEx.
machine-learning information-theory unsupervised-learning clustering corex temporal-data covariance-estimation
Language:Python 35
polsys / ennemi
Easy Nearest Neighbor Estimation of Mutual Information
information-theory mutual-information entropy python scientific-computing
Language:Python 35