emptymalei / ptstat

Probabilistic Programming and Statistical Inference in PyTorch

PtStat

Probabilistic Programming and Statistical Inference in PyTorch.

Introduction

This project is being developed during my time at Cogent Labs.

The documentation is still WIP, a brief API description is reported below. The tests might also be helpful.

The API might change quickly during this initial development period.

API

The first dimension is the batch dimension, over which the samples are assumed to be independent.

# Random variables interface:

class RandomVariable:
    def size(self)        # --> (batch_size, rv_dimension)
        
    def log_pdf(self, x)  # --> [batch_size]

    def sample(self)      # --> [batch_size, rv_dimension]

    def entropy(self)     # --> [batch_size]


# Implemented random variables:

Normal(size=(batch_size, rv_dimension), cuda=cuda)
Normal(mu, sd)

Categorical(size=(batch_size, rv_dimension), cuda=cuda)
Categorical(p)

Bernoulli(size=(batch_size, rv_dimension), cuda=cuda)
Bernoulli(p)

Uniform(size=(batch_size, rv_dimension), cuda=cuda)

# KL-Divergence:

def kld(rv_from, rv_to)  # --> [batch_size]

Changelog

Version 0.2.0

• removed specialized distributions => more flexible constructors
• refactoring: distributions into multiple files

Version 0.1.0

• initial commit

Licensing

The code is released under the MIT license.