dezhanglee / Evaluating-Variational-Inference

Evaluating variational inference using Pareto-smoothed importance sampling and simulation-based calibration

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

R code for "Yes, but Did It Work: Evaluating Variational Inference"

The paper has been accepted by ICML 2018. Preprint

The R_code folder contains source code for Figure 1-8 in the paper, where we experimentally illustrates the benefits of proposed diagnoistics.

Abstract

While it’s always possible to compute a variational approximation to a posterior distribution,it’s difficult to work out when this approximation is good. We propose two diagnostic algorithms to alleviate this problem. The Pareto-smoothed importance sampling (PSIS) diagnostic gives a goodness of fit measurement for joint distributions through the shape parameter in the fitted distribution of density ratios. It shrinks the variational estimation error at the same time. The variational simulation-based calibration (VSBC) assesses the average performance of point estimates.

Authors

  • Yuling Yao
  • Aki Vehtari
  • Daniel Simpson
  • Andrew Gelman

License

This project is licensed under the MIT License - see the LICENSE.md file for details

About

Evaluating variational inference using Pareto-smoothed importance sampling and simulation-based calibration

License:MIT License


Languages

Language:R 97.9%Language:Stan 2.1%