go-cfr is a package that implements several forms of Counterfactual Regret Minimization in Go. CFR can be used to solve for an approximate Nash Equilibrium in an imperfect information extensive-form game.
This project is a research library used to study different forms of CFR. For a similar alternative in C++/Python/Swift, see OpenSpiel.
To use CFR, you must implement the extensive-form game tree for your game,
by implementing the GameTreeNode interface.
An implementation of Kuhn Poker is included as an example.
package main
import (
"fmt"
"github.com/timpalpant/go-cfr"
"github.com/timpalpant/go-cfr/kuhn"
"github.com/timpalpant/go-cfr/tree"
)
func main() {
poker := kuhn.NewGame()
policy := cfr.NewPolicyTable(cfr.DiscountParams{})
vanillaCFR := cfr.New(policy)
nIter := 10000
expectedValue := float32(0.0)
for i := 1; i <= nIter; i++ {
expectedValue += vanillaCFR.Run(poker)
}
expectedValue /= float32(nIter)
fmt.Printf("Expected value is: %v\n", expectedValue)
seen := make(map[string]struct{})
tree.Visit(poker, func(node cfr.GameTreeNode) {
if node.Type() != cfr.PlayerNodeType {
return
}
key := node.InfoSet(node.Player()).Key()
if _, ok := seen[string(key)]; ok {
return
}
actionProbs := policy.GetPolicy(node).GetAverageStrategy()
if actionProbs != nil {
fmt.Printf("[player %d] %6s: check=%.2f bet=%.2f\n",
node.Player(), key, actionProbs[0], actionProbs[1])
}
seen[string(key)] = struct{}{}
})
}- Vanilla CFR: https://poker.cs.ualberta.ca/publications/NIPS07-cfr.pdf
- CFR+: https://arxiv.org/abs/1407.5042
- Discounted (including Linear) CFR: https://arxiv.org/abs/1809.04040
- Monte Carlo CFR (MC-CFR):
- Chance Sampling, External Sampling, Outcome Sampling CFR: http://mlanctot.info/files/papers/nips09mccfr.pdf
- Average Strategy CFR: https://papers.nips.cc/paper/4569-efficient-monte-carlo-counterfactual-regret-minimization-in-games-with-many-player-actions.pdf
- Robust Sampling CFR: https://arxiv.org/abs/1901.07621
- Generalized Sampling CFR: https://dl.acm.org/citation.cfm?id=2900920
- Deep CFR: https://arxiv.org/abs/1811.00164
- Single Deep CFR: https://arxiv.org/abs/1901.07621
go-cfr is released under the GNU Lesser General Public License, Version 3.0.