EricLBuehler / candle-sampling

Sampling techniques for Candle.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

candle-sampling

Continuous integration Documentation

Sampling techniques for Candle.

Currently implemented methods are:

  • multinomial (ancestral)
  • top-k
  • top-p (nucleus)
  • top-n logprobs
  • repeat penalty (frequency penalty)
  • presence penalty
  • logit bias

About

Sampling techniques for Candle.

License:MIT License


Languages

Language:Rust 100.0%