kanishkamisra / minicons

Utility for analyzing Transformer based representations of language.

https://minicons.kanishka.website

kanishkamisra/minicons Issues

IncrementalLMScorer discards probability of first token
Closed 2 months ago5
Using minicons wih XLM-R-Base and got GPU out of memory (the GPU size is 80GB)
Closed 2 months ago1
GPT2 minicons surprisal: IndexError: index out of range in self
Closed 3 months ago2
A question about extracting word representations
Closed 3 months ago3
I Must Know
Closed 6 months ago1
Discrepancies in output between simonepri/lm-scorer and minicons libraries
Closed a year ago8
Linking to docs
Updated a year ago1
Installing with conda
Closed a year ago3
incorrect tokenizers
Updated a year ago4
Very low log-probabilities (and therefore high surprisals) for a grammatical sentence
Closed a year ago5
Chinese word surprsial
Closed a year ago3
seq_score vs sequence_score vs compute_stats
Closed 2 years ago2
Testing word-by-word surprisal in languages other than English
Closed 2 years ago4
wrong tokenization for the first word
Closed 3 years ago2
Can't make the surprisal example to work
Closed 3 years ago2