nyu-mll / jiant

jiant is an nlp toolkit

https://jiant.info

nyu-mll/jiant Issues

Are the leaderboard results evaluated using 0-shot settings?
Updated 5 months ago
Add `Levenshtein` and `nltk` to `requirements.txt`
Updated 6 months ago
Can I use jiant for multi input task learning like (image, audio, video)?
Updated 9 months ago
Error report about running code in edge probing example notebook.
Updated 10 months ago2
Using JIANT to test model bias on winogender task
Updated 10 months ago
Stuck once in a while during training
Updated 10 months ago1
Support for seq2seq task
Updated a year ago
testing subsample of the test set
Updated a year ago
Evaluation script example
Updated a year ago12
Issue in `call_predict`: error while getting predictions from trained models
Updated 2 years ago
Swapped labels in CommitmentBank
Updated 2 years ago1
MLM task is broken in the new update
Updated 2 years ago1
Installation of jiant using pip fails
Updated 2 years ago5
Unable to execute run_simple() with different models of the same type
Updated 2 years ago
Can't instantiate abstract class JiantBartModel with abstract methods normalize_tokenizations
Updated 2 years ago
How to save trained multi-task model & evaluate on test data
Closed 2 years ago1
# Question about the support of DistributedDataParallel
Updated 3 years ago
How can I reproduce the results in SuperGlue paper?
Updated 3 years ago1
how to use multi-gpus to finetune large datasets like ReCoRD?
Updated 3 years ago3
How to train a task with soft label?
Closed 3 years ago1
Unable to run RAG model for tokenizing, fine-tuning, and predicting with `jiant` on branch `IRT_experiments`
Updated 3 years ago2
Documentation for Trainer and Run experiments is outdated and/or unclear
Updated 3 years ago
Multi-task Learning - Two instances of the same task
Closed 3 years ago5
XTREME tokenize_and_cache script error
Closed 3 years ago1
Error in data download while converting conllu files to conll format
Closed 3 years ago2
Unable to reproduce XTREME numbers
Updated 3 years ago2
Custom torch.utils.data.DataLoader.collate_fn
Updated 3 years ago1
IndexError in jiant/trainer.py
Closed 3 years ago
Unable to run the simple_api_fine_tuning.ipynb with Python 3.6.9
Closed 3 years ago3
Installation of jiant using pip fails
Closed 3 years ago1
blimp-and-npi branch Getting started tutorial doesn't work for me.
Closed 3 years ago
Implementation Details on the COPA Task
Updated 3 years ago
Sequential Training: How to fine-tune on MLM?
Closed 3 years ago3
Using jiant to make BioBERT and SciBERT to run superGLUE tasks
Closed 3 years ago23
Google Colab Error
Closed 3 years ago1
Help with editing the NER script
Updated 3 years ago
Reproducibility of edge probing tasks
Updated 3 years ago3
tokenize_and_cache clobbers paths.json
Updated 3 years ago
Error during edge-probing task when a span is located beyond the max_seq_length
Updated 3 years ago1
fixes in benchmark_submission_formatter.py
Updated 3 years ago1
Error in jiant_MNLI_Diagnostic_Example.ipynb?
Closed 3 years ago1
typo in supported_tasks.md?
Closed 3 years ago1
How to start training from a checkpoint or snapshot? [question] [documentation]
Updated 3 years ago2
tokenize_and_cache cooks up wacky paths
Updated 3 years ago3
DeBERTa support
Closed 3 years ago2
How to load datasets from local path?
Closed 3 years ago1
Ability to define custom models
Closed 3 years ago2
README.md "Quick Introduction" is broken
Closed 3 years ago1
Tutorial Notebooks and Installations do not work
Closed 3 years ago4
How to compute the score GPS for AXG
Closed 3 years ago1