google-research / albert

ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

google-research/albert Issues

Prediction Fails on default Colab
Closed 2 months ago2
Albert
Closed 3 months ago
Albet
Closed 3 months ago
Why do I find inconsistencies between the output of my ALBERT model converted to ONNX format and tested with ONNX Runtime, compared to the original PyTorch format model?
Updated 5 months ago
how to do inference for SQuAD style QA task using ALBERT?
Updated 10 months ago2
Load in Browser Tensorflow
Updated a year ago
torch.nn.modules.module.ModuleAttributeError: 'AlbertEmbeddings' object has no attribute 'bias'
Updated a year ago1
albert base fine-tuned on squad2.0 gets stuck in loop when predicting on new file
Updated a year ago1
Improvement to how the `app` and `pages` files conflict is shown. Especially the last log line `"pages/" - "app/"` made it seem like you should remove the `pages` folder altogether. This was a bug in how the `''` case was displayed. After having a look at this I went further and added exactly which file caused the conflict given that `app` allows you to create `app/(home)/page.js` and such it saves some digging for what the actual conflicting file is. Similarly in `pages` both `pages/dashboard/index.js` and `pages/dashboard.js` are possible.
Closed 2 years ago
The results can't be reproduced
Updated 2 years ago2
[Problem/ Squad V2] the result is too low compare with the F1 score in paper, Is something wrong?
Updated 2 years ago7
Wrong evaluate result on Squad2.0
Closed 2 years ago
Difference between v1 and v2 for xxlarge
Updated 2 years ago
when training in Race , The eval_accuracy is flat , it only has three numbers which are 0.0, 0.33334, 0.66667, 1.0
Updated 2 years ago
How to get the test embeddings from output of fine-tuned model (tutorial)
Updated 2 years ago
Default Tutorial Not Working - Can't download MRPC data
Updated 2 years ago2
Probable error on line 306 in `create_pretraining_data.py` for albert
Updated 2 years ago
which word segmentation tool is used for pretraining Chinese ALBERT
Updated 3 years ago
Discrepancy in tokenization results using albert's tokenizer and sentencepiece library
Updated 3 years ago
Wrong pieces for control symbols after loading SentencepieceProcessor from official model
Closed 3 years ago2
fine_tune albert with run_classifier.py on GPU but the GPU-util is 0,why and how?
Updated 3 years ago2
fine tune on my own English dataset
Updated 3 years ago
Could you provide the training hyper paras
Updated 3 years ago1
TypeError: '<' not supported between instances of 'int' and 'NoneType' while only predicting, try to fix it, but not sure is it make sense
Updated 3 years ago2
Error creating and exporting TFLite after fine-tuning (using run_squad_v1.py/run_squad_v2.py)
Updated 3 years ago2
The exact English pretraining data and Chinese pretraining data that are exact same to the BERT paper's pretraining data.
Updated 3 years ago
The output of the features of a given text consists of two tensor. Are they both the deep features?
Updated 3 years ago
train albert on custom dataset
Closed 3 years ago
Where to download "all.txt" to train the sentencepiece?
Updated 3 years ago
where to download the "spm_model_file" called "30k-clean.model"
Updated 3 years ago
[Implementation] Sentence order prediction (SOP) label for a single-chunk-document in create_pretraining_data.py
Updated 4 years ago
albert_base可以使用多块GPU同时训练么
Updated 4 years ago
ValueError: Expected input batch_size (864) to match target batch_size (32).
Updated 4 years ago
How to prepare for the environment/data for fine-tuning?
Closed 4 years ago2
Can ALBERT's parameter sharing concept be used in image-GPT paper implementation?
Updated 4 years ago
Finetune with multiple GPU
Updated 4 years ago
is it support fine tuning with tf2.x?
Updated 4 years ago1
Albert-base-v2 training data
Updated 4 years ago
why running run_squad_v2.py in prediction mode with dev-v2.0.json gets zero neg example
Updated 4 years ago1
tensorflow.python.framework.errors_impl.NotFoundError: Restoring from checkpoint failed.
Closed 4 years ago
Is it possible to load pretrained model's checkpoint and pretrain other corpus with that checkpoint?
Updated 4 years ago
invalid load key, '\x12'
Updated 4 years ago1
use custom vocab.txt
Updated 4 years ago1
is inner_group_num exactly equal to num_hidden_layers/num_hidden_groups?
Updated 4 years ago
Where is the function of Factorized Embedding Parameterization?
Updated 4 years ago2
model isn't learning
Updated 4 years ago1
Description problem of attention_mask.
Updated 4 years ago
different parameter position with api doc
Updated 4 years ago
get Matthew_corr = 0 in eval on CoLA
Updated 4 years ago
Extremely large RAM consumption by create_pretraining.py
Updated 4 years ago3