Giters

facebookresearch / LASER

Language-Agnostic SEntence Representations

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Is there a limit of sentence length for LASER?

maohbao opened this issue · comments

commented

Hello there,

Is there a limit of sentence length for LASER? How it process long sentence during embedding?

Thank you!

commented

Hi @maohbao! It can accept variable input lengths, so inference will probably depend on the amount of memory available on your hardware. For practical purposes, it may be worthwhile to filter out very long sentences in your input data (e.g. > 1024 tokens).

commented

Closing due to inactivity. Please re-open if needed!