rustformers / llm

[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

Home Page:https://docs.rs/llm/latest/llm/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Disable tokenizers-remote support for the library by default

philpax opened this issue · comments

While convenient, the tokenizers-remote feature means people will have OpenSSL dragged in unless they specify otherwise. It's probably a better default to have it disabled and let people opt in (e.g. the binary) if they want it.

Should gate this behind a feature flag imo 👍🏻