peft contains the code of flora under peft/src/peft/tuners/flora.py
To start,
from transformers import AutoModel
from peft import get_peft_config, get_peft_model, FLoraConfig, TaskType
model_name_or_path = YOUR_MODEL
tokenizer_name_or_path = YOUR_TOKENIZER
peft_config = FLoraConfig(
task_type=TaskType.CAUSAL_LM, inference_mode=False, r=2, lora_alpha=16
)
model = AutoModel.from_pretrained(model_name_or_path)
model = get_peft_model(model, peft_config)
model.print_trainable_parameters()This is based on the peft version 0.4.0. We are working on the pull request to merge it to the latest peft.