SFTConfig centralizes the settings for supervised fine-tuning. In a QLoRA workflow, it sets training duration, batch size, learning-rate scheduling and warmup, numerical precision, and the dataset field consumed by SFTTrainer. section 7.3.3
Listing 7.11 Configuring and training QLoRA
from trl import SFTTrainer, SFTConfig #1
training_args = SFTConfig(
output_dir="./qlora_output",
num_train_epochs=3, #2
per_device_train_batch_size=8,
gradient_accumulation_steps=1,
learning_rate=2e-4, #3
lr_scheduler_type="cosine", #4
warmup_steps=7, #5
fp16=False,
bf16=True, #6
logging_steps=10,
save_strategy="no",
max_length=MAX_SEQ_LENGTH,
dataset_text_field="text", #7
report_to="none",
)
trainer = SFTTrainer(
model=model,
train_dataset=train_dataset,
args=training_args,
)
trainer.train()
The configuration and SFTTrainer call show how the settings are applied to launch training. section 7.3.3
