liveBook · Manning

Unsloth

Unsloth is an open-source software library that accelerates language-model training and fine-tuning while reducing memory and other resource requirements.

How 2 Manning books explain it

Building Specialized AI Systems

An open-source library for accelerating and simplifying large-language-model fine-tuning.

How it is used
Accelerates domain-specific fine-tuning when compute resources are limited.
How deep it goes
Demonstrates installation, model loading, LoRA configuration, dataset formatting, training, testing, and saving, while deferring detailed parameter explanations.
Examples
Uses a credit-risk dataset, chat prompt template, applicant test case, and generated high-risk assessment.
What you can do after
Operate a LoRA fine-tuning workflow for a quantized language model and save the resulting model and tokenizer.

Read how Building Specialized AI Systems explains Unsloth →

Build Applications with Local AI Models on a Mac

A software library that accelerates and streamlines fine-tuning of language models while aiming to reduce memory use.

How it is used
Uses Unsloth to connect fine-tuning on personal examples with local model deployment.
How deep it goes
Outlines training, export, and deployment steps with example commands, without detailing the notebook training cells.
Examples
Uses conversations, documents, and input/output pairs as training data and shows GGUF export and Ollama commands.
What you can do after
Apply it via Unsloth to fine-tune a selected model on domain data and export it for local serving.

Read how Build Applications with Local AI Models on a Mac explains Unsloth →

Also covered in

What to know first

Related concepts

Questions about Unsloth

What is Unsloth?

Unsloth is an open-source software library that accelerates language-model training and fine-tuning while reducing memory and other resource requirements.

Which Manning books explain Unsloth?

Building Specialized AI Systems and Build Applications with Local AI Models on a Mac.

What should I know before learning Unsloth?

Manning books that teach Unsloth usually introduce language model, Llama, low-rank adaptation and Proximal Policy Optimization first.

What is the difference between Unsloth and Ollama?

Unsloth is an open-source software library that accelerates language-model training and fine-tuning while reducing memory and other resource requirements. Ollama is software for downloading, managing, running, and serving language models locally.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.