liveBook · Manning

Vicuna

As explained in Natural Language Processing in Action, Second Edition

Vicuna is an open-source large language model fine-tuned from Llama 2 for conversational and virtual-assistant tasks.

Vicuna is an open-source conversational model fine-tuned from Llama 2 for virtual-assistant tasks. Its practical appeal is efficiency: the 13-billion-parameter model is reported to approach ChatGPT’s accuracy while requiring fewer resources than larger alternatives. section 10.3.13

Its development and deployment emphasize:

  • Training on roughly 90,000 ShareGPT conversations to adapt a foundation model to dialogue. section 10.3.13
  • Comparing chatbots through Hugging Face and the LMSYS arena. section 10.3.13
  • Improving domain accuracy by combining open models, fine-tuning, semantic search, and retrieval-augmented generation. section 10.3.13

A useful limitation to remember

When asked whether it can reason about physical things, a Vicuna response states that it generates text but cannot directly perceive, sense, or interact with the physical world.

How Natural Language Processing in Action, Second Edition covers it

How deep it goes
Explains training data, comparative scale, evaluation, grounding, and local execution without detailing model architecture.
Examples
Uses ShareGPT conversations, the LMSYS arena, a physical-world limitation response, and a FastChat CPU command.
What you can do after
Operate Vicuna locally through FastChat and evaluate how grounding and domain fine-tuning may improve assistant accuracy.
How it connects
Connects Llama 2, ShareGPT, reinforcement learning from human feedback, Hugging Face, semantic search, RAG, and knowledge graphs.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Natural Language Processing in Action, Second Edition. The section links point to the parts of the book it draws on.