LLM optimization changes model design or behavior to improve efficiency or task performance. Architecture knowledge supports techniques intended to preserve performance or improve it in specific fields. section 1.4
The treatment points toward two kinds of work:
- Study Transformer architecture to identify optimization methods that can apply across models. section 3.1
- Identify model behaviors and eliminate neurons to change unwanted behavior without affecting performance. section 1.4





































