A .litertlm bundle packages a transformer model with metadata needed by LiteRT-LM. It belongs to the FlatBuffers family and serves as the unit of dispatch. section 11.2.3
The bundle includes three runtime metadata groups:
- Tokenizer configuration: vocabulary, special-token IDs, and normalization rules. section 11.2.3
- KV-cache layout: per-layer key/value dimensions, maximum sequence length, and cache-management policy. section 11.2.3
- A default sampling configuration. section 11.2.3
Unlike a .tflite file, which represents an op graph dispatched through an Interpreter, a .litertlm bundle is dispatched through LiteRT-LM. The app can stream token deltas through sendMessageAsync as a Kotlin Flow. section 11.2.3
