A tenant is a company or organization using the same application or service as other customers while retaining a separate account and segregated data. section 6.3.2
In a multitenant chatbot, each tenant can train a model on its own dataset. Requests are routed to that tenant’s model, improving fit for its business situation. section 6.3.2
A shared model-serving design provides:
- A model cache that keeps model graphs and dependent data in memory. section 6.3.2
- A model file server that supplies the models used by the service. section 6.3.2
- One prediction service capable of serving multiple tenant models of the same type. section 6.3.2
Tenant-specific intent classification
A school and a retail store share a chatbot application, but each has a separate account, dataset, and intent classification model. The application identifies the tenant and uses that tenant’s model for prediction. section 6.3.2
Shows a prediction service using model caching to serve multiple tenant models. section 6.3.2



