How deeply does Machine Learning System Design cover Amazon ElastiCache?

Explains service choice, cache pattern, TTL consideration, batch interaction, monitoring, and access boundaries without implementation detail.

Amazon ElastiCache

As explained in Machine Learning System Design

AWS ElastiCache is a managed in-memory caching service compatible with engines including Redis and Memcached.

Amazon ElastiCache provides a managed key-value cache for reducing inference-server load when some queries are much more popular than others. It supports Redis and Memcached and is suited to runtime inference rather than batch inference. section 15.5.2

A practical caching setup should:

Use a simple key-value cache with a low time to live, choosing the exact duration through data analysis. section 15.5.2
Let batch inference update the cache when a key changes, rather than using the cache as part of batch inference itself. section 15.5.2
Monitor CPU and RAM usage, request volume, and active instances while ensuring the serving system is accessible only to the application. section 15.5.2

How Machine Learning System Design covers it

liveBook manning.com

Read Machine Learning System Design on liveBook Get the book at manning.com

Also explained in

liveBook manning.com

Amazon Web Services in Action, Third Edition: An in-depth guide to AWSAmazon ElastiCache is a managed in-memory caching service supporting engines such as Redis and Memcached.

Compare how 2 books explain Amazon ElastiCache →

Related concepts

AWS Identity and Access Managementused by · AWS Identity and Access Management is an AWS service that manages identities and controls authentication and authorization to AWS resources through policies and permissions.
IAM policyconfigured by · An IAM policy is a declarative set of rules specifying which identities or principals may perform which actions on which resources.
security groupconfigured by · A security group is a virtual firewall configuration that controls permitted inbound and outbound network traffic for associated cloud resources.
MemoryDBalternative to · Amazon MemoryDB is a managed, durable, Redis-compatible in-memory database service that persists data using a distributed transaction log.
Redisuses · Redis is an open-source, in-memory data-structure store that provides network-accessible data operations and supports persistence.
Memcacheduses · Memcached is an open-source distributed in-memory key-value caching system for storing data that can be retrieved quickly.

This explainer was generated by Manning's knowledge graph from the text of Machine Learning System Design. The section links point to the parts of the book it draws on.