Readiness check

As explained in Machine Learning Platform Engineering

A periodic check that determines whether a workload is ready to receive traffic.

A readiness check periodically calls the /readyz endpoint to determine whether a Kubernetes pod is ready to receive traffic. Readiness requires the pod to be alive and operational enough to handle incoming requests. section 10.4.1

Readiness checks belong to the observability and pod-management layer of a deployed service. They complement liveness probes, which call /healthz to determine whether Kubernetes should restart a faulty process. section 10.4.1

BentoML service on Kubernetes

A BentoML Service includes built-in support for health checks and liveness/readiness probes, so a model-serving pod exposes the endpoints needed for Kubernetes monitoring without requiring custom endpoint implementation. section 10.4.1

Figure 10.7 BentoML’s built-in observability endpoints for K8s environments

Inspect the built-in observability endpoints used by BentoML Services in Kubernetes environments. section 10.4.1

How Machine Learning Platform Engineering covers it

How deep it goes

Defines periodic /readyz polling and operational readiness, while deferring custom endpoint implementation.

Examples

Uses the /readyz endpoint and BentoML’s built-in Kubernetes observability endpoints as concrete examples.

What it assumes

Assumes familiarity with deployed services and Kubernetes pods while distinguishing readiness from liveness from the operational context.

What you can do after

Operate/configure BentoML services with Kubernetes readiness probes for traffic eligibility and pod observability.

How it connects

Connects observability endpoints with Kubernetes pods, health checks, liveness probes, and BentoML Services.

liveBookmanning.com

Read Machine Learning Platform Engineering on liveBook Get the book at manning.com

Also explained in

• 

  liveBookmanning.com
  Kubernetes in Action, Second EditionA readiness endpoint is an application-provided HTTP endpoint that reports whether the application is ready to serve requests.
• 

  liveBookmanning.com
  Kubernetes for DevelopersA readiness probe is a health test that determines whether an application instance is ready to receive user traffic.
• 

  liveBookmanning.com
  Quarkus in ActionA readiness probe is a Kubernetes health check that determines whether a container is ready to receive traffic.
• 

  liveBookmanning.com
  Learn Docker in a Month of Lunches, Second EditionA readiness probe is a Kubernetes container probe that determines whether a Pod should receive traffic from a Service.
• 

  liveBookmanning.com
  Spring in Action, Sixth EditionA readiness probe is a Kubernetes health check that determines whether an application instance is prepared to receive traffic.
• 

  liveBookmanning.com
  Bootstrapping Microservices, Second Edition: With Docker, Kubernetes, GitHub Actions, and TerraformA Kubernetes readiness probe is a health check that indicates whether a container or application instance is ready to receive traffic.

Compare how 7 books explain readiness check →

Related concepts

• Kubernetesused by · Kubernetes is an open-source platform for orchestrating and automating the deployment, scaling, and management of containerized workloads across computing clusters.
• health checkkind of · A health check is an assessment or probe that determines whether a system, service, or component is functioning acceptably according to defined criteria.
• liveness checkcontrasts with · A liveness check is an automated health test that determines whether a running workload remains functional or should be restarted.
• TCP socket probeincludes · A TCP socket probe is a Kubernetes container probe that checks whether a TCP connection can be established on a specified port.
• http get probeincludes · An HTTP GET probe is a Kubernetes liveness-check mechanism that sends an HTTP GET request to a specified path and port in a container and succeeds for a non-error response.

This explainer was generated by Manning's knowledge graph from the text of Machine Learning Platform Engineering. The section links point to the parts of the book it draws on.