Endpoint

As explained in Machine Learning Platform Engineering

An API endpoint is a network-accessible interface that receives requests and returns responses according to an API contract.

An API endpoint exposes a model through a network-accessible interface: it receives requests and returns responses. In production ML systems, endpoints serve real-time predictions and fit within broader deployment workflows. section 2.1.5 section 6.1.3

Common model-serving endpoint roles include:

• The income classifier’s /predict endpoint accepts a request and returns a prediction. section 6.1.3
• BentoML also exposes /metrics for Prometheus scraping; MLflow model servers provide /health and /invocations endpoints. section 6.1.3 section 10.7

Figure 6.10 Swagger document for the deployed service with the /predict endpoint

The Swagger document shows the deployed service’s /predict endpoint. section 6.1.3

How Machine Learning Platform Engineering covers it

How deep it goes

Traces deployment from application packaging through ingress, prediction requests, and metrics.

Examples

Uses an income classifier’s /predict endpoint and MLflow’s /health and /invocations endpoints.

What you can do after

Operate/configure model-serving endpoints with BentoML and Yatai or MLflow, and inspect requests, health, and metrics.

How it connects

Connects model endpoints with REST APIs, BentoML, Yatai, Kubernetes, Prometheus, and MLflow.

liveBookmanning.com

Read Machine Learning Platform Engineering on liveBook Get the book at manning.com

Also explained in

• 

  liveBookmanning.com
  Learn Go with Pocket-Sized ProjectsAn HTTP endpoint is a server-accessible interface identified by an HTTP method and request target that processes web requests.
• 

  liveBookmanning.com
  ASP.NET Core in Action, 3eAn endpoint is an addressable application operation associated with a URL pattern that receives a dispatched request and returns a response.
• 

  liveBookmanning.com
  Build Financial Software with Generative AI (From Scratch)An API endpoint is a network-accessible address or operation at which an API exposes a resource or functionality.
• 

  liveBookmanning.com
  Microsoft Azure in ActionAn API endpoint is a network-accessible interface at which an application or service receives requests and returns responses.
• 

  liveBookmanning.com
  Spring Security in Action, Second EditionAn endpoint is a network-accessible entry point representing an operation or resource in an application.
• 

  liveBookmanning.com
  Build AI-Enhanced Web AppsA network-accessible interface address through which an application receives requests for a particular operation or resource.
• 

  liveBookmanning.com
  Amazon Web Services in Action, Third Edition: An in-depth guide to AWSA service endpoint is a network-accessible address through which clients connect to a specific service or resource.
• 

  liveBookmanning.com
  Spring in Action, Sixth EditionA REST endpoint is an addressable HTTP interface through which a client accesses a resource or operation according to REST principles.
• 

  liveBookmanning.com
  Pro ASP.NET Core 7, Tenth EditionAn endpoint is an ASP.NET Core object representing a selected application handler together with its metadata and execution logic.
• 

  liveBookmanning.com
  Snowflake Data EngineeringAn API endpoint is a network-accessible interface location representing a specific operation or resource of an application programming interface.
• 

  liveBookmanning.com
  Build Python Web Apps with StreamlitAn endpoint is an API-specific address identifying a particular operation or resource.
• 

  liveBookmanning.com
  Automating API DeliveryAn API endpoint is a network-accessible interface location through which a client invokes a particular API resource or operation.
• 

  liveBookmanning.com
  Quarkus in ActionA REST endpoint is a network-accessible resource interface that handles HTTP interactions according to REST conventions.
• 

  liveBookmanning.com
  Go in Action, Second EditionAn HTTP endpoint is a network-accessible interface identified by an HTTP method and resource location that handles client requests.
• 

  liveBookmanning.com
  Grokking AI ApplicationsA network-accessible address exposed by an API for receiving requests to perform an operation or provide data.
• 

  liveBookmanning.com
  Django in ActionAn API endpoint is a network-accessible interface location that receives requests and returns API responses.
• 

  liveBookmanning.com
  Secure APIsAn API endpoint is a network-accessible interface location that exposes one or more API operations.
• 

  liveBookmanning.com
  ScyllaDB in ActionAn API endpoint is a network-accessible path or interface through which an application receives requests and returns responses.
• 

  liveBookmanning.com
  Contract Testing in ActionAn API endpoint is a network-accessible operation at a specified URL and method through which a client interacts with an API.
• 

  liveBookmanning.com
  gRPC Microservices in GoA gRPC endpoint is a network-accessible interface through which a client communicates with a gRPC service.
• 

  liveBookmanning.com
  Building Web APIs with ASP.NET CoreAn endpoint is a network-accessible entry point through which a web API exposes an operation or resource.
• 

  liveBookmanning.com
  .NET in Action, Second EditionAn endpoint is a network-accessible interface that receives requests and returns responses for a defined operation or resource.
• 

  liveBookmanning.com
  Learn Haskell by ExampleAn API endpoint is a network-accessible operation identified by a route and HTTP method at which an API accepts requests.
• 

  liveBookmanning.com
  Effective Data AnalysisAn API endpoint is a specific network-accessible address at which an API receives requests for a particular resource or operation.
• 

  liveBookmanning.com
  Python Concurrency with asyncio

Compare how 26 books explain endpoint →

Related concepts

• contractpart of · An API contract is a specification of the operations, data, and behavioral expectations that govern interactions between software components.
• managed APIused by · A managed API is an interface to a remotely hosted service whose provider operates the underlying software and infrastructure.
• base pathconfigured by · A base path is the common URL or URI path prefix under which an application, API, or set of resources is exposed.
• request messageused by · An HTTP request is a message sent by a client to a server that specifies a method and target and may include headers and a body.
• health check endpointincludes · A health check endpoint is an API endpoint that reports whether an application or service is operating correctly or ready to handle requests.

This explainer was generated by Manning's knowledge graph from the text of Machine Learning Platform Engineering. The section links point to the parts of the book it draws on.