liveBook · Manning

Snowpipe Streaming API

As explained in Snowflake Data Engineering

Snowpipe Streaming API is a Snowflake programmatic interface for continuously ingesting row-oriented streaming data as it becomes available.

Snowpipe Streaming API is a Snowflake programmatic interface for continuously ingesting row-oriented streaming data as it becomes available, including data produced by Apache Kafka topics. section 5.4

Choose the ingestion approach according to the producer and integration boundary:

  • Use a custom Java application with the Snowpipe Streaming API to automatically load streaming rows into Snowflake. section 5.4
  • Use the Kafka connector when a framework that reads Kafka topics and writes to Snowflake tables is preferable. section 5.4

How Snowflake Data Engineering covers it

How deep it goes
Defines the API and its application boundary but defers implementation configuration and code details.
Examples
Uses Apache Kafka topics as the representative source for continuously produced streaming rows.
What you can do after
Apply it via a custom Java application to load streaming data into Snowflake continuously.
How it connects
Connects continuous data ingestion with Apache Kafka, custom Java applications, Kafka Connector, and Snowflake tables.
Cover of Snowflake Data Engineering
liveBookmanning.com
Read Snowflake Data Engineering on liveBook Get the book at manning.com

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Snowflake Data Engineering. The section links point to the parts of the book it draws on.