appendix B Snowflake objects used in the examples

 

The examples in this book are based on the scenario of a fictional bakery that makes bread and pastries. The bakery delivers these baked goods to small businesses such as grocery stores, coffee shops, and restaurants in the neighborhood. The bakery data engineers ingest order data from the bakery’s customers while the data analysts and the bakery manager view reports derived from the data.

To illustrate the examples, we made up various fictional use cases, such as ingesting data continuously from a food delivery service, using data from the Snowflake Marketplace to research areas of expansion, and augmenting data with outputs from large language models (LLMs).

In each chapter, we created Snowflake objects, such as tables, views, stages, streams, functions, and so on, to illustrate the examples. This appendix summarizes the objects used in each chapter and their descriptions for your reference.

B.1 Ingesting and transforming data from CSV files (chapter 2)

In chapter 2, we ingested data from CSV files by uploading the files manually to a Snowflake internal stage. We executed the COPY command to copy the data from the staged files to a Snowflake table and then transformed the data and automated the process with a task. The objects used are summarized in table B.1.

B.2 Ingesting data from a cloud storage provider (chapter 3)

B.3 Ingesting and flattening semi-structured data (chapter 4)

B.4 Continuous data ingestion and dynamic tables (chapter 5)

B.5 Executing code natively with Snowpark (chapter 6)

B.6 Calling API endpoints and LLM functions (chapter 7)

B.7 Optimizing query performance and controlling cost (chapters 8 and 9)

B.8 Data governance and access control (chapter 10)

B.9 Designing data pipelines (chapter 11)

B.10 Ingesting data incrementally (chapter 12)

B.11 Orchestrating data pipelines (chapter 13)

B.12 Testing for data integrity and completeness (chapter 14)

B.13 Data pipeline continuous integration (chapter 15)