concept processing layer in category cloud

This is an excerpt from Manning's book Designing Cloud Data Platforms.
Today, every major cloud provider offers a cloud storage service – and for good reason. As data flows through the data lake, cloud storage becomes a central component: raw data is stored in cloud storage and awaits processing, the processing layer saves the final results or even intermediate results back to cloud storage, and users access either raw or processed data in an ad-hoc fashion.
As we discussed in Chapter 3, the processing layer, highlighted in the diagram below, is the heart of the data platform implementation. This is where all the required business logic is applied and all the data validations and data transformations take place. The processing layer also plays an important role in providing ad-hoc access to the data in the data platform.
Figure 6.1. The processing layer is where business logic is applied and all data validations and data transformations take place as well as providing ad-hoc access to data
![]()