appendix C Dataset and feature dictionaries
Reproducing the enterprise-grade AI architectures discussed in this book requires a clear understanding of the underlying data structures. Because financial data spans highly regulated personal histories, real-time market movements, and complex behavioral interactions, we used distinct types of data sources across the different parts of this book: public Kaggle datasets for risk and fraud, live market APIs for investment, and a custom-generated synthetic dataset for personalization.
This appendix provides the data dictionaries and schemas for the core features and engineered variables used across these modeling pipelines.
C.1 Credit risk dataset (part 2)
To build the credit scoring pipelines in chapters 4 through 6, we used the American Express Default Prediction dataset from Kaggle. This dataset contains high-dimensional, anonymized credit data. To ensure memory efficiency during our modeling exercises, we sampled 100,000 rows from the original 50 GB+ dataset (see table C.1).