InsuranceLake

Contents

• Overview
• Additional Resources
• Authors
• Notices
• License Summary

Overview

This solution guidance helps you deploy extract, transform, load (ETL) processes and data storage resources to create InsuranceLake. It uses Amazon Simple Storage Service (Amazon S3) buckets for storage, AWS Glue for data transformation, and AWS Cloud Development Kit (CDK) Pipelines. The solution is originally based on the AWS blog Deploy data lake ETL jobs using CDK Pipelines.

The best way to learn about InsuranceLake is to follow the Quickstart guide and try it out!

The InsuranceLake solution is comprised of two codebases: Infrastructure and ETL.

Specifically, this solution helps you to:

• Deploy a “4 Cs” (Collect, Cleanse, Consume, Comply) architecture data lake.
• Deploy ETL jobs needed to make common insurance industry data souces available in a data lake.
• Use PySpark Glue jobs and supporting resoures to perform data transforms in a modular approach.
• Ingest new data quickly with automatically supported file formats and low code ETL configuration.
• Build and replicate the application in multiple environments quickly.
• Deploy ETL jobs from a central deployment account to multiple AWS environments such as Dev, Test, and Prod.
• Leverage the benefit of self-mutating feature of CDK Pipelines; specifically, the pipeline itself is infrastructure as code and can be changed as part of the deployment.
• Increase the speed of prototyping, testing, and deployment of new ETL jobs.

Additional Resources

• InsuranceLake Quickstart AWS Workshop
• InsuranceLake Deep Dive AWS Workshop
• General Insurance dashboard on Quicksight DemoCentral using Consume-ready-data
• Life Insurance dashboard also on Quicksight DemoCentral
• AWS Solutions Library Guidance for Modern Insurance Data Lakes
• InsuranceLake in the AWS Well-Architected Framework Financial Services Industry Lens

Authors

The following people are involved in the design, architecture, development, testing, and review of this solution:

1. Cory Visi, Senior Solutions Architect, Amazon Web Services
2. Ratnadeep Bardhan Roy, Senior Solutions Architect, Amazon Web Services
3. Jose Guay, Enterprise Support, Amazon Web Services
4. Isaiah Grant, Cloud Consultant, 2nd Watch, Inc.
5. Muhammad Zahid Ali, Data Architect, Amazon Web Services
6. Ravi Itha, Senior Data Architect, Amazon Web Services
7. Justiono Putro, Cloud Infrastructure Architect, Amazon Web Services
8. Mike Apted, Principal Solutions Architect, Amazon Web Services
9. Nikunj Vaidya, Senior DevOps Specialist, Amazon Web Services

Notices

Customers are responsible for making their own independent assessment of the information in this document. This document: (a) is for informational purposes only, (b) represents AWS current product offerings and practices, which are subject to change without notice, and (c) does not create any commitments or assurances from AWS and its affiliates, suppliers or licensors. AWS products or services are provided “as is” without warranties, representations, or conditions of any kind, whether express or implied. AWS responsibilities and liabilities to its customers are controlled by AWS agreements, and this document is not part of, nor does it modify, any agreement between AWS and its customers.

License Summary

This sample code is made available under the MIT-0 license. See the LICENSE file.

Copyright Amazon.com and its affiliates; all rights reserved. This file is Amazon Web Services Content and may not be duplicated or distributed without permission.