Use AWS Glue Job Bookmark feature with Aurora PostgreSQL Database
Published in
8 min readJan 23, 2022
· Overview
· Load data into Aurora PostgreSQL using Glue Catalog table
· Job Bookmark for JDBC source
· Create AWS Glue Job with Job bookmark feature enabled
· Crawl Aurora PostgreSQL table
· AWS Glue PySpark Script using create_dynamic_frame_from_catalog with jobBookmarkKeys
· Extract data from table without Primary Key
· Extract data from table with Primary key
· AWS Glue…