![COVID-19 data pipeline on AWS feat. Glue/PySpark, Docker, Great Expectations, Airflow, and Redshift, templated in CF/CDK, deployable via Github Actions : r/dataengineering COVID-19 data pipeline on AWS feat. Glue/PySpark, Docker, Great Expectations, Airflow, and Redshift, templated in CF/CDK, deployable via Github Actions : r/dataengineering](https://preview.redd.it/covid-19-data-pipeline-on-aws-feat-glue-pyspark-docker-v0-4qpi4llisora1.png?auto=webp&s=9c51efabd9f1c0d1cead13be212e7e5044d1897f)
COVID-19 data pipeline on AWS feat. Glue/PySpark, Docker, Great Expectations, Airflow, and Redshift, templated in CF/CDK, deployable via Github Actions : r/dataengineering
![Data Preparation on AWS: Comparing Available ELT Options to Cleanse and Normalize Data | Programmatic Ponderings Data Preparation on AWS: Comparing Available ELT Options to Cleanse and Normalize Data | Programmatic Ponderings](https://programmaticponderings.files.wordpress.com/2022/03/etl-shootout-v2.png?w=1200)
Data Preparation on AWS: Comparing Available ELT Options to Cleanse and Normalize Data | Programmatic Ponderings
![Introducing AWS Glue serverless Spark UI for better monitoring and troubleshooting | AWS Big Data Blog Introducing AWS Glue serverless Spark UI for better monitoring and troubleshooting | AWS Big Data Blog](https://d2908q01vomqb2.cloudfront.net/b6692ea5df920cad691c20319a6fffd7a4a766b8/2023/11/09/bdb-3733-image003.jpg)
Introducing AWS Glue serverless Spark UI for better monitoring and troubleshooting | AWS Big Data Blog
![Process data with varying data ingestion frequencies using AWS Glue job bookmarks | AWS Big Data Blog Process data with varying data ingestion frequencies using AWS Glue job bookmarks | AWS Big Data Blog](https://d2908q01vomqb2.cloudfront.net/b6692ea5df920cad691c20319a6fffd7a4a766b8/2020/06/19/GlueJobBookmarks1.png)
Process data with varying data ingestion frequencies using AWS Glue job bookmarks | AWS Big Data Blog
![Build an automatic data profiling and reporting solution with Amazon EMR, AWS Glue, and Amazon QuickSight | AWS Big Data Blog Build an automatic data profiling and reporting solution with Amazon EMR, AWS Glue, and Amazon QuickSight | AWS Big Data Blog](https://d2908q01vomqb2.cloudfront.net/b6692ea5df920cad691c20319a6fffd7a4a766b8/2020/04/30/AutoDataProfilingEMRGlueQuickSight1_revised.png)