COVID-19 data pipeline on AWS feat. Glue/PySpark, Docker, Great Expectations, Airflow, and Redshift, templated in CF/CDK, deployable via Github Actions : r/dataengineering
Data Engineering with Reddit, Airflow, Celery, Postgres, S3, AWS Glue, Athena, Redshift | by Yusuf Ganiyu | AWS in Plain English
Reference architecture with the AWS Glue product family - AWS Glue Best Practices: Building an Operationally Efficient Data Pipeline
Migrating from self-managed Apache Airflow to Amazon Managed Workflows for Apache Airflow (MWAA) | AWS Open Source Blog
Orchestrate XGBoost ML Pipelines with Amazon Managed Workflows for Apache Airflow | AWS Machine Learning Blog
Running Spark Jobs on Amazon EMR with Apache Airflow | by Gary A. Stafford | ITNEXT
Reference architecture with the AWS Glue product family - AWS Glue Best Practices: Building an Operationally Efficient Data Pipeline
Data Pipeline with Airflow and AWS Tools (S3, Lambda & Glue) | by João Pedro | Towards Data Science
Improve observability across Amazon MWAA tasks | AWS Big Data Blog
Amazon Managed Workflows for Apache Airflow (Amazon MWAA) | AWS Big Data Blog
AWS Managed Workflows for Apache Airflow vs. Glue | by Minseok Song | Towards Data Science
ETL Orchestration on Yelp Dataset using Glue and AWS MWAA(Airflow) | by Tugrul Gokce | Dev Genius
AWS Glue vs. Apache Airflow: A Comparative Outlook
Airflow (MWAA) to Snowflake, SNS, and Glue
Introducing Amazon Managed Workflows for Apache Airflow (MWAA) | AWS News Blog
Orchestrate AWS Glue DataBrew jobs using Amazon Managed Workflows for Apache Airflow | AWS Big Data Blog
Video Demonstration: Lakehouse Automation on AWS with Apache Airflow | Programmatic Ponderings
Customer Churn Data Analytics|Data Pipeline using Apache Airflow, Glue, S3, Redshift, PowerBI|Part 1 - YouTube
End to End Data Engineering project using apache airflow and AWS (AWS Crawler, AWS Glue , Amazon Athena) | by Mbaye SENE | Medium
Building complex workflows with Amazon MWAA, AWS Step Functions, AWS Glue, and Amazon EMR | AWS Big Data Blog
AWS Glue vs. Apache Airflow: A Comparative Outlook | Nexla
Dream11's journey to building their Data Highway on AWS | AWS Big Data Blog
Orchestrate big data workflows with Apache Airflow, Genie, and Amazon EMR: Part 2 | AWS Big Data Blog
Build a Concurrent Data Orchestration Pipeline Using Amazon EMR and Apache Livy | AWS Big Data Blog
Building a Data Lake on AWS with Apache Airflow | by Gary A. Stafford | Medium
Airflow vs AWS Glue | What are the differences?
