Scheduling a SQL script, using Apache Airflow, with an example
One of the most common use cases for Apache Airflow is to run scheduled SQL scripts. Developers who start with Airflow often ask the foll...
Similar Articles (10 found)
🔍 68.7% similar
How to Backfill a SQL query using Apache Airflow
- What is backfilling ?
- Setup
- Apache Airflow - Execution Day
- Backfill
- Conclusion
- Further Re...
🔍 67.2% similar
Why use Apache Airflow (or any orchestrator)?
- 1. Introduction
- 2. Features crucial to building and maintaining data pipelines
- 3. Conclusion
- 4. ...
🔍 64.0% similar
Apache Airflow Review: the good, the bad
When getting started with Apache Airflow
, data engineers have questions similar to the two below
“What are p...
🔍 59.8% similar
How to submit Spark jobs to EMR cluster from Airflow
Table of Contents
Introduction
I have been asked and seen the questions
how others are automating...
🔍 56.4% similar
Data Engineering Project for Beginners - Batch edition
- 1. Introduction
- 2. Objective
- 3. Run Data Pipeline
- 4. Architecture
- 5. Code walkthrough...
🔍 52.4% similar
Build Data Engineering Projects, with Free Template
- 1. Introduction
- 2. Run Data Pipeline
- 3. Architecture and services in this template
- 4. CI/C...
🔍 51.6% similar
Data Engineering Interview Preparation Series #3: SQL
- 1. Introduction
- 2. Step-by-step process to solve any SQL interview question
- 3. Lead the co...
🔍 51.1% similar
Data Engineering Projects
1. Introduction
Whether you are new to data engineering or have been in the data field for a few years, one of the most chal...
🔍 50.5% similar
Advantages of Using dbt(Data Build Tool)
In this article we aim to go over the reasoning behind why someone might want to use dbt
. If you are interes...
🔍 49.6% similar
How to turn a 1000-line messy SQL into a modular, & easy-to-maintain data pipeline?
1. Introduction
If you’ve been in the data space long enough, you ...