How to gather requirements to re-engineer a legacy data pipeline
Introduction
As data engineers, you will have to re-engineer legacy data pipelines. While re-engineering data pipelines, if you have st...
Similar Articles (10 found)
🔍 80.6% similar
How to gather requirements for your data project
1. Introduction
Data engineers are often caught off guard by undefined end-user assumptions. As a dat...
🔍 76.7% similar
Understand & Deliver on Your Data Engineering Task
- 1. Introduction
- 2. Understanding your data engineering task
- 3. Delivering your data engineeri...
🔍 75.0% similar
What are the Key Parts of Data Engineering?
1. Introduction
If you are trying to break into (or land a new) data engineering job, you will inevitably ...
🔍 71.6% similar
How to choose the right tools for your data pipeline
1. Introduction
If you are building data pipelines from the ground up, the number of available da...
🔍 69.6% similar
Data Engineering Best Practices - #1. Data flow & Code
- 1. Introduction
- 2. Sample project
- 3. Best practices
- 3.1. Use standard patterns that pro...
🔍 69.0% similar
Data Engineering Interview Preparation Series #2: System Design
- 1. Introduction
- 2. Guide the interviewer through the process
- 2.1. [Requirements ...
🔍 68.8% similar
Data Engineering Project for Beginners - Batch edition
- 1. Introduction
- 2. Objective
- 3. Run Data Pipeline
- 4. Architecture
- 5. Code walkthrough...
🔍 68.0% similar
6 Steps to Avoid Messy Data in Your Warehouse
- 1. Introduction
- 2. Six Steps for a Clean Data Warehouse
- 2.1. Understand the business
- 2.2. Make d...
🔍 68.0% similar
End-to-end data engineering project - batch edition
- Objective
- Setup
- Components
- Choosing tools & frameworks
- Future work & improvements
- Conc...
🔍 67.9% similar
How to add tests to your data pipelines
Introduction
Testing data pipelines are different from testing other applications, like a website backend. If ...