Docker Fundamentals for Data Engineers
1. Introduction
Docker can be overwhelming to start with. Most data projects use Docker to set up the data infra locally (and often in production). Setting up da...
Similar Articles (10 found)
🔍 77.9% similar
Setting up a local development environment for python data projects using Docker
- 1. Introduction
- 2. Set up
- 3. Reproducibility
- 4. Developer erg...
🔍 77.1% similar
How to quickly set up a local Spark development environment?
- 1. Introduction
- 2. Setup
- 3. Use VSCode devcontainers to set up Spark environment
- ...
🔍 69.6% similar
Build Data Engineering Projects, with Free Template
- 1. Introduction
- 2. Run Data Pipeline
- 3. Architecture and services in this template
- 4. CI/C...
🔍 67.5% similar
Data Engineering Projects
1. Introduction
Whether you are new to data engineering or have been in the data field for a few years, one of the most chal...
🔍 64.2% similar
Where I Use Docker Containers
Skipping the hype around Docker, Kubernetes, and containers in general; I wanted to talk through how I use them and wher...
🔍 64.2% similar
End-to-end data engineering project - batch edition
- Objective
- Setup
- Components
- Choosing tools & frameworks
- Future work & improvements
- Conc...
🔍 64.0% similar
How to test PySpark code with pytest
- 1. Introduction
- 2. Ensure the code’s logic is working as expected with tests
- 3. Conclusion
- 4. Further Rea...
🔍 63.7% similar
Data Engineering Project for Beginners - Batch edition
- 1. Introduction
- 2. Objective
- 3. Run Data Pipeline
- 4. Architecture
- 5. Code walkthrough...
🔍 63.5% similar
|
|
| | Ask HN: What is the best source to learn Docker in 2023? | | 172 points by lukasfischer on Jan 29, 2023 | hide | past | favorite | 78 comments...
🔍 62.9% similar
Why use Apache Airflow (or any orchestrator)?
- 1. Introduction
- 2. Features crucial to building and maintaining data pipelines
- 3. Conclusion
- 4. ...