What, why, when to use Apache Kafka, with an example
I have seen, heard and been asked questions and comments like
What is Kafka and When should I use it?
I don’t understand why we have to use Kafka
T...
Similar Articles (10 found)
🔍 58.2% similar
Why use Apache Airflow (or any orchestrator)?
- 1. Introduction
- 2. Features crucial to building and maintaining data pipelines
- 3. Conclusion
- 4. ...
🔍 57.3% similar
Data Engineering Project: Stream Edition
- 1. Introduction
- 2. Sample project
- 3. Streaming concepts
- 4. Future work
- 5. Conclusion
- 6. Further r...
🔍 56.9% similar
Small Kafka: Tansu + SQLite on a free t3.micro (AWS Free Tier)
AWS has a free tier that can be used with the t3micro instance, having 1GiB of memory a...
🔍 55.0% similar
I find stories and analogies very fascinating and — to explain message queues in a super approachable way, we will use some analogies: databases, ware...
🔍 53.7% similar
Review: Building a Real Time Data Warehouse
Many data engineers coming from traditional batch processing frameworks have questions about real time dat...
🔍 51.3% similar
While I was working on a project with Wayfair, I got the opportunity to work on a system that generated daily business reports aggregated from multipl...
🔍 51.0% similar
Apache Airflow Review: the good, the bad
When getting started with Apache Airflow
, data engineers have questions similar to the two below
“What are p...
🔍 50.5% similar
Python Essentials for Data Engineers
- Introduction
- Data is stored on disk and processed in memory
- Practicing Python
- Python basics
- Python is u...
🔍 50.3% similar
Data Engineering Project for Beginners - Batch edition
- 1. Introduction
- 2. Objective
- 3. Run Data Pipeline
- 4. Architecture
- 5. Code walkthrough...
🔍 50.3% similar
I find the best comments here to be ones where people use their knowledge and experience to discuss the relative strengths and weaknesses of the techn...