Showing 20 of 636 URL(s)
(Page 18 of 32)
Data Engineering Interview Preparation Series #3: SQL
Data Engineering Interview Preparation Series #3: SQL
- 1. Introduction
- 2. Step-by-step process to solve any SQL interview question
- 3. Lead the conversation with a step-by-step approach and stating assumptions
- 4. Conclusion
- 5. Further reading
1. Introduction
Every data engineering interview ...
💡 Top Recommendations:
How to Extract Data from APIs for Data Pipelines using Python
How to Extract Data from APIs for Data Pipelines using Python
- 1. Introduction
- 2. APIs are a way to communicate between systems on the Internet
- 3. API Data extraction = GET-ting data from a server
- 4. Conclusion
- 5. Further reading
1. Introduction
Extracting data is one of the critical skills...
💡 Top Recommendations:
CTEs(Common Table Expression) or Temporary Tables for Spark SQL
CTEs(Common Table Expression) or Temporary Tables for Spark SQL
- 1. Introduction
- 2. CTE for short clean code & temp tables for re-usability
- 3. Conclusion
- 4. Recommended reading
1. Introduction
As a data engineer, CTEs(Common Table Expression) are one of the best techniques you can use to impr...
💡 Top Recommendations:
Advanced SQL is knowing how to model the data & get there effectively
Advanced SQL is knowing how to model the data & get there effectively
- 1. Introduction
- 2. SQL techniques
- 3. Query optimization
- 4. Data modeling & data flow
- 5. Conclusion
- 6. Further reading
1. Introduction
Most data engineering job descriptions these days expect “knowledge of advanced SQL,...
💡 Top Recommendations:
Using Joins and Group Bys the right way for data warehousing
Using Joins and Group Bys the right way for data warehousing
- 1. Introduction
- 2. Joins & Group bys are two of the most commonly used operations in data warehousing
- 3. Conclusion
- 4. Recommended reading
1. Introduction
Joins represent the denormalization of data to create dimensions and add dim...
💡 Top Recommendations:
There is no longer any such thing as Computer Security
There is no longer any such thing as Computer Security
Remember “cybersecurity”?
Mysterious hooded computer guys doing mysterious hooded computer guy... things! Who knows what kind of naughty digital mischief they might be up to?
Unfortunately, we now live in a world where this kind of digital misch...
💡 Top Recommendations:
To Serve Man, with Software
To Serve Man, with Software
I didn’t choose to be a programmer. Somehow, it seemed, the computers chose me. For a long time, that was fine, that was enough; that was all I needed. But along the way I never felt that being a programmer was this unambiguously great-for-everyone career field with zero ...
💡 Top Recommendations:
The Cloud Is Just Someone Else’s Computer
The Cloud Is Just Someone Else’s Computer
When we started Discourse in 2013, our server requirements were high:
- 1GB RAM
- modern, fast dual core CPU
- speedy solid state drive with 20+ GB
I’m not talking about a cheapo shared cpanel server, either, I mean a dedicated virtual private server with th...
💡 Top Recommendations:
What does Stack Overflow want to be when it grows up?
What does Stack Overflow want to be when it grows up?
I sometimes get asked by regular people in the actual real world what it is that I do for a living, and here’s my 15 second answer:
We built a sort of Wikipedia website for computer programmers to post questions and answers. It’s called Stack Ove...
💡 Top Recommendations:
The Rise of the Electric Scooter
The Rise of the Electric Scooter
In an electric car, the (enormous) battery is a major part of the price. If electric car prices are decreasing, battery costs must be decreasing, because it’s not like the cost of fabricating rubber, aluminum, glass, and steel into car shapes can decline that much, r...
💡 Top Recommendations:
Electric Geek Transportation Systems
Electric Geek Transportation Systems
I’ve never thought of myself as a “car person.” The last new car I bought (and in fact, now that I think about it, the first new car I ever bought) was the quirky 1998 Ford Contour SVT. Since then, we bought a VW station wagon in 2011 and a Honda minivan in 2012 ...
💡 Top Recommendations:
An Exercise Program for the Fat Web
An Exercise Program for the Fat Web
When I wrote about App-pocalypse Now in 2014, I implied the future still belonged to the web. And it does. But it’s also true that the web has changed a lot in the last 10 years, much less the last 20 or 30.
Websites have gotten a lot… fatter.
While I think it’s i...
💡 Top Recommendations:
Building a PC, Part IX: Downsizing
Building a PC, Part IX: Downsizing
Hard to believe that I’ve had the same PC case since 2011, and my last serious upgrade was in 2015. I guess that’s yet another sign that the PC is over, because PC upgrades have gotten really boring. It took 5 years for me to muster up the initiative to get my syst...
💡 Top Recommendations:
I Fight For The Users
I Fight For The Users
If you haven’t been able to keep up with my blistering pace of one blog post per year, I don’t blame you. There’s a lot going on right now. It’s a busy time. But let’s pause and take a moment to celebrate that Elon Musk destroyed Twitter. I can’t possibly say it better than Pau...
💡 Top Recommendations:
The 2030 Self-Driving Car Bet
The 2030 Self-Driving Car Bet
It’s my honor to announce that John Carmack and I have initiated a friendly bet of $10,000* to the 501(c)(3) charity of the winner’s choice:
By January 1st, 2030, completely autonomous self-driving cars meeting SAE J3016 level 5 will be commercially available for passen...
💡 Top Recommendations:
Updating The Single Most Influential Book of the BASIC Era
Updating The Single Most Influential Book of the BASIC Era
In a way, these two books are responsible for my entire professional career.
With early computers, you didn’t boot up to a fancy schmancy desktop, or a screen full of apps you could easily poke and prod with your finger. No, those computers ...
💡 Top Recommendations:
Stay Gold, America
Stay Gold, America
We are at an unprecedented point in American history, and I'm concerned we may lose sight of the American Dream.
We are at an unprecedented point in American history, and I’m concerned we may lose sight of the American Dream:
- The costs of housing, healthcare, and education have ...
💡 Top Recommendations:
The Great Filter Comes For Us All
The Great Filter Comes For Us All
With a 13 billion year head start on evolution, why haven’t any other forms of life in the universe contacted us by now?
(Arrival is a fantastic movie. Watch it, but don’t stop there – read the Story of Your Life novella it was based on for so much additional nuance...
💡 Top Recommendations:
Let's Talk About The American Dream
Let's Talk About The American Dream
A few months ago I wrote about what it means to stay gold — to hold on to the best parts of ourselves, our communities, and the American Dream itself. But staying gold isn’t passive. It takes work. It takes action. It takes hard conversations that ask us to confro...
💡 Top Recommendations:
The Road Not Taken is Guaranteed Minimum Income
The Road Not Taken is Guaranteed Minimum Income
The dream is incomplete until we share it with our fellow Americans.
The following is drawn from a speech I delivered today at Cooper Union’s Great Hall in New York City, where I joined Lieutenant Colonel Alexander Vindman to discuss the future of the ...
💡 Top Recommendations: