To upgrade ur feed #Connect

🌟 Startup Darrel Frater ✝️
🎡 Data Engineering Zach Wilson
🖥️ Backend John Crickett
🧑‍💻 Java Vlad Mihalcea
⚒️ DevOps, Cloud: Andrew Brown
🔐 CyberSecurity: Confidence Staveley
▶️ Developer Career: Sebastian Sigl
♻️ Renewable Energy: Nyokabi Jesse

#buildinginpublic

When I was making $42k/month at Netflix I felt rich.

When I make $42k in 3 days, I feel like a crack head.

The last minute sales for May 6th DataExpert.io boot camp were 🔥

#dataengineering

When I worked at Airbnb, I was able to leverage a few data modeling techniques using structs and arrays that cut the storage footprint by over 90%!

>100 TBs became <10 TBs!

Modeling with complex data types comes with a tradeoff with regard to usability!

Querying array…

How to learn data engineering is different from what you should learn!

Sure you can grind away at Spark, Airflow, Iceberg, SQL, and Python and make some headway. But you might be learning less effectively than you could be!

In this article I cover the 6 principles I use when…

When I worked at Airbnb, I was able to leverage a few data modeling techniques using structs and arrays that cut the storage footprint by over 90%!

>100 TBs became <10 TBs!

Modeling with complex data types comes with a tradeoff with regard to usability!

Querying array…

Been optimizing DataExpert landing page a lot! We're down to 725 KB payload. Let's go!

Load time of dataexpert.io w. Pingdom Tools 1270 ms. Size: 725.0 KB. Requests: 39. tools.pingdom.com/#63cf0c566cc00…

How to learn data engineering is different from what you should learn!

Sure you can grind away at Spark, Airflow, Iceberg, SQL, and Python and make some headway. But you might be learning less effectively than you could be!

In this article I cover the 6 principles I use when…

DataExpert.io bootcamp is innovating! Here’s what we’re adding in V4!

- high quality LLM-generated feedback on homework submissions for much faster feedback cycles with OpenAI

- use Careerflow to track your mentorship sessions and use AI to develop an optimized…

I did 18m impressions here, 23m on Instagram, 13m on TikTok and 67m on LinkedIn in the past year!

Let’s go!!

Most data engineering isn’t “big data” and it’s exhausting that industry doesn’t see it that way!

Unless you’re at 20-30 specific companies, one terabyte would be considered gigantic

Data engineering is first about quality and completeness and second about scale.

So if…

Most data engineering isn’t “big data” and it’s exhausting that industry doesn’t see it that way!

Unless you’re at 20-30 specific companies, one terabyte would be considered gigantic

Data engineering is first about quality and completeness and second about scale.

So if…

An abundance of options is how you build a life on your own terms!

- should I go back and be a principal engineer in big tech?
Recruiters are messaging everyday again.

- should I sell my business and try something new?
I’m getting offers from people here

- should I post…

I've been working through Zach Wilson 's self-paced boot camp and it has been an invaluable learning experience for me. The thorough coverage of material and the immediate application of new concepts have been particularly impressive. Highly recommend!

Big data SQL JOINs with high cardinality have a few tiers of size:

<10 million rows = query comes back almost instantly
<100 million rows = query comes back in a few minutes
<1 billion rows = query comes back in an hour or two
<10 billion rows = query takes half the day…

Attending Zach Wilson 's Bootcamp was transformative in my data engineering journey. The rigorous six-week program helped me refresh certain concepts and ramp up new technologies.
The next cohort commences on May 6th for those seeking to elevate their data engineering skills.

My last year at Airbnb I made $600k as a staff engineer
My first year as a creator I made $1.1m (at an 85% profit margin)

How is this possible?

After you start building an audience, you need to offer them enhanced value.

I do this from a tiered system:
- newsletter priced at…

An abundance of options is how you build a life on your own terms!

- should I go back and be a principal engineer in big tech?
Recruiters are messaging everyday again.

- should I sell my business and try something new?
I’m getting offers from people here

- should I post…

Since covid...
4M kids have left public school system
2.6M teachers resigned from the public school system
54% YoY growth of alternative schooling

🤯

Big data SQL JOINs with high cardinality have a few tiers of size:

<10 million rows = query comes back almost instantly
<100 million rows = query comes back in a few minutes
<1 billion rows = query comes back in an hour or two
<10 billion rows = query takes half the day…

Made a rookie JavaScript mistake today.

Object.keys(module_map) throws when module_map is null.

Slapping module_map && in front saves the day!

#softwareengineering