6 Comments

Agreed. And I'd go farther - a lot of the problems come from lack of actual knowledge in the foundations (I'm talking for data science): good old fashioned statistics and basic scientific method. We've focused on tooling and fancy stuff on top, forgetting that competency takes study and effort.

Expand full comment
Aug 5, 2023·edited Aug 5, 2023Liked by Joe Reis

Enjoy your trip! Thank you for sharing sharing the personal voice message with the catchy duration of 5 minutes tops. That is the kind of content that stands out and makes it easy to digest any time of the date.

Expand full comment
author

Thanks! Much appreciated

Expand full comment
Aug 5, 2023Liked by Joe Reis

It would have been helpful if a few examples were provided... I understand that maybe it's hard to do that without causing embarrassment to clients, but it's difficult to understand what exactly is the problem being described without an example.

Expand full comment
author
Aug 5, 2023·edited Aug 5, 2023Author

Yeah, it’s hard for me to give examples without outing someone or a company. An example that comes to mind is where a company blew through 10% of its annual “cloud data platform” credits in 3 days due to bombarding it with streaming single row inserts and merges. Definitely could’ve avoided this by understanding the proper data ingestion patterns for this platform. Needless to say, the CFO was about to fire the data team for this.

Expand full comment

Hi Joe, Great insights on the data engineering tools. I am from Informatica data engineering team and would like to connect with you on some GTM activities for data engineers. Do you have any availability next week for a brief call?

Expand full comment