Thanks Joe, inspiring as usual. I do believe to some extent that A.I comes as gift not only for data engineering but for statisticians where they were struggling to speak and be understandable by business units. The patiential of A.I stretching minute by minute...
There are things AI does very well and any data engineer who doesn't become conversant in those things will find themselves struggling to keep up. Anytime you're writing boilerplate code or have to refactor it's a huge productivity boost. Things like writing unit tests should be 90% AI. That said, the reason I'm not that worried about the current crop of AI at least replacing data engineers is that a lot of what makes a good data engineer is about understanding the underlying systems and processes that drive the data creation and using that understanding to model in a way that maximizes the effectiveness of data for the business. AI isn't there yet. Ironically I'd say we're better positioned in some ways to maintain employment than our software engineering brethren.
Don't worry, I believe in equal opportunity. Next week I'll talk about why going 100% all in on vibe coding isn't wise.
Thanks Joe, inspiring as usual. I do believe to some extent that A.I comes as gift not only for data engineering but for statisticians where they were struggling to speak and be understandable by business units. The patiential of A.I stretching minute by minute...
I thought Big Fat Tablers were the flat earthers?!
There are things AI does very well and any data engineer who doesn't become conversant in those things will find themselves struggling to keep up. Anytime you're writing boilerplate code or have to refactor it's a huge productivity boost. Things like writing unit tests should be 90% AI. That said, the reason I'm not that worried about the current crop of AI at least replacing data engineers is that a lot of what makes a good data engineer is about understanding the underlying systems and processes that drive the data creation and using that understanding to model in a way that maximizes the effectiveness of data for the business. AI isn't there yet. Ironically I'd say we're better positioned in some ways to maintain employment than our software engineering brethren.
Excellent article Joe