Infinite Machine Learning

Joe Reis on data engineering and architecture

June 12, 2022 Prateek Joshi
Infinite Machine Learning
Joe Reis on data engineering and architecture
Show Notes

Joe Reis is a business-minded data engineer who’s worked in the industry for 20 years. He is the CEO and Co-Founder of Ternary Data, a data engineering and architecture consulting firm based in Salt Lake City, Utah. He volunteers with several technology groups and teaches at the University of Utah. In his spare time, he likes to rock climb, produce electronic music, and take his kids on crazy adventures.

In this episode, we cover a range of topics including:
- What does a data engineer do?
- Relationship between data engineering and MLOps
- What are the components of the data engineering lifecycle?
- What should a data engineer know at a fundamental level to be successful at this?
- His book Fundamentals of Data Engineering 
- Why writing a book is one of the few activities that exposes your weaknesses and very deeply refines your thinking
- The three pillars of a solid data foundation: data architecture, data engineering, and DataOps. 
- How do you structure your first call with a potential client? 
- Why is there a mismatch between expectations and reality when it comes to using data science within a business?
- Why he puts a lot of the responsibility on the student to get good at researching problems and solutions
- How to think about architecture as a data professional