In this episode, we speak with Blake Burch, co-founder of Shipyard, a data orchestrator tool that allows you to create powerful workflows in a matter of minutes.
Top 3 Value Bombs:
- Data tests are often for the assumptions we already know. There's a lot of unknowns that can crop up and cause issues that tests are not catching. Start analyzing job metadata to alert on potential anomalies.
- Store your raw data to allow the most flexibility when it comes to re-transforming the data.
- Don’t settle for scatter shot troubleshooting. Have a clear lineage of how your data is being used from the source to the various consumers.