The Data Exchange with Ben Lorica
A series of informal conversations with thought leaders, researchers, practitioners, and writers on a wide range of topics in technology, science, and of course big data, data science, artificial intelligence, and related applications. Anchored by Ben Lorica (@BigData), the Data Exchange also features a roundup of the most important stories from the worlds of data, machine learning and AI. Detailed show notes for each episode can be found on https://thedataexchange.media/ The Data Exchange podcast is a production of Gradient Flow [https://gradientflow.com/].
The Data Exchange with Ben Lorica
The combination of the right software and commodity hardware will prove capable of handling most machine learning tasks
•
Ben Lorica
In this episode of the Data Exchange I speak with Nir Shavit, Professor of EECS at MIT, and cofounder and CEO of Neural Magic, a startup that is creating software to enable deep neural networks to run on commodity CPUs (at GPU speeds or faster). Their initial products are focused on model inference, but they are also working on similar software for model training.
Our conversation spanned many topics, including:
- Neurobiology, in particular the combination of Nir’s research areas of multicore software and connectomics – a branch of neurobiology.
- Why he believes the combination of the right software and CPUs will prove capable of handling many deep learning tasks.
- Speed is not the only factor: the “unlimited memory” of CPUs are able to unlock larger problems and architectures.
- Neural Magic’s initial offering is in inference, model training using CPUs is also on the horizon.
Detailed show notes can be found on The Data Exchange web site.