{"version":"1.0.0","segments":[{"speaker":"Hannah Clark","startTime":1.32,"endTime":3.72,"body":"Innovation is"},{"speaker":"Hannah Clark","startTime":1.32,"endTime":3.72,"body":"cumulative—and by that, I"},{"speaker":"Hannah Clark","startTime":3.72,"endTime":6.36,"body":"mean that the ways we solve"},{"speaker":"Hannah Clark","startTime":3.72,"endTime":6.36,"body":"problems now couldn't be"},{"speaker":"Hannah Clark","startTime":6.36,"endTime":8.55,"body":"effective if not for the"},{"speaker":"Hannah Clark","startTime":6.36,"endTime":8.55,"body":"ways we solved them before."},{"speaker":"Hannah Clark","startTime":8.97,"endTime":11.13,"body":"And while these days, the"},{"speaker":"Hannah Clark","startTime":8.97,"endTime":11.13,"body":"words 'training data' are"},{"speaker":"Hannah Clark","startTime":11.13,"endTime":14.1,"body":"typically used in the context"},{"speaker":"Hannah Clark","startTime":11.13,"endTime":14.1,"body":"of AI development, it's worth"},{"speaker":"Hannah Clark","startTime":14.1,"endTime":18.0,"body":"remembering that users are"},{"speaker":"Hannah Clark","startTime":14.1,"endTime":18.0,"body":"also consumers and retainers"},{"speaker":"Hannah Clark","startTime":18.11,"endTime":21.5,"body":"of enormous amounts of training"},{"speaker":"Hannah Clark","startTime":18.11,"endTime":21.5,"body":"data from years of discovering"},{"speaker":"Hannah Clark","startTime":21.5,"endTime":24.29,"body":"and adopting every piece of"},{"speaker":"Hannah Clark","startTime":21.5,"endTime":24.29,"body":"software they've ever used."},{"speaker":"Hannah Clark","startTime":24.619,"endTime":26.9,"body":"So while we are busy"},{"speaker":"Hannah Clark","startTime":24.619,"endTime":26.9,"body":"obsessing over use cases"},{"speaker":"Hannah Clark","startTime":26.9,"endTime":29.72,"body":"and new features for our"},{"speaker":"Hannah Clark","startTime":26.9,"endTime":29.72,"body":"own AI products, users are"},{"speaker":"Hannah Clark","startTime":29.72,"endTime":30.979,"body":"following a different script."},{"speaker":"Hannah Clark","startTime":31.369,"endTime":33.92,"body":"They're operating with"},{"speaker":"Hannah Clark","startTime":31.369,"endTime":33.92,"body":"preferences, habits, and most"},{"speaker":"Hannah Clark","startTime":33.92,"endTime":36.41,"body":"importantly, expectations"},{"speaker":"Hannah Clark","startTime":33.92,"endTime":36.41,"body":"they've picked up since"},{"speaker":"Hannah Clark","startTime":36.41,"endTime":38.3,"body":"the very first time they"},{"speaker":"Hannah Clark","startTime":36.41,"endTime":38.3,"body":"opened a web browser."},{"speaker":"Hannah Clark","startTime":38.69,"endTime":41.06,"body":"My guest today is Dhruv"},{"speaker":"Hannah Clark","startTime":38.69,"endTime":41.06,"body":"Batra, co-founder and"},{"speaker":"Hannah Clark","startTime":41.06,"endTime":42.23,"body":"Chief Scientist at Yutori."},{"speaker":"Hannah Clark","startTime":42.68,"endTime":45.635,"body":"As you're about to hear, Dhruv's"},{"speaker":"Hannah Clark","startTime":42.68,"endTime":45.635,"body":"experience in AI research,"},{"speaker":"Hannah Clark","startTime":45.635,"endTime":48.995,"body":"development, training and"},{"speaker":"Hannah Clark","startTime":45.635,"endTime":48.995,"body":"leadership spans over 20 years."},{"speaker":"Hannah Clark","startTime":49.025,"endTime":52.295,"body":"So as you can imagine, he's"},{"speaker":"Hannah Clark","startTime":49.025,"endTime":52.295,"body":"got more fascinating insights"},{"speaker":"Hannah Clark","startTime":52.295,"endTime":54.755,"body":"on the tech than we could"},{"speaker":"Hannah Clark","startTime":52.295,"endTime":54.755,"body":"possibly cover in one episode."},{"speaker":"Hannah Clark","startTime":55.175,"endTime":57.215,"body":"With that in mind, when I"},{"speaker":"Hannah Clark","startTime":55.175,"endTime":57.215,"body":"asked Dhruv what he'd most"},{"speaker":"Hannah Clark","startTime":57.215,"endTime":59.735,"body":"like to communicate to product"},{"speaker":"Hannah Clark","startTime":57.215,"endTime":59.735,"body":"leaders, he didn't hesitate."},{"speaker":"Hannah Clark","startTime":59.975,"endTime":62.255,"body":"He told me it's that"},{"speaker":"Hannah Clark","startTime":59.975,"endTime":62.255,"body":"AI capabilities are"},{"speaker":"Hannah Clark","startTime":62.255,"endTime":63.365,"body":"extremely jagged."},{"speaker":"Hannah Clark","startTime":63.755,"endTime":66.425,"body":"And you're about to hear exactly"},{"speaker":"Hannah Clark","startTime":63.755,"endTime":66.425,"body":"what that means for your users,"},{"speaker":"Hannah Clark","startTime":66.665,"endTime":69.335,"body":"for your organization, and for"},{"speaker":"Hannah Clark","startTime":66.665,"endTime":69.335,"body":"the near future of product."},{"speaker":"Hannah Clark","startTime":69.545,"endTime":70.175,"body":"Let's jump in."},{"speaker":"Hannah Clark","startTime":72.06,"endTime":74.31,"body":"Oh, by the way, we hold"},{"speaker":"Hannah Clark","startTime":72.06,"endTime":74.31,"body":"conversations like this"},{"speaker":"Hannah Clark","startTime":74.399,"endTime":76.259,"body":"every week, so if this"},{"speaker":"Hannah Clark","startTime":74.399,"endTime":76.259,"body":"sounds interesting to"},{"speaker":"Hannah Clark","startTime":76.259,"endTime":77.67,"body":"you, why not subscribe?"},{"speaker":"Hannah Clark","startTime":77.94,"endTime":78.99,"body":"Okay, now let's jump in."},{"speaker":"Hannah Clark","startTime":80.429,"endTime":82.289,"body":"Welcome back to The"},{"speaker":"Hannah Clark","startTime":80.429,"endTime":82.289,"body":"Product Manager podcast."},{"speaker":"Hannah Clark","startTime":82.289,"endTime":84.309,"body":"I'm here today with Dhruv"},{"speaker":"Hannah Clark","startTime":82.289,"endTime":84.309,"body":"Batra, who's the  co-founder"},{"speaker":"Hannah Clark","startTime":84.309,"endTime":85.749,"body":"and Chief Scientist at Yutori."},{"speaker":"Hannah Clark","startTime":85.889,"endTime":87.419,"body":"Dhruv, thank you so much"},{"speaker":"Hannah Clark","startTime":85.889,"endTime":87.419,"body":"for joining me today."},{"speaker":"Dhruv Batra","startTime":87.84,"endTime":88.229,"body":"Of course."},{"speaker":"Dhruv Batra","startTime":88.229,"endTime":89.015,"body":"Thank you for having me, Hannah."},{"speaker":"Hannah Clark","startTime":89.715,"endTime":91.215,"body":"So let's"},{"speaker":"Hannah Clark","startTime":89.715,"endTime":91.215,"body":"get started with a little"},{"speaker":"Hannah Clark","startTime":91.215,"endTime":92.655,"body":"bit of background info."},{"speaker":"Hannah Clark","startTime":92.925,"endTime":94.665,"body":"Can you tell us a little bit"},{"speaker":"Hannah Clark","startTime":92.925,"endTime":94.665,"body":"about your background and"},{"speaker":"Hannah Clark","startTime":94.665,"endTime":97.905,"body":"how your journey through AI"},{"speaker":"Hannah Clark","startTime":94.665,"endTime":97.905,"body":"research from deep learning into"},{"speaker":"Hannah Clark","startTime":97.905,"endTime":101.355,"body":"today's generative revolution"},{"speaker":"Hannah Clark","startTime":97.905,"endTime":101.355,"body":"has shaped your perspective on"},{"speaker":"Hannah Clark","startTime":101.355,"endTime":102.765,"body":"where we are now with this tech?"},{"speaker":"Dhruv Batra","startTime":103.125,"endTime":104.775,"body":"So, I'm"},{"speaker":"Dhruv Batra","startTime":103.125,"endTime":104.775,"body":"an AI researcher."},{"speaker":"Dhruv Batra","startTime":105.075,"endTime":107.715,"body":"Been in the field almost"},{"speaker":"Dhruv Batra","startTime":105.075,"endTime":107.715,"body":"20 years at this point."},{"speaker":"Dhruv Batra","startTime":108.135,"endTime":112.515,"body":"AI research in modern discussion"},{"speaker":"Dhruv Batra","startTime":108.135,"endTime":112.515,"body":"seems to start around the"},{"speaker":"Dhruv Batra","startTime":112.545,"endTime":114.975,"body":"2022 ChatGPT revolution."},{"speaker":"Dhruv Batra","startTime":114.975,"endTime":118.8,"body":"I entered the field in"},{"speaker":"Dhruv Batra","startTime":114.975,"endTime":118.8,"body":"2005 before the last"},{"speaker":"Dhruv Batra","startTime":118.8,"endTime":120.0,"body":"epoch of deep learning."},{"speaker":"Dhruv Batra","startTime":120.45,"endTime":123.99,"body":"I, you know, I got my PhD at"},{"speaker":"Dhruv Batra","startTime":120.45,"endTime":123.99,"body":"CMU working in core machine"},{"speaker":"Dhruv Batra","startTime":123.99,"endTime":127.53,"body":"learning problems applied to"},{"speaker":"Dhruv Batra","startTime":123.99,"endTime":127.53,"body":"computer vision problems, like"},{"speaker":"Dhruv Batra","startTime":127.56,"endTime":129.36,"body":"detecting objects and images."},{"speaker":"Dhruv Batra","startTime":129.389,"endTime":133.62,"body":"Over the years, I've built"},{"speaker":"Dhruv Batra","startTime":129.389,"endTime":133.62,"body":"chat bots, built the first"},{"speaker":"Dhruv Batra","startTime":133.62,"endTime":136.89,"body":"systems that could answer"},{"speaker":"Dhruv Batra","startTime":133.62,"endTime":136.89,"body":"questions about images, hold"},{"speaker":"Dhruv Batra","startTime":136.92,"endTime":138.24,"body":"a dialogue about images."},{"speaker":"Dhruv Batra","startTime":138.66,"endTime":141.18,"body":"I was a professor at"},{"speaker":"Dhruv Batra","startTime":138.66,"endTime":141.18,"body":"Georgia Tech for many years."},{"speaker":"Dhruv Batra","startTime":141.18,"endTime":143.339,"body":"I created the deep"},{"speaker":"Dhruv Batra","startTime":141.18,"endTime":143.339,"body":"learning class."},{"speaker":"Dhruv Batra","startTime":143.73,"endTime":145.62,"body":"I also spent eight"},{"speaker":"Dhruv Batra","startTime":143.73,"endTime":145.62,"body":"years at Meta."},{"speaker":"Dhruv Batra","startTime":145.62,"endTime":148.8,"body":"I was a senior director,"},{"speaker":"Dhruv Batra","startTime":145.62,"endTime":148.8,"body":"leading FAIR Embodied AI."},{"speaker":"Dhruv Batra","startTime":148.829,"endTime":152.43,"body":"FAIR is Meta's fundamental"},{"speaker":"Dhruv Batra","startTime":148.829,"endTime":152.43,"body":"AI research division."},{"speaker":"Dhruv Batra","startTime":152.79,"endTime":156.31,"body":"Embodied AI is AI for robotics"},{"speaker":"Dhruv Batra","startTime":152.79,"endTime":156.31,"body":"and AI for smart glasses."},{"speaker":"Dhruv Batra","startTime":156.75,"endTime":160.41,"body":"So one of my teams at Meta had"},{"speaker":"Dhruv Batra","startTime":156.75,"endTime":160.41,"body":"built the earliest version of an"},{"speaker":"Dhruv Batra","startTime":160.41,"endTime":163.29,"body":"image question answering model"},{"speaker":"Dhruv Batra","startTime":160.41,"endTime":163.29,"body":"that shipped as a multimodal"},{"speaker":"Dhruv Batra","startTime":163.29,"endTime":166.47,"body":"assistant on the first version"},{"speaker":"Dhruv Batra","startTime":163.29,"endTime":166.47,"body":"of RayBan Meta sunglasses."},{"speaker":"Dhruv Batra","startTime":166.86,"endTime":169.38,"body":"Other teams of mine built"},{"speaker":"Dhruv Batra","startTime":166.86,"endTime":169.38,"body":"the world's fastest 3D"},{"speaker":"Dhruv Batra","startTime":169.38,"endTime":172.59,"body":"simulator for training virtual"},{"speaker":"Dhruv Batra","startTime":169.38,"endTime":172.59,"body":"robots and simulation before"},{"speaker":"Dhruv Batra","startTime":172.59,"endTime":175.11,"body":"we deployed them on the"},{"speaker":"Dhruv Batra","startTime":172.59,"endTime":175.11,"body":"Boston Dynamics bot robot."},{"speaker":"Dhruv Batra","startTime":175.575,"endTime":179.354,"body":"I've sort of seen the spectrum"},{"speaker":"Dhruv Batra","startTime":175.575,"endTime":179.354,"body":"from computer vision, chat"},{"speaker":"Dhruv Batra","startTime":179.354,"endTime":182.625,"body":"bots, robotics, and I've, I'm"},{"speaker":"Dhruv Batra","startTime":179.354,"endTime":182.625,"body":"just sort of fascinated about"},{"speaker":"Dhruv Batra","startTime":182.625,"endTime":185.084,"body":"intelligence and building"},{"speaker":"Dhruv Batra","startTime":182.625,"endTime":185.084,"body":"intelligence systems, and"},{"speaker":"Dhruv Batra","startTime":185.385,"endTime":187.855,"body":"that's what has taken me on"},{"speaker":"Dhruv Batra","startTime":185.385,"endTime":187.855,"body":"my journey today to Yutori."},{"speaker":"Hannah Clark","startTime":188.355,"endTime":190.034,"body":"Clearly you're"},{"speaker":"Hannah Clark","startTime":188.355,"endTime":190.034,"body":"a very qualified person"},{"speaker":"Hannah Clark","startTime":190.034,"endTime":191.575,"body":"to speak on this topic,"},{"speaker":"Hannah Clark","startTime":190.034,"endTime":191.575,"body":"which is something that I"},{"speaker":"Hannah Clark","startTime":191.575,"endTime":194.519,"body":"think all of us wanna know"},{"speaker":"Hannah Clark","startTime":191.575,"endTime":194.519,"body":"as much as possible about."},{"speaker":"Hannah Clark","startTime":194.85,"endTime":197.25,"body":"And I'm really excited about"},{"speaker":"Hannah Clark","startTime":194.85,"endTime":197.25,"body":"today's topic 'cause we're"},{"speaker":"Hannah Clark","startTime":197.25,"endTime":199.649,"body":"gonna be looking a lot more"},{"speaker":"Hannah Clark","startTime":197.25,"endTime":199.649,"body":"closely at the expectations"},{"speaker":"Hannah Clark","startTime":199.649,"endTime":202.5,"body":"versus reality when it comes"},{"speaker":"Hannah Clark","startTime":199.649,"endTime":202.5,"body":"to the state of AI technology"},{"speaker":"Hannah Clark","startTime":202.5,"endTime":205.59,"body":"right now, which I feel like"},{"speaker":"Hannah Clark","startTime":202.5,"endTime":205.59,"body":"you need to have a certain set"},{"speaker":"Hannah Clark","startTime":205.59,"endTime":207.93,"body":"of qualifications to really be"},{"speaker":"Hannah Clark","startTime":205.59,"endTime":207.93,"body":"able to speak to this topic and"},{"speaker":"Hannah Clark","startTime":207.93,"endTime":210.06,"body":"answer some of these questions"},{"speaker":"Hannah Clark","startTime":207.93,"endTime":210.06,"body":"that are really on our minds."},{"speaker":"Hannah Clark","startTime":210.405,"endTime":212.894,"body":"So we're gonna be looking at"},{"speaker":"Hannah Clark","startTime":210.405,"endTime":212.894,"body":"it today from three angles, the"},{"speaker":"Hannah Clark","startTime":212.894,"endTime":216.825,"body":"user side, the business side,"},{"speaker":"Hannah Clark","startTime":212.894,"endTime":216.825,"body":"and the technology side of AI."},{"speaker":"Hannah Clark","startTime":217.035,"endTime":219.615,"body":"Starting with the user side,"},{"speaker":"Hannah Clark","startTime":217.035,"endTime":219.615,"body":"right now, obviously we're"},{"speaker":"Hannah Clark","startTime":219.615,"endTime":223.485,"body":"caught in huge hype cycle"},{"speaker":"Hannah Clark","startTime":219.615,"endTime":223.485,"body":"around AI, but users can often"},{"speaker":"Hannah Clark","startTime":223.485,"endTime":226.155,"body":"experience some really wildly"},{"speaker":"Hannah Clark","startTime":223.485,"endTime":226.155,"body":"inconsistent results depending"},{"speaker":"Hannah Clark","startTime":226.155,"endTime":228.825,"body":"on the tools and the use"},{"speaker":"Hannah Clark","startTime":226.155,"endTime":228.825,"body":"cases that they're pursuing."},{"speaker":"Hannah Clark","startTime":229.185,"endTime":232.125,"body":"So what do you think is causing"},{"speaker":"Hannah Clark","startTime":229.185,"endTime":232.125,"body":"the gap right now between"},{"speaker":"Hannah Clark","startTime":232.125,"endTime":235.454,"body":"what people on the user side"},{"speaker":"Hannah Clark","startTime":232.125,"endTime":235.454,"body":"expect AI to do and what it"},{"speaker":"Hannah Clark","startTime":235.454,"endTime":236.715,"body":"can actually deliver right now?"},{"speaker":"Dhruv Batra","startTime":237.045,"endTime":237.87,"body":"I think"},{"speaker":"Dhruv Batra","startTime":237.045,"endTime":237.87,"body":"that's a great question."},{"speaker":"Dhruv Batra","startTime":238.685,"endTime":242.735,"body":"It speaks to a problem that"},{"speaker":"Dhruv Batra","startTime":238.685,"endTime":242.735,"body":"lies at the heart of, you know,"},{"speaker":"Dhruv Batra","startTime":242.735,"endTime":245.765,"body":"not just building products,"},{"speaker":"Dhruv Batra","startTime":242.735,"endTime":245.765,"body":"but also AI research, and that"},{"speaker":"Dhruv Batra","startTime":245.765,"endTime":248.765,"body":"gets to this nature of what"},{"speaker":"Dhruv Batra","startTime":245.765,"endTime":248.765,"body":"is often referred to as the"},{"speaker":"Dhruv Batra","startTime":248.765,"endTime":250.475,"body":"jagged nature of intelligence."},{"speaker":"Dhruv Batra","startTime":251.19,"endTime":254.31,"body":"As with many of these topics,"},{"speaker":"Dhruv Batra","startTime":251.19,"endTime":254.31,"body":"there's a famous XKCD comic"},{"speaker":"Dhruv Batra","startTime":254.37,"endTime":258.36,"body":"of a PM like figure asking"},{"speaker":"Dhruv Batra","startTime":254.37,"endTime":258.36,"body":"an engineer like figure to,"},{"speaker":"Dhruv Batra","startTime":258.66,"endTime":259.74,"body":"Hey, can you build me an app?"},{"speaker":"Dhruv Batra","startTime":259.74,"endTime":262.56,"body":"Every time someone, a user"},{"speaker":"Dhruv Batra","startTime":259.74,"endTime":262.56,"body":"takes a picture, I want to"},{"speaker":"Dhruv Batra","startTime":262.56,"endTime":265.02,"body":"know whether that picture"},{"speaker":"Dhruv Batra","startTime":262.56,"endTime":265.02,"body":"is in a national park and"},{"speaker":"Dhruv Batra","startTime":265.02,"endTime":266.61,"body":"the engineer responds."},{"speaker":"Dhruv Batra","startTime":266.67,"endTime":270.18,"body":"Sure, that's sounds like"},{"speaker":"Dhruv Batra","startTime":266.67,"endTime":270.18,"body":"simple GPS based lookup"},{"speaker":"Dhruv Batra","startTime":270.18,"endTime":271.47,"body":"query into a database."},{"speaker":"Dhruv Batra","startTime":271.53,"endTime":273.06,"body":"Gimme a few hours,"},{"speaker":"Dhruv Batra","startTime":271.53,"endTime":273.06,"body":"this should be doable."},{"speaker":"Dhruv Batra","startTime":273.51,"endTime":276.69,"body":"And then the next sentence"},{"speaker":"Dhruv Batra","startTime":273.51,"endTime":276.69,"body":"from the PM is let me know if"},{"speaker":"Dhruv Batra","startTime":276.69,"endTime":277.95,"body":"the picture is off a board."},{"speaker":"Dhruv Batra","startTime":278.31,"endTime":280.83,"body":"And the response from the"},{"speaker":"Dhruv Batra","startTime":278.31,"endTime":280.83,"body":"engineer is, I'll need a"},{"speaker":"Dhruv Batra","startTime":280.83,"endTime":283.8,"body":"research team, $50 million"},{"speaker":"Dhruv Batra","startTime":280.83,"endTime":283.8,"body":"in five years, and maybe we"},{"speaker":"Dhruv Batra","startTime":283.8,"endTime":284.88,"body":"can answer that question."},{"speaker":"Dhruv Batra","startTime":285.375,"endTime":289.035,"body":"Now the specific example in"},{"speaker":"Dhruv Batra","startTime":285.375,"endTime":289.035,"body":"that story is no longer valid."},{"speaker":"Dhruv Batra","startTime":289.095,"endTime":291.765,"body":"Computer vision has made enough"},{"speaker":"Dhruv Batra","startTime":289.095,"endTime":291.765,"body":"progress that now we can, we"},{"speaker":"Dhruv Batra","startTime":291.765,"endTime":295.815,"body":"consider detecting species of"},{"speaker":"Dhruv Batra","startTime":291.765,"endTime":295.815,"body":"birds or dogs a solved problem."},{"speaker":"Dhruv Batra","startTime":296.205,"endTime":298.515,"body":"But I think the point it's"},{"speaker":"Dhruv Batra","startTime":296.205,"endTime":298.515,"body":"trying to illustrate is"},{"speaker":"Dhruv Batra","startTime":298.515,"endTime":301.995,"body":"that there are extremely"},{"speaker":"Dhruv Batra","startTime":298.515,"endTime":301.995,"body":"sharp transitions from"},{"speaker":"Dhruv Batra","startTime":302.235,"endTime":304.935,"body":"trivial problems to"},{"speaker":"Dhruv Batra","startTime":302.235,"endTime":304.935,"body":"impossibly hard problems."},{"speaker":"Dhruv Batra","startTime":305.295,"endTime":309.345,"body":"And that sharpness is"},{"speaker":"Dhruv Batra","startTime":305.295,"endTime":309.345,"body":"difficult for people to"},{"speaker":"Dhruv Batra","startTime":309.345,"endTime":311.325,"body":"conceptualize, to predict."},{"speaker":"Dhruv Batra","startTime":311.73,"endTime":315.42,"body":"This is true not just for"},{"speaker":"Dhruv Batra","startTime":311.73,"endTime":315.42,"body":"users of technologies."},{"speaker":"Dhruv Batra","startTime":315.84,"endTime":318.48,"body":"It's also true for builders"},{"speaker":"Dhruv Batra","startTime":315.84,"endTime":318.48,"body":"of technologies, builders"},{"speaker":"Dhruv Batra","startTime":318.48,"endTime":320.849,"body":"of products, and it's also"},{"speaker":"Dhruv Batra","startTime":318.48,"endTime":320.849,"body":"true for AI researchers."},{"speaker":"Dhruv Batra","startTime":320.849,"endTime":325.92,"body":"We, you know, it's not really"},{"speaker":"Dhruv Batra","startTime":320.849,"endTime":325.92,"body":"the credentials that matter,"},{"speaker":"Dhruv Batra","startTime":325.92,"endTime":328.77,"body":"but when you spend time"},{"speaker":"Dhruv Batra","startTime":325.92,"endTime":328.77,"body":"building this technology,"},{"speaker":"Dhruv Batra","startTime":328.8,"endTime":331.68,"body":"different researchers end up"},{"speaker":"Dhruv Batra","startTime":328.8,"endTime":331.68,"body":"building mental models of what"},{"speaker":"Dhruv Batra","startTime":331.68,"endTime":333.599,"body":"machines can do and cannot do."},{"speaker":"Dhruv Batra","startTime":333.99,"endTime":338.31,"body":"And in today's world, for"},{"speaker":"Dhruv Batra","startTime":333.99,"endTime":338.31,"body":"example, we joke about how we"},{"speaker":"Dhruv Batra","startTime":338.31,"endTime":342.235,"body":"have built chatbots that can"},{"speaker":"Dhruv Batra","startTime":338.31,"endTime":342.235,"body":"answer international math on PR"},{"speaker":"Dhruv Batra","startTime":342.235,"endTime":345.385,"body":"questions, yet simultaneously"},{"speaker":"Dhruv Batra","startTime":342.235,"endTime":345.385,"body":"they make mistakes like"},{"speaker":"Dhruv Batra","startTime":345.385,"endTime":349.585,"body":"saying 9.11 is greater than"},{"speaker":"Dhruv Batra","startTime":345.385,"endTime":349.585,"body":"9.9 that no human would do."},{"speaker":"Dhruv Batra","startTime":349.855,"endTime":353.585,"body":"But that just is a kind of"},{"speaker":"Dhruv Batra","startTime":349.855,"endTime":353.585,"body":"mistake that chatbots make."},{"speaker":"Dhruv Batra","startTime":354.094,"endTime":355.265,"body":"So where does that leave us?"},{"speaker":"Dhruv Batra","startTime":355.625,"endTime":356.795,"body":"First of all, why"},{"speaker":"Dhruv Batra","startTime":355.625,"endTime":356.795,"body":"does that happen?"},{"speaker":"Dhruv Batra","startTime":356.795,"endTime":357.36,"body":"Where does that leave us?"},{"speaker":"Dhruv Batra","startTime":357.955,"endTime":359.934,"body":"That happens for a"},{"speaker":"Dhruv Batra","startTime":357.955,"endTime":359.934,"body":"few different reasons."},{"speaker":"Dhruv Batra","startTime":360.054,"endTime":365.005,"body":"We are building intelligent"},{"speaker":"Dhruv Batra","startTime":360.054,"endTime":365.005,"body":"systems that are at a different"},{"speaker":"Dhruv Batra","startTime":365.005,"endTime":369.085,"body":"point in the intelligent"},{"speaker":"Dhruv Batra","startTime":365.005,"endTime":369.085,"body":"landscape and humans approach"},{"speaker":"Dhruv Batra","startTime":369.145,"endTime":372.955,"body":"intelligent systems with"},{"speaker":"Dhruv Batra","startTime":369.145,"endTime":372.955,"body":"their human understanding from"},{"speaker":"Dhruv Batra","startTime":372.955,"endTime":374.395,"body":"dealing with other humans."},{"speaker":"Dhruv Batra","startTime":374.664,"endTime":377.975,"body":"When I talk to a person,"},{"speaker":"Dhruv Batra","startTime":374.664,"endTime":377.975,"body":"they tell me that they"},{"speaker":"Dhruv Batra","startTime":377.975,"endTime":381.845,"body":"have gone to high school"},{"speaker":"Dhruv Batra","startTime":377.975,"endTime":381.845,"body":"or college or university"},{"speaker":"Dhruv Batra","startTime":382.175,"endTime":384.905,"body":"or have a PhD at different"},{"speaker":"Dhruv Batra","startTime":382.175,"endTime":384.905,"body":"spectrums of their expertise."},{"speaker":"Dhruv Batra","startTime":385.175,"endTime":387.665,"body":"I expect different"},{"speaker":"Dhruv Batra","startTime":385.175,"endTime":387.665,"body":"things from them."},{"speaker":"Dhruv Batra","startTime":387.725,"endTime":390.365,"body":"When someone says that they"},{"speaker":"Dhruv Batra","startTime":387.725,"endTime":390.365,"body":"have a PhD in chemistry, I"},{"speaker":"Dhruv Batra","startTime":390.365,"endTime":393.545,"body":"don't expect them to make a"},{"speaker":"Dhruv Batra","startTime":390.365,"endTime":393.545,"body":"mistake of the kind that, you"},{"speaker":"Dhruv Batra","startTime":393.545,"endTime":395.27,"body":"know, 9.11 is greater than 9.9."},{"speaker":"Dhruv Batra","startTime":395.27,"endTime":398.195,"body":"I just expect them to be"},{"speaker":"Dhruv Batra","startTime":395.27,"endTime":398.195,"body":"mathematically numerate,"},{"speaker":"Dhruv Batra","startTime":398.345,"endTime":400.565,"body":"generally well-informed"},{"speaker":"Dhruv Batra","startTime":398.345,"endTime":400.565,"body":"by the world and so on."},{"speaker":"Dhruv Batra","startTime":400.975,"endTime":404.545,"body":"Those expectations break down"},{"speaker":"Dhruv Batra","startTime":400.975,"endTime":404.545,"body":"when we are dealing with AI"},{"speaker":"Dhruv Batra","startTime":404.545,"endTime":408.355,"body":"systems and they break down"},{"speaker":"Dhruv Batra","startTime":404.545,"endTime":408.355,"body":"because we cannot rely on"},{"speaker":"Dhruv Batra","startTime":408.355,"endTime":410.035,"body":"the same shared assumptions."},{"speaker":"Dhruv Batra","startTime":410.425,"endTime":413.905,"body":"Performance on certain"},{"speaker":"Dhruv Batra","startTime":410.425,"endTime":413.905,"body":"tasks requires training"},{"speaker":"Dhruv Batra","startTime":413.905,"endTime":415.195,"body":"for those tasks."},{"speaker":"Dhruv Batra","startTime":415.525,"endTime":419.605,"body":"And even though we have built"},{"speaker":"Dhruv Batra","startTime":415.525,"endTime":419.605,"body":"general purpose systems now"},{"speaker":"Dhruv Batra","startTime":419.605,"endTime":422.785,"body":"over the last few years, there"},{"speaker":"Dhruv Batra","startTime":419.605,"endTime":422.785,"body":"is a very specific thing that"},{"speaker":"Dhruv Batra","startTime":422.785,"endTime":424.315,"body":"we mean when we say generality."},{"speaker":"Dhruv Batra","startTime":424.795,"endTime":427.195,"body":"And that makes it very"},{"speaker":"Dhruv Batra","startTime":424.795,"endTime":427.195,"body":"hard for consumers to"},{"speaker":"Dhruv Batra","startTime":427.255,"endTime":428.425,"body":"build mental models."},{"speaker":"Dhruv Batra","startTime":428.755,"endTime":432.025,"body":"And so there is this, perhaps"},{"speaker":"Dhruv Batra","startTime":428.755,"endTime":432.025,"body":"a frustrating experience where"},{"speaker":"Dhruv Batra","startTime":432.025,"endTime":433.315,"body":"people arrive at a product."},{"speaker":"Dhruv Batra","startTime":433.794,"endTime":436.044,"body":"It says it can do"},{"speaker":"Dhruv Batra","startTime":433.794,"endTime":436.044,"body":"a lot of things."},{"speaker":"Dhruv Batra","startTime":436.224,"endTime":439.465,"body":"You ask it to do the thing"},{"speaker":"Dhruv Batra","startTime":436.224,"endTime":439.465,"body":"that is listed on the website"},{"speaker":"Dhruv Batra","startTime":439.705,"endTime":441.804,"body":"from the manufacturer of"},{"speaker":"Dhruv Batra","startTime":439.705,"endTime":441.804,"body":"that product, and maybe it"},{"speaker":"Dhruv Batra","startTime":441.804,"endTime":444.505,"body":"does it, you ask it a slight"},{"speaker":"Dhruv Batra","startTime":441.804,"endTime":444.505,"body":"variation of that question"},{"speaker":"Dhruv Batra","startTime":444.505,"endTime":445.705,"body":"and it's unable to do it."},{"speaker":"Dhruv Batra","startTime":445.914,"endTime":447.655,"body":"And so that can be a"},{"speaker":"Dhruv Batra","startTime":445.914,"endTime":447.655,"body":"frustrating experience."},{"speaker":"Hannah Clark","startTime":448.075,"endTime":448.734,"body":"Absolutely."},{"speaker":"Hannah Clark","startTime":448.734,"endTime":448.945,"body":"Yeah."},{"speaker":"Hannah Clark","startTime":448.945,"endTime":451.974,"body":"And this is such a new"},{"speaker":"Hannah Clark","startTime":448.945,"endTime":451.974,"body":"consumer behavior as well,"},{"speaker":"Hannah Clark","startTime":451.974,"endTime":455.455,"body":"whereas, you know, we're"},{"speaker":"Hannah Clark","startTime":451.974,"endTime":455.455,"body":"kind of trained on features"},{"speaker":"Hannah Clark","startTime":455.455,"endTime":458.844,"body":"that are very specific, very"},{"speaker":"Hannah Clark","startTime":455.455,"endTime":458.844,"body":"intuitive, very easy to use."},{"speaker":"Hannah Clark","startTime":459.19,"endTime":463.03,"body":"So there's definitely this"},{"speaker":"Hannah Clark","startTime":459.19,"endTime":463.03,"body":"matter of people calling"},{"speaker":"Hannah Clark","startTime":463.03,"endTime":466.24,"body":"upon their existing training"},{"speaker":"Hannah Clark","startTime":463.03,"endTime":466.24,"body":"of interacting with chat or"},{"speaker":"Hannah Clark","startTime":466.24,"endTime":470.26,"body":"with another human being and"},{"speaker":"Hannah Clark","startTime":466.24,"endTime":470.26,"body":"applying those expectations"},{"speaker":"Hannah Clark","startTime":470.26,"endTime":472.99,"body":"to a feature that's kind"},{"speaker":"Hannah Clark","startTime":470.26,"endTime":472.99,"body":"of largely undefined."},{"speaker":"Hannah Clark","startTime":472.99,"endTime":476.29,"body":"We don't really quite grasp"},{"speaker":"Hannah Clark","startTime":472.99,"endTime":476.29,"body":"the limitations in different,"},{"speaker":"Hannah Clark","startTime":476.56,"endTime":477.73,"body":"you could say competencies."},{"speaker":"Hannah Clark","startTime":478.12,"endTime":481.81,"body":"So yeah, very complex technology"},{"speaker":"Hannah Clark","startTime":478.12,"endTime":481.81,"body":"that we all are kind of"},{"speaker":"Hannah Clark","startTime":481.93,"endTime":483.1,"body":"learning how to use together."},{"speaker":"Hannah Clark","startTime":483.7,"endTime":485.95,"body":"So when we think about"},{"speaker":"Hannah Clark","startTime":483.7,"endTime":485.95,"body":"everyday tasks that AI could"},{"speaker":"Hannah Clark","startTime":485.95,"endTime":488.74,"body":"automate, things like booking"},{"speaker":"Hannah Clark","startTime":485.95,"endTime":488.74,"body":"travel, managing schedules,"},{"speaker":"Hannah Clark","startTime":488.95,"endTime":491.65,"body":"those kinds of things, what"},{"speaker":"Hannah Clark","startTime":488.95,"endTime":491.65,"body":"makes tasks like that harder"},{"speaker":"Hannah Clark","startTime":491.65,"endTime":493.45,"body":"to solve than people assume?"},{"speaker":"Dhruv Batra","startTime":493.75,"endTime":496.66,"body":"So I'll use Yutori"},{"speaker":"Dhruv Batra","startTime":493.75,"endTime":496.66,"body":"and what we're building as"},{"speaker":"Dhruv Batra","startTime":496.66,"endTime":498.25,"body":"an example of these things."},{"speaker":"Dhruv Batra","startTime":498.76,"endTime":502.3,"body":"So at Yutori, we're building"},{"speaker":"Dhruv Batra","startTime":498.76,"endTime":502.3,"body":"personal assistance that"},{"speaker":"Dhruv Batra","startTime":502.3,"endTime":505.39,"body":"can automate mundane"},{"speaker":"Dhruv Batra","startTime":502.3,"endTime":505.39,"body":"workflows on the web."},{"speaker":"Dhruv Batra","startTime":506.02,"endTime":507.85,"body":"Our first product"},{"speaker":"Dhruv Batra","startTime":506.02,"endTime":507.85,"body":"is called Scouts."},{"speaker":"Dhruv Batra","startTime":507.909,"endTime":510.49,"body":"It's a team of agents"},{"speaker":"Dhruv Batra","startTime":507.909,"endTime":510.49,"body":"that monitor anything"},{"speaker":"Dhruv Batra","startTime":510.49,"endTime":511.33,"body":"on the web for you."},{"speaker":"Dhruv Batra","startTime":511.749,"endTime":515.41,"body":"And it was extremely important"},{"speaker":"Dhruv Batra","startTime":511.749,"endTime":515.41,"body":"to us that we clearly state"},{"speaker":"Dhruv Batra","startTime":515.41,"endTime":519.789,"body":"this expectation that, you"},{"speaker":"Dhruv Batra","startTime":515.41,"endTime":519.789,"body":"know, this product monitors"},{"speaker":"Dhruv Batra","startTime":519.789,"endTime":520.75,"body":"a piece of information."},{"speaker":"Dhruv Batra","startTime":520.75,"endTime":524.319,"body":"You cannot ask it to book"},{"speaker":"Dhruv Batra","startTime":520.75,"endTime":524.319,"body":"anything, buy something for you."},{"speaker":"Dhruv Batra","startTime":524.325,"endTime":526.089,"body":"It'll not create slides for you."},{"speaker":"Dhruv Batra","startTime":526.089,"endTime":527.5,"body":"It will not do your homework."},{"speaker":"Dhruv Batra","startTime":527.5,"endTime":529.15,"body":"It will, you know, not"},{"speaker":"Dhruv Batra","startTime":527.5,"endTime":529.15,"body":"write code for you."},{"speaker":"Dhruv Batra","startTime":529.685,"endTime":532.835,"body":"It's not everything that"},{"speaker":"Dhruv Batra","startTime":529.685,"endTime":532.835,"body":"you can do on a browser, but"},{"speaker":"Dhruv Batra","startTime":532.835,"endTime":536.765,"body":"what it can do for individual"},{"speaker":"Dhruv Batra","startTime":532.835,"endTime":536.765,"body":"consumers is let me know when my"},{"speaker":"Dhruv Batra","startTime":536.765,"endTime":538.325,"body":"favorite artist comes into town."},{"speaker":"Dhruv Batra","startTime":538.355,"endTime":540.365,"body":"They might announce it on"},{"speaker":"Dhruv Batra","startTime":538.355,"endTime":540.365,"body":"a few different websites."},{"speaker":"Dhruv Batra","startTime":540.395,"endTime":543.305,"body":"I might go to those"},{"speaker":"Dhruv Batra","startTime":540.395,"endTime":543.305,"body":"websites at some frequency."},{"speaker":"Dhruv Batra","startTime":543.305,"endTime":545.255,"body":"I would just like you to"},{"speaker":"Dhruv Batra","startTime":543.305,"endTime":545.255,"body":"check it up, that frequency."},{"speaker":"Dhruv Batra","startTime":545.675,"endTime":548.135,"body":"You know, maybe I'm looking"},{"speaker":"Dhruv Batra","startTime":545.675,"endTime":548.135,"body":"for reservations for something"},{"speaker":"Dhruv Batra","startTime":548.135,"endTime":550.625,"body":"that requires filling"},{"speaker":"Dhruv Batra","startTime":548.135,"endTime":550.625,"body":"some lightweight form on a"},{"speaker":"Dhruv Batra","startTime":550.625,"endTime":552.365,"body":"browser, clicking buttons."},{"speaker":"Dhruv Batra","startTime":552.365,"endTime":554.765,"body":"I would like this agent to do"},{"speaker":"Dhruv Batra","startTime":552.365,"endTime":554.765,"body":"that for me, and then tell me"},{"speaker":"Dhruv Batra","startTime":554.765,"endTime":556.055,"body":"what information is available."},{"speaker":"Dhruv Batra","startTime":556.505,"endTime":561.369,"body":"Maybe I'm, i'm a recruiter and"},{"speaker":"Dhruv Batra","startTime":556.505,"endTime":561.369,"body":"I'm tracking changing roles by"},{"speaker":"Dhruv Batra","startTime":561.369,"endTime":564.22,"body":"a particular set of people, and"},{"speaker":"Dhruv Batra","startTime":561.369,"endTime":564.22,"body":"if they announce it on X versus"},{"speaker":"Dhruv Batra","startTime":564.22,"endTime":567.01,"body":"LinkedIn versus their blog post,"},{"speaker":"Dhruv Batra","startTime":564.22,"endTime":567.01,"body":"let me know when that happens."},{"speaker":"Dhruv Batra","startTime":567.46,"endTime":568.99,"body":"So why is this hard?"},{"speaker":"Dhruv Batra","startTime":569.605,"endTime":571.194,"body":"This seems like a trivial thing."},{"speaker":"Dhruv Batra","startTime":571.405,"endTime":573.865,"body":"Humans sit down, open their"},{"speaker":"Dhruv Batra","startTime":571.405,"endTime":573.865,"body":"browser, go to a particular"},{"speaker":"Dhruv Batra","startTime":573.865,"endTime":575.275,"body":"page, fill out certain things."},{"speaker":"Dhruv Batra","startTime":575.515,"endTime":576.265,"body":"Why is this hard?"},{"speaker":"Dhruv Batra","startTime":576.595,"endTime":580.165,"body":"Fundamentally, these problems"},{"speaker":"Dhruv Batra","startTime":576.595,"endTime":580.165,"body":"are hard because they are"},{"speaker":"Dhruv Batra","startTime":580.194,"endTime":582.685,"body":"what are known as sequential"},{"speaker":"Dhruv Batra","startTime":580.194,"endTime":582.685,"body":"decision making problems."},{"speaker":"Dhruv Batra","startTime":583.015,"endTime":586.225,"body":"You are in a particular state,"},{"speaker":"Dhruv Batra","startTime":583.015,"endTime":586.225,"body":"maybe you're on a webpage."},{"speaker":"Dhruv Batra","startTime":586.315,"endTime":588.865,"body":"You have to take up few"},{"speaker":"Dhruv Batra","startTime":586.315,"endTime":588.865,"body":"different actions you have,"},{"speaker":"Dhruv Batra","startTime":589.045,"endTime":591.655,"body":"you know, websites are laid"},{"speaker":"Dhruv Batra","startTime":589.045,"endTime":591.655,"body":"out for human consumption."},{"speaker":"Dhruv Batra","startTime":591.985,"endTime":597.129,"body":"Reading code on HTML, it's"},{"speaker":"Dhruv Batra","startTime":591.985,"endTime":597.129,"body":"wildly inconsistent about how"},{"speaker":"Dhruv Batra","startTime":597.129,"endTime":600.97,"body":"buttons are annotated or labeled"},{"speaker":"Dhruv Batra","startTime":597.129,"endTime":600.97,"body":"on webpages across websites."},{"speaker":"Dhruv Batra","startTime":601.329,"endTime":603.639,"body":"And so fundamentally, this"},{"speaker":"Dhruv Batra","startTime":601.329,"endTime":603.639,"body":"is a perception problem."},{"speaker":"Dhruv Batra","startTime":604.089,"endTime":606.55,"body":"You have to click a button,"},{"speaker":"Dhruv Batra","startTime":604.089,"endTime":606.55,"body":"then something happens."},{"speaker":"Dhruv Batra","startTime":606.579,"endTime":608.74,"body":"You maybe scroll the"},{"speaker":"Dhruv Batra","startTime":606.579,"endTime":608.74,"body":"page, fill out something,"},{"speaker":"Dhruv Batra","startTime":608.859,"endTime":609.639,"body":"something happens."},{"speaker":"Dhruv Batra","startTime":610.03,"endTime":612.79,"body":"Any mistake that you make"},{"speaker":"Dhruv Batra","startTime":610.03,"endTime":612.79,"body":"along the way, simply"},{"speaker":"Dhruv Batra","startTime":612.79,"endTime":617.589,"body":"cascades and earlier mistakes"},{"speaker":"Dhruv Batra","startTime":612.79,"endTime":617.589,"body":"lead to later failures."},{"speaker":"Dhruv Batra","startTime":618.325,"endTime":620.755,"body":"This is a similar"},{"speaker":"Dhruv Batra","startTime":618.325,"endTime":620.755,"body":"kind of problem that"},{"speaker":"Dhruv Batra","startTime":620.815,"endTime":623.425,"body":"robotics and self-driving"},{"speaker":"Dhruv Batra","startTime":620.815,"endTime":623.425,"body":"industry dealt with."},{"speaker":"Dhruv Batra","startTime":623.785,"endTime":627.535,"body":"We realize that if robots"},{"speaker":"Dhruv Batra","startTime":623.785,"endTime":627.535,"body":"make a mistake, those mistakes"},{"speaker":"Dhruv Batra","startTime":627.535,"endTime":628.795,"body":"cascade on themselves."},{"speaker":"Dhruv Batra","startTime":629.125,"endTime":631.315,"body":"If you're slightly"},{"speaker":"Dhruv Batra","startTime":629.125,"endTime":631.315,"body":"deviating from a lane,"},{"speaker":"Dhruv Batra","startTime":631.555,"endTime":633.775,"body":"now you are no longer at"},{"speaker":"Dhruv Batra","startTime":631.555,"endTime":633.775,"body":"the center of the lane."},{"speaker":"Dhruv Batra","startTime":633.775,"endTime":634.194,"body":"You have to."},{"speaker":"Dhruv Batra","startTime":634.55,"endTime":635.96,"body":"I have a course"},{"speaker":"Dhruv Batra","startTime":634.55,"endTime":635.96,"body":"correction maneuver."},{"speaker":"Dhruv Batra","startTime":636.26,"endTime":639.53,"body":"Similarly, browser automation"},{"speaker":"Dhruv Batra","startTime":636.26,"endTime":639.53,"body":"agents that we are building,"},{"speaker":"Dhruv Batra","startTime":639.589,"endTime":642.05,"body":"if you have ended up in a"},{"speaker":"Dhruv Batra","startTime":639.589,"endTime":642.05,"body":"part of a webpage that is"},{"speaker":"Dhruv Batra","startTime":642.05,"endTime":644.15,"body":"either hung or is you're not"},{"speaker":"Dhruv Batra","startTime":642.05,"endTime":644.15,"body":"supposed to be there, you're"},{"speaker":"Dhruv Batra","startTime":644.15,"endTime":645.44,"body":"not gonna find that response."},{"speaker":"Dhruv Batra","startTime":645.74,"endTime":647.96,"body":"So there's an error"},{"speaker":"Dhruv Batra","startTime":645.74,"endTime":647.96,"body":"recovery that you have"},{"speaker":"Dhruv Batra","startTime":647.96,"endTime":650.36,"body":"to learn when you're"},{"speaker":"Dhruv Batra","startTime":647.96,"endTime":650.36,"body":"operating out in the wild."},{"speaker":"Dhruv Batra","startTime":650.875,"endTime":654.385,"body":"There are also read only"},{"speaker":"Dhruv Batra","startTime":650.875,"endTime":654.385,"body":"tasks versus write tasks."},{"speaker":"Dhruv Batra","startTime":654.474,"endTime":659.185,"body":"If you fill out a form and you"},{"speaker":"Dhruv Batra","startTime":654.474,"endTime":659.185,"body":"click submit, some websites"},{"speaker":"Dhruv Batra","startTime":659.185,"endTime":662.185,"body":"will not let you go back to"},{"speaker":"Dhruv Batra","startTime":659.185,"endTime":662.185,"body":"fill it out again, which means"},{"speaker":"Dhruv Batra","startTime":662.185,"endTime":665.125,"body":"that's an irre recoverable"},{"speaker":"Dhruv Batra","startTime":662.185,"endTime":665.125,"body":"mistake that you have made."},{"speaker":"Dhruv Batra","startTime":665.53,"endTime":669.28,"body":"Training for irre recoverable"},{"speaker":"Dhruv Batra","startTime":665.53,"endTime":669.28,"body":"mistakes is difficult, and"},{"speaker":"Dhruv Batra","startTime":669.55,"endTime":672.67,"body":"for that you have to create"},{"speaker":"Dhruv Batra","startTime":669.55,"endTime":672.67,"body":"replicas of the real world."},{"speaker":"Dhruv Batra","startTime":672.76,"endTime":675.04,"body":"This is what roboticists"},{"speaker":"Dhruv Batra","startTime":672.76,"endTime":675.04,"body":"deal with creating 3D"},{"speaker":"Dhruv Batra","startTime":675.04,"endTime":678.729,"body":"simulators of the world,"},{"speaker":"Dhruv Batra","startTime":675.04,"endTime":678.729,"body":"almost like virtual gameplay,"},{"speaker":"Dhruv Batra","startTime":678.969,"endTime":681.31,"body":"training virtual robots and"},{"speaker":"Dhruv Batra","startTime":678.969,"endTime":681.31,"body":"simulation, then deploying"},{"speaker":"Dhruv Batra","startTime":681.31,"endTime":682.12,"body":"them in the real world."},{"speaker":"Dhruv Batra","startTime":682.479,"endTime":684.734,"body":"This is what we do with browser"},{"speaker":"Dhruv Batra","startTime":682.479,"endTime":684.734,"body":"automation agents as well."},{"speaker":"Dhruv Batra","startTime":685.39,"endTime":688.99,"body":"When we have to train them"},{"speaker":"Dhruv Batra","startTime":685.39,"endTime":688.99,"body":"to fill out a form and click"},{"speaker":"Dhruv Batra","startTime":688.99,"endTime":691.93,"body":"submit, or maybe buy something"},{"speaker":"Dhruv Batra","startTime":688.99,"endTime":691.93,"body":"on the web, those are going"},{"speaker":"Dhruv Batra","startTime":691.93,"endTime":694.96,"body":"to be irre recoverable"},{"speaker":"Dhruv Batra","startTime":691.93,"endTime":694.96,"body":"errors if you make them."},{"speaker":"Dhruv Batra","startTime":694.99,"endTime":696.685,"body":"So you have to"},{"speaker":"Dhruv Batra","startTime":694.99,"endTime":696.685,"body":"train in simulation."},{"speaker":"Dhruv Batra","startTime":697.225,"endTime":700.705,"body":"Those are some of the things"},{"speaker":"Dhruv Batra","startTime":697.225,"endTime":700.705,"body":"that cause these problems to"},{"speaker":"Dhruv Batra","startTime":700.705,"endTime":704.175,"body":"be difficult, and it's often"},{"speaker":"Dhruv Batra","startTime":700.705,"endTime":704.175,"body":"difficult to know or to know"},{"speaker":"Dhruv Batra","startTime":704.175,"endTime":708.555,"body":"what you did along the way as"},{"speaker":"Dhruv Batra","startTime":704.175,"endTime":708.555,"body":"an AI agent that contributed"},{"speaker":"Dhruv Batra","startTime":708.555,"endTime":710.835,"body":"to your success or failures,"},{"speaker":"Dhruv Batra","startTime":708.555,"endTime":710.835,"body":"and that's known as the"},{"speaker":"Dhruv Batra","startTime":710.865,"endTime":711.915,"body":"credit assignment problem."},{"speaker":"Hannah Clark","startTime":712.469,"endTime":714.959,"body":"All of these"},{"speaker":"Hannah Clark","startTime":712.469,"endTime":714.959,"body":"things that as humans, you"},{"speaker":"Hannah Clark","startTime":714.959,"endTime":717.81,"body":"know, at this point we're"},{"speaker":"Hannah Clark","startTime":714.959,"endTime":717.81,"body":"also well trained to do"},{"speaker":"Hannah Clark","startTime":717.839,"endTime":719.369,"body":"some of these procedures."},{"speaker":"Hannah Clark","startTime":719.369,"endTime":723.569,"body":"It seems like a simple task,"},{"speaker":"Hannah Clark","startTime":719.369,"endTime":723.569,"body":"but on a technical level, we're"},{"speaker":"Hannah Clark","startTime":723.569,"endTime":725.009,"body":"looking at a much more complex."},{"speaker":"Hannah Clark","startTime":725.039,"endTime":726.93,"body":"I know that doesn't"},{"speaker":"Hannah Clark","startTime":725.039,"endTime":726.93,"body":"even take into account"},{"speaker":"Hannah Clark","startTime":726.93,"endTime":728.159,"body":"things like preferences."},{"speaker":"Hannah Clark","startTime":728.159,"endTime":730.979,"body":"You know, what time, where"},{"speaker":"Hannah Clark","startTime":728.159,"endTime":730.979,"body":"in the restaurant do you"},{"speaker":"Hannah Clark","startTime":730.979,"endTime":731.849,"body":"wanna sit at the bar?"},{"speaker":"Hannah Clark","startTime":731.849,"endTime":734.909,"body":"You know, there's all these"},{"speaker":"Hannah Clark","startTime":731.849,"endTime":734.909,"body":"other kinds of matters that I"},{"speaker":"Hannah Clark","startTime":734.909,"endTime":737.639,"body":"can imagine are just impossible"},{"speaker":"Hannah Clark","startTime":734.909,"endTime":737.639,"body":"to do from a coding perspective."},{"speaker":"Dhruv Batra","startTime":737.999,"endTime":740.16,"body":"Here's a small"},{"speaker":"Dhruv Batra","startTime":737.999,"endTime":740.16,"body":"example I'll give that,"},{"speaker":"Dhruv Batra","startTime":740.16,"endTime":741.089,"body":"that communicates this."},{"speaker":"Dhruv Batra","startTime":741.42,"endTime":745.56,"body":"Humans are used to"},{"speaker":"Dhruv Batra","startTime":741.42,"endTime":745.56,"body":"certain design patterns."},{"speaker":"Dhruv Batra","startTime":745.589,"endTime":747.42,"body":"For example, when you go on"},{"speaker":"Dhruv Batra","startTime":745.589,"endTime":747.42,"body":"a webpage and maybe you're"},{"speaker":"Dhruv Batra","startTime":747.42,"endTime":751.469,"body":"trying to book a reservation"},{"speaker":"Dhruv Batra","startTime":747.42,"endTime":751.469,"body":"or book an appointment, there's"},{"speaker":"Dhruv Batra","startTime":751.469,"endTime":754.92,"body":"a common design pattern that"},{"speaker":"Dhruv Batra","startTime":751.469,"endTime":754.92,"body":"if a date or a time slot is"},{"speaker":"Dhruv Batra","startTime":754.949,"endTime":759.42,"body":"grayed out or has been struck"},{"speaker":"Dhruv Batra","startTime":754.949,"endTime":759.42,"body":"through, you understand that"},{"speaker":"Dhruv Batra","startTime":759.42,"endTime":762.629,"body":"it is not available, even"},{"speaker":"Dhruv Batra","startTime":759.42,"endTime":762.629,"body":"though there is no text above"},{"speaker":"Dhruv Batra","startTime":762.629,"endTime":765.66,"body":"it or around it saying that"},{"speaker":"Dhruv Batra","startTime":762.629,"endTime":765.66,"body":"this slot is not available."},{"speaker":"Dhruv Batra","startTime":766.199,"endTime":768.39,"body":"You understand it because"},{"speaker":"Dhruv Batra","startTime":766.199,"endTime":768.39,"body":"you've been exposed to that"},{"speaker":"Dhruv Batra","startTime":768.39,"endTime":772.41,"body":"design pattern on websites"},{"speaker":"Dhruv Batra","startTime":768.39,"endTime":772.41,"body":"that you have seen or in"},{"speaker":"Dhruv Batra","startTime":772.5,"endTime":776.25,"body":"various pieces of writing that"},{"speaker":"Dhruv Batra","startTime":772.5,"endTime":776.25,"body":"you've seen across the things."},{"speaker":"Dhruv Batra","startTime":776.624,"endTime":778.275,"body":"How do machines understand this?"},{"speaker":"Dhruv Batra","startTime":778.545,"endTime":781.604,"body":"Well, they may have read a"},{"speaker":"Dhruv Batra","startTime":778.545,"endTime":781.604,"body":"lot of books, but you have"},{"speaker":"Dhruv Batra","startTime":781.604,"endTime":784.515,"body":"to interact with websites"},{"speaker":"Dhruv Batra","startTime":781.604,"endTime":784.515,"body":"to understand that grade"},{"speaker":"Dhruv Batra","startTime":784.515,"endTime":786.134,"body":"out text means something."},{"speaker":"Dhruv Batra","startTime":786.494,"endTime":790.665,"body":"And this is just one example"},{"speaker":"Dhruv Batra","startTime":786.494,"endTime":790.665,"body":"of the kinds of design"},{"speaker":"Dhruv Batra","startTime":790.665,"endTime":793.094,"body":"patterns that are meant"},{"speaker":"Dhruv Batra","startTime":790.665,"endTime":793.094,"body":"for human consumption that"},{"speaker":"Dhruv Batra","startTime":793.094,"endTime":794.265,"body":"machines have to absorb."},{"speaker":"Dhruv Batra","startTime":794.265,"endTime":796.545,"body":"That clicking on this"},{"speaker":"Dhruv Batra","startTime":794.265,"endTime":796.545,"body":"button will not do anything,"},{"speaker":"Dhruv Batra","startTime":796.545,"endTime":798.285,"body":"and there's no text"},{"speaker":"Dhruv Batra","startTime":796.545,"endTime":798.285,"body":"describing its purpose."},{"speaker":"Dhruv Batra","startTime":798.285,"endTime":799.724,"body":"You just have to"},{"speaker":"Dhruv Batra","startTime":798.285,"endTime":799.724,"body":"know what this means."},{"speaker":"Hannah Clark","startTime":800.395,"endTime":801.385,"body":"This"},{"speaker":"Hannah Clark","startTime":800.395,"endTime":801.385,"body":"is so interesting."},{"speaker":"Hannah Clark","startTime":801.385,"endTime":803.905,"body":"This reminds me of a"},{"speaker":"Hannah Clark","startTime":801.385,"endTime":803.905,"body":"conversation way back"},{"speaker":"Hannah Clark","startTime":803.905,"endTime":806.11,"body":"with Nimrod Priell, who's"},{"speaker":"Hannah Clark","startTime":803.905,"endTime":806.11,"body":"the Founder of Cord."},{"speaker":"Hannah Clark","startTime":806.35,"endTime":809.38,"body":"When we talked about the"},{"speaker":"Hannah Clark","startTime":806.35,"endTime":809.38,"body":"evolution of user behavior"},{"speaker":"Hannah Clark","startTime":809.38,"endTime":812.74,"body":"and how these incremental"},{"speaker":"Hannah Clark","startTime":809.38,"endTime":812.74,"body":"changes and how we understand"},{"speaker":"Hannah Clark","startTime":812.89,"endTime":816.58,"body":"UX elements and just the"},{"speaker":"Hannah Clark","startTime":812.89,"endTime":816.58,"body":"general layout and design of"},{"speaker":"Hannah Clark","startTime":816.61,"endTime":819.7,"body":"websites and technology over"},{"speaker":"Hannah Clark","startTime":816.61,"endTime":819.7,"body":"the years is kind of this"},{"speaker":"Hannah Clark","startTime":819.7,"endTime":822.64,"body":"compounding asset that all of"},{"speaker":"Hannah Clark","startTime":819.7,"endTime":822.64,"body":"us really take for granted."},{"speaker":"Hannah Clark","startTime":822.91,"endTime":825.34,"body":"And this is something that's"},{"speaker":"Hannah Clark","startTime":822.91,"endTime":825.34,"body":"very difficult for us."},{"speaker":"Hannah Clark","startTime":825.34,"endTime":827.32,"body":"It's kind of a shared language"},{"speaker":"Hannah Clark","startTime":825.34,"endTime":827.32,"body":"at this point that we've kind"},{"speaker":"Hannah Clark","startTime":827.32,"endTime":830.75,"body":"of shared over many years"},{"speaker":"Hannah Clark","startTime":827.32,"endTime":830.75,"body":"of technology progression."},{"speaker":"Hannah Clark","startTime":830.93,"endTime":833.78,"body":"It's very difficult to"},{"speaker":"Hannah Clark","startTime":830.93,"endTime":833.78,"body":"communicate to a machine."},{"speaker":"Hannah Clark","startTime":834.05,"endTime":836.18,"body":"So I just think this is such"},{"speaker":"Hannah Clark","startTime":834.05,"endTime":836.18,"body":"a fascinating area and I wanna"},{"speaker":"Hannah Clark","startTime":836.18,"endTime":839.27,"body":"dig a little bit deeper into the"},{"speaker":"Hannah Clark","startTime":836.18,"endTime":839.27,"body":"consumer behavior side as well."},{"speaker":"Hannah Clark","startTime":839.48,"endTime":842.54,"body":"So as an extension of some"},{"speaker":"Hannah Clark","startTime":839.48,"endTime":842.54,"body":"of these kinds of behaviors"},{"speaker":"Hannah Clark","startTime":842.54,"endTime":845.06,"body":"and patterns that we've kind"},{"speaker":"Hannah Clark","startTime":842.54,"endTime":845.06,"body":"of internalized over time."},{"speaker":"Hannah Clark","startTime":845.455,"endTime":846.745,"body":"Now this is an ongoing process."},{"speaker":"Hannah Clark","startTime":846.745,"endTime":848.935,"body":"So what are some of the"},{"speaker":"Hannah Clark","startTime":846.745,"endTime":848.935,"body":"shifts in how people interact"},{"speaker":"Hannah Clark","startTime":848.935,"endTime":851.335,"body":"with technology that product"},{"speaker":"Hannah Clark","startTime":848.935,"endTime":851.335,"body":"leaders should be preparing"},{"speaker":"Hannah Clark","startTime":851.335,"endTime":852.13,"body":"for in the near future?"},{"speaker":"Dhruv Batra","startTime":852.895,"endTime":857.305,"body":"The emergence of"},{"speaker":"Dhruv Batra","startTime":852.895,"endTime":857.305,"body":"AI products on the consumer"},{"speaker":"Dhruv Batra","startTime":857.305,"endTime":861.055,"body":"market has certainly shifted"},{"speaker":"Dhruv Batra","startTime":857.305,"endTime":861.055,"body":"people's expectations."},{"speaker":"Dhruv Batra","startTime":861.385,"endTime":864.145,"body":"There are now children growing"},{"speaker":"Dhruv Batra","startTime":861.385,"endTime":864.145,"body":"up who will just expect to"},{"speaker":"Dhruv Batra","startTime":864.145,"endTime":865.405,"body":"be able to talk to machines."},{"speaker":"Dhruv Batra","startTime":865.735,"endTime":867.745,"body":"There's always this future"},{"speaker":"Dhruv Batra","startTime":865.735,"endTime":867.745,"body":"drama episode or you know,"},{"speaker":"Dhruv Batra","startTime":867.745,"endTime":870.355,"body":"science fiction thing that"},{"speaker":"Dhruv Batra","startTime":867.745,"endTime":870.355,"body":"children growing up in"},{"speaker":"Dhruv Batra","startTime":870.715,"endTime":872.785,"body":"technologically advanced"},{"speaker":"Dhruv Batra","startTime":870.715,"endTime":872.785,"body":"civilizations, if they're"},{"speaker":"Dhruv Batra","startTime":872.785,"endTime":875.005,"body":"exposed to an older technology."},{"speaker":"Dhruv Batra","startTime":875.305,"endTime":877.285,"body":"Wonder, why can't"},{"speaker":"Dhruv Batra","startTime":875.305,"endTime":877.285,"body":"I talk to my tv?"},{"speaker":"Dhruv Batra","startTime":877.285,"endTime":878.695,"body":"Like, why is this"},{"speaker":"Dhruv Batra","startTime":877.285,"endTime":878.695,"body":"not understanding me?"},{"speaker":"Dhruv Batra","startTime":878.965,"endTime":881.485,"body":"I think we're seeing that"},{"speaker":"Dhruv Batra","startTime":878.965,"endTime":881.485,"body":"shift in expectations"},{"speaker":"Dhruv Batra","startTime":881.485,"endTime":883.075,"body":"from consumer behaviors"},{"speaker":"Dhruv Batra","startTime":881.485,"endTime":883.075,"body":"as well, that you just."},{"speaker":"Dhruv Batra","startTime":884.185,"endTime":887.125,"body":"You feel like you want to be"},{"speaker":"Dhruv Batra","startTime":884.185,"endTime":887.125,"body":"able to express yourself, you"},{"speaker":"Dhruv Batra","startTime":887.125,"endTime":890.545,"body":"feel like I should just be"},{"speaker":"Dhruv Batra","startTime":887.125,"endTime":890.545,"body":"able to talk to the machine."},{"speaker":"Dhruv Batra","startTime":890.545,"endTime":892.795,"body":"It should have a certain"},{"speaker":"Dhruv Batra","startTime":890.545,"endTime":892.795,"body":"general purpose capabilities."},{"speaker":"Dhruv Batra","startTime":892.795,"endTime":894.745,"body":"It should be able to"},{"speaker":"Dhruv Batra","startTime":892.795,"endTime":894.745,"body":"hold a coherent dialogue."},{"speaker":"Dhruv Batra","startTime":895.015,"endTime":898.945,"body":"It should understand my usage"},{"speaker":"Dhruv Batra","startTime":895.015,"endTime":898.945,"body":"patterns, and that's kind of"},{"speaker":"Dhruv Batra","startTime":898.945,"endTime":902.805,"body":"what motivated our work and"},{"speaker":"Dhruv Batra","startTime":898.945,"endTime":902.805,"body":"vision at tutorial as well."},{"speaker":"Dhruv Batra","startTime":903.295,"endTime":907.135,"body":"We see the evolution of the web"},{"speaker":"Dhruv Batra","startTime":903.295,"endTime":907.135,"body":"in the last 30 years as just"},{"speaker":"Dhruv Batra","startTime":907.195,"endTime":912.835,"body":"incremental advancements over"},{"speaker":"Dhruv Batra","startTime":907.195,"endTime":912.835,"body":"a core technology of connecting"},{"speaker":"Dhruv Batra","startTime":912.895,"endTime":914.935,"body":"content and services to humans."},{"speaker":"Dhruv Batra","startTime":915.175,"endTime":918.385,"body":"The web is primarily laid for"},{"speaker":"Dhruv Batra","startTime":915.175,"endTime":918.385,"body":"human consumption, and that"},{"speaker":"Dhruv Batra","startTime":918.385,"endTime":921.065,"body":"has been because it has just"},{"speaker":"Dhruv Batra","startTime":918.385,"endTime":921.065,"body":"been human eyeballs on the web."},{"speaker":"Dhruv Batra","startTime":921.705,"endTime":924.705,"body":"Now people just expect to"},{"speaker":"Dhruv Batra","startTime":921.705,"endTime":924.705,"body":"be able to tell the machines"},{"speaker":"Dhruv Batra","startTime":924.705,"endTime":926.985,"body":"what they want the machine"},{"speaker":"Dhruv Batra","startTime":924.705,"endTime":926.985,"body":"to do on their computer"},{"speaker":"Dhruv Batra","startTime":926.985,"endTime":927.885,"body":"and on their browser."},{"speaker":"Dhruv Batra","startTime":928.125,"endTime":932.295,"body":"Why should I as a person,"},{"speaker":"Dhruv Batra","startTime":928.125,"endTime":932.295,"body":"sit down, click buttons,"},{"speaker":"Dhruv Batra","startTime":932.475,"endTime":936.675,"body":"fill out my name, my address,"},{"speaker":"Dhruv Batra","startTime":932.475,"endTime":936.675,"body":"credit card details in"},{"speaker":"Dhruv Batra","startTime":936.675,"endTime":939.045,"body":"order to buy something or"},{"speaker":"Dhruv Batra","startTime":936.675,"endTime":939.045,"body":"to procure some information?"},{"speaker":"Dhruv Batra","startTime":939.45,"endTime":942.96,"body":"This should be something that"},{"speaker":"Dhruv Batra","startTime":939.45,"endTime":942.96,"body":"should be automatable, and I"},{"speaker":"Dhruv Batra","startTime":942.96,"endTime":943.89,"body":"think that's what we're seeing."},{"speaker":"Dhruv Batra","startTime":943.95,"endTime":945.9,"body":"Seeing as a shift in"},{"speaker":"Dhruv Batra","startTime":943.95,"endTime":945.9,"body":"consumer behavior."},{"speaker":"Dhruv Batra","startTime":946.26,"endTime":951.96,"body":"This idea that I should have"},{"speaker":"Dhruv Batra","startTime":946.26,"endTime":951.96,"body":"30 tabs open to search for this"},{"speaker":"Dhruv Batra","startTime":951.96,"endTime":953.76,"body":"one item that I'm looking for."},{"speaker":"Dhruv Batra","startTime":953.76,"endTime":956.04,"body":"Read 20 different"},{"speaker":"Dhruv Batra","startTime":953.76,"endTime":956.04,"body":"reviews already."},{"speaker":"Dhruv Batra","startTime":956.04,"endTime":959.845,"body":"People just want to ask"},{"speaker":"Dhruv Batra","startTime":956.04,"endTime":959.845,"body":"a. Deep research system"},{"speaker":"Dhruv Batra","startTime":959.905,"endTime":961.165,"body":"or a monitoring system."},{"speaker":"Dhruv Batra","startTime":961.165,"endTime":963.085,"body":"Why don't you let me"},{"speaker":"Dhruv Batra","startTime":961.165,"endTime":963.085,"body":"know when this happens?"},{"speaker":"Dhruv Batra","startTime":963.295,"endTime":966.265,"body":"The next step after that"},{"speaker":"Dhruv Batra","startTime":963.295,"endTime":966.265,"body":"is, okay, if you have told"},{"speaker":"Dhruv Batra","startTime":966.265,"endTime":968.455,"body":"me that this my favorite"},{"speaker":"Dhruv Batra","startTime":966.265,"endTime":968.455,"body":"artist is coming into town"},{"speaker":"Dhruv Batra","startTime":968.455,"endTime":970.615,"body":"and they're performing this"},{"speaker":"Dhruv Batra","startTime":968.455,"endTime":970.615,"body":"on Friday, why don't you go"},{"speaker":"Dhruv Batra","startTime":970.615,"endTime":973.285,"body":"ahead and buy the tickets for"},{"speaker":"Dhruv Batra","startTime":970.615,"endTime":973.285,"body":"me while am I sitting there?"},{"speaker":"Dhruv Batra","startTime":973.835,"endTime":975.725,"body":"Mucking through"},{"speaker":"Dhruv Batra","startTime":973.835,"endTime":975.725,"body":"forms and things."},{"speaker":"Dhruv Batra","startTime":976.055,"endTime":979.415,"body":"I think the shift in consumer"},{"speaker":"Dhruv Batra","startTime":976.055,"endTime":979.415,"body":"expectations is moving up a"},{"speaker":"Dhruv Batra","startTime":979.415,"endTime":984.755,"body":"level in abstraction, talking"},{"speaker":"Dhruv Batra","startTime":979.415,"endTime":984.755,"body":"to software, expecting software"},{"speaker":"Dhruv Batra","startTime":984.755,"endTime":989.735,"body":"to automate the mundane pieces"},{"speaker":"Dhruv Batra","startTime":984.755,"endTime":989.735,"body":"of their lives, and it almost"},{"speaker":"Dhruv Batra","startTime":989.735,"endTime":995.165,"body":"sort of becomes a task list with"},{"speaker":"Dhruv Batra","startTime":989.735,"endTime":995.165,"body":"superpowers, and I think there"},{"speaker":"Dhruv Batra","startTime":995.165,"endTime":996.965,"body":"will be a notion of proactivity."},{"speaker":"Dhruv Batra","startTime":997.235,"endTime":1001.375,"body":"We don't want to sit down and"},{"speaker":"Dhruv Batra","startTime":997.235,"endTime":1001.375,"body":"explain every single time."},{"speaker":"Dhruv Batra","startTime":1001.835,"endTime":1004.475,"body":"Here is who I am, here is"},{"speaker":"Dhruv Batra","startTime":1001.835,"endTime":1004.475,"body":"what my preferences are."},{"speaker":"Dhruv Batra","startTime":1004.565,"endTime":1006.185,"body":"You know, there's"},{"speaker":"Dhruv Batra","startTime":1004.565,"endTime":1006.185,"body":"a notion of memory."},{"speaker":"Dhruv Batra","startTime":1006.425,"endTime":1009.785,"body":"Once you understand memory"},{"speaker":"Dhruv Batra","startTime":1006.425,"endTime":1009.785,"body":"and personalization, why don't"},{"speaker":"Dhruv Batra","startTime":1009.785,"endTime":1011.645,"body":"you do something proactively?"},{"speaker":"Dhruv Batra","startTime":1011.735,"endTime":1014.105,"body":"Why am I having to sit"},{"speaker":"Dhruv Batra","startTime":1011.735,"endTime":1014.105,"body":"down and say things?"},{"speaker":"Dhruv Batra","startTime":1014.105,"endTime":1017.675,"body":"So it's sort of like"},{"speaker":"Dhruv Batra","startTime":1014.105,"endTime":1017.675,"body":"everybody gets an assistant"},{"speaker":"Dhruv Batra","startTime":1017.675,"endTime":1021.305,"body":"and a superpowered employee"},{"speaker":"Dhruv Batra","startTime":1017.675,"endTime":1021.305,"body":"or a chief of staff."},{"speaker":"Hannah Clark","startTime":1021.785,"endTime":1023.345,"body":"And you"},{"speaker":"Hannah Clark","startTime":1021.785,"endTime":1023.345,"body":"can see how some of the"},{"speaker":"Hannah Clark","startTime":1023.465,"endTime":1025.445,"body":"technologies that we interact"},{"speaker":"Hannah Clark","startTime":1023.465,"endTime":1025.445,"body":"with every day kind of"},{"speaker":"Hannah Clark","startTime":1025.445,"endTime":1026.525,"body":"contribute to that as well."},{"speaker":"Hannah Clark","startTime":1026.525,"endTime":1029.255,"body":"You think about the for you"},{"speaker":"Hannah Clark","startTime":1026.525,"endTime":1029.255,"body":"page on TikTok and where there's"},{"speaker":"Hannah Clark","startTime":1029.255,"endTime":1032.795,"body":"the technology that learns your"},{"speaker":"Hannah Clark","startTime":1029.255,"endTime":1032.795,"body":"preferences, learns your, the"},{"speaker":"Hannah Clark","startTime":1032.795,"endTime":1035.165,"body":"things that you're likely to"},{"speaker":"Hannah Clark","startTime":1032.795,"endTime":1035.165,"body":"interact with and engage with."},{"speaker":"Hannah Clark","startTime":1035.165,"endTime":1037.954,"body":"And we kind of apply that"},{"speaker":"Hannah Clark","startTime":1035.165,"endTime":1037.954,"body":"same logic to the technology"},{"speaker":"Hannah Clark","startTime":1037.954,"endTime":1040.715,"body":"that we're using now that we"},{"speaker":"Hannah Clark","startTime":1037.954,"endTime":1040.715,"body":"know knows a lot about us,"},{"speaker":"Hannah Clark","startTime":1040.715,"endTime":1043.115,"body":"we know knows a lot about"},{"speaker":"Hannah Clark","startTime":1040.715,"endTime":1043.115,"body":"our preferences and habits."},{"speaker":"Hannah Clark","startTime":1043.49,"endTime":1045.95,"body":"So, yeah, it's interesting"},{"speaker":"Hannah Clark","startTime":1043.49,"endTime":1045.95,"body":"how kind of our technology"},{"speaker":"Hannah Clark","startTime":1046.22,"endTime":1048.92,"body":"landscape is sort of training"},{"speaker":"Hannah Clark","startTime":1046.22,"endTime":1048.92,"body":"some of these expectations."},{"speaker":"Hannah Clark","startTime":1049.19,"endTime":1052.04,"body":"I think that those are"},{"speaker":"Hannah Clark","startTime":1049.19,"endTime":1052.04,"body":"interesting relationships to"},{"speaker":"Hannah Clark","startTime":1052.04,"endTime":1054.71,"body":"tip, to be paying attention"},{"speaker":"Hannah Clark","startTime":1052.04,"endTime":1054.71,"body":"to in terms of anticipating"},{"speaker":"Hannah Clark","startTime":1054.71,"endTime":1057.26,"body":"what consumers are going to"},{"speaker":"Hannah Clark","startTime":1054.71,"endTime":1057.26,"body":"expect, which I think is a great"},{"speaker":"Hannah Clark","startTime":1057.26,"endTime":1058.4,"body":"segue into the business side."},{"speaker":"Hannah Clark","startTime":1058.7,"endTime":1061.64,"body":"So right now there's no"},{"speaker":"Hannah Clark","startTime":1058.7,"endTime":1061.64,"body":"surprise here we see a lot of"},{"speaker":"Hannah Clark","startTime":1061.64,"endTime":1063.74,"body":"companies that are rushing to"},{"speaker":"Hannah Clark","startTime":1061.64,"endTime":1063.74,"body":"market with AI products and"},{"speaker":"Hannah Clark","startTime":1063.74,"endTime":1066.89,"body":"AI features, and they're, you"},{"speaker":"Hannah Clark","startTime":1063.74,"endTime":1066.89,"body":"know, very quick to promise"},{"speaker":"Hannah Clark","startTime":1067.01,"endTime":1070.315,"body":"transformative capabilities"},{"speaker":"Hannah Clark","startTime":1067.01,"endTime":1070.315,"body":"to varying degrees of success."},{"speaker":"Hannah Clark","startTime":1070.615,"endTime":1072.625,"body":"What would you say are the"},{"speaker":"Hannah Clark","startTime":1070.615,"endTime":1072.625,"body":"biggest mistakes that you"},{"speaker":"Hannah Clark","startTime":1072.625,"endTime":1074.995,"body":"see product teams making"},{"speaker":"Hannah Clark","startTime":1072.625,"endTime":1074.995,"body":"when it comes to scoping and"},{"speaker":"Hannah Clark","startTime":1074.995,"endTime":1076.08,"body":"positioning their AI features?"},{"speaker":"Dhruv Batra","startTime":1076.73,"endTime":1079.34,"body":"I think this, again"},{"speaker":"Dhruv Batra","startTime":1076.73,"endTime":1079.34,"body":"goes back to the question of the"},{"speaker":"Dhruv Batra","startTime":1079.34,"endTime":1080.929,"body":"jagged nature of intelligence."},{"speaker":"Dhruv Batra","startTime":1080.929,"endTime":1082.58,"body":"You have to be"},{"speaker":"Dhruv Batra","startTime":1080.929,"endTime":1082.58,"body":"extremely careful."},{"speaker":"Dhruv Batra","startTime":1082.88,"endTime":1084.949,"body":"This affects not just"},{"speaker":"Dhruv Batra","startTime":1082.88,"endTime":1084.949,"body":"the consumers, but"},{"speaker":"Dhruv Batra","startTime":1084.949,"endTime":1085.88,"body":"also the builders."},{"speaker":"Dhruv Batra","startTime":1086.21,"endTime":1088.4,"body":"You have to be extremely"},{"speaker":"Dhruv Batra","startTime":1086.21,"endTime":1088.4,"body":"careful not to promise the"},{"speaker":"Dhruv Batra","startTime":1088.4,"endTime":1091.219,"body":"sky because you will not be"},{"speaker":"Dhruv Batra","startTime":1088.4,"endTime":1091.219,"body":"able to deliver it on day one."},{"speaker":"Dhruv Batra","startTime":1091.61,"endTime":1096.11,"body":"Yet at the same time, the"},{"speaker":"Dhruv Batra","startTime":1091.61,"endTime":1096.11,"body":"expectations of generality"},{"speaker":"Dhruv Batra","startTime":1096.114,"endTime":1097.699,"body":"from consumers are climbing."},{"speaker":"Dhruv Batra","startTime":1097.73,"endTime":1101.36,"body":"They expect you to be able"},{"speaker":"Dhruv Batra","startTime":1097.73,"endTime":1101.36,"body":"to not be extremely narrow"},{"speaker":"Dhruv Batra","startTime":1101.36,"endTime":1104.865,"body":"applications because ChatGPT"},{"speaker":"Dhruv Batra","startTime":1101.36,"endTime":1104.865,"body":"answers any question, so"},{"speaker":"Dhruv Batra","startTime":1104.865,"endTime":1106.515,"body":"why don't you do anything?"},{"speaker":"Dhruv Batra","startTime":1106.785,"endTime":1109.875,"body":"And so there is this trap"},{"speaker":"Dhruv Batra","startTime":1106.785,"endTime":1109.875,"body":"of falling into this design"},{"speaker":"Dhruv Batra","startTime":1109.875,"endTime":1114.855,"body":"pattern of a text box as"},{"speaker":"Dhruv Batra","startTime":1109.875,"endTime":1114.855,"body":"the entryway into anything."},{"speaker":"Dhruv Batra","startTime":1115.155,"endTime":1116.745,"body":"And you don't tell"},{"speaker":"Dhruv Batra","startTime":1115.155,"endTime":1116.745,"body":"your user anything."},{"speaker":"Dhruv Batra","startTime":1116.745,"endTime":1117.764,"body":"You promise the word."},{"speaker":"Dhruv Batra","startTime":1117.945,"endTime":1121.455,"body":"My agent can do anything that"},{"speaker":"Dhruv Batra","startTime":1117.945,"endTime":1121.455,"body":"leads to frustration from"},{"speaker":"Dhruv Batra","startTime":1121.455,"endTime":1123.885,"body":"the users because they're not"},{"speaker":"Dhruv Batra","startTime":1121.455,"endTime":1123.885,"body":"going to, you know, first of"},{"speaker":"Dhruv Batra","startTime":1123.885,"endTime":1126.825,"body":"all, they are dealing with the"},{"speaker":"Dhruv Batra","startTime":1123.885,"endTime":1126.825,"body":"problem of just a blank canvas."},{"speaker":"Dhruv Batra","startTime":1127.195,"endTime":1130.045,"body":"What are the kinds of things"},{"speaker":"Dhruv Batra","startTime":1127.195,"endTime":1130.045,"body":"that I can ask here, and if"},{"speaker":"Dhruv Batra","startTime":1130.045,"endTime":1132.835,"body":"I'm not calibrated, I will"},{"speaker":"Dhruv Batra","startTime":1130.045,"endTime":1132.835,"body":"ask for things that the agent"},{"speaker":"Dhruv Batra","startTime":1132.835,"endTime":1134.575,"body":"will not be able to do and"},{"speaker":"Dhruv Batra","startTime":1132.835,"endTime":1134.575,"body":"they will be frustrated."},{"speaker":"Dhruv Batra","startTime":1134.575,"endTime":1135.205,"body":"Your users will."},{"speaker":"Dhruv Batra","startTime":1135.205,"endTime":1135.535,"body":"Sure."},{"speaker":"Dhruv Batra","startTime":1136.015,"endTime":1138.505,"body":"This is one of the reasons"},{"speaker":"Dhruv Batra","startTime":1136.015,"endTime":1138.505,"body":"why for our first product,"},{"speaker":"Dhruv Batra","startTime":1138.805,"endTime":1142.465,"body":"we crafted a fairly narrow"},{"speaker":"Dhruv Batra","startTime":1138.805,"endTime":1142.465,"body":"scope of capability."},{"speaker":"Dhruv Batra","startTime":1142.945,"endTime":1146.065,"body":"Scouts are agents that monitor"},{"speaker":"Dhruv Batra","startTime":1142.945,"endTime":1146.065,"body":"anything on the web for you."},{"speaker":"Dhruv Batra","startTime":1146.395,"endTime":1148.555,"body":"They don't log into"},{"speaker":"Dhruv Batra","startTime":1146.395,"endTime":1148.555,"body":"services and they don't"},{"speaker":"Dhruv Batra","startTime":1148.555,"endTime":1150.025,"body":"take right actions there."},{"speaker":"Dhruv Batra","startTime":1150.025,"endTime":1151.675,"body":"It's a read-only"},{"speaker":"Dhruv Batra","startTime":1150.025,"endTime":1151.675,"body":"monitoring product."},{"speaker":"Dhruv Batra","startTime":1152.12,"endTime":1155.179,"body":"However, we did not say"},{"speaker":"Dhruv Batra","startTime":1152.12,"endTime":1155.179,"body":"this is Amazon Price"},{"speaker":"Dhruv Batra","startTime":1155.179,"endTime":1158.72,"body":"Monitoring or this is"},{"speaker":"Dhruv Batra","startTime":1155.179,"endTime":1158.72,"body":"Ticketmaster event monitoring."},{"speaker":"Dhruv Batra","startTime":1159.11,"endTime":1162.439,"body":"Any digital information that"},{"speaker":"Dhruv Batra","startTime":1159.11,"endTime":1162.439,"body":"is available on the web that"},{"speaker":"Dhruv Batra","startTime":1162.439,"endTime":1166.07,"body":"you could open up a browser and"},{"speaker":"Dhruv Batra","startTime":1162.439,"endTime":1166.07,"body":"get access to these agents will"},{"speaker":"Dhruv Batra","startTime":1166.07,"endTime":1169.1,"body":"tell you, and you will get an"},{"speaker":"Dhruv Batra","startTime":1166.07,"endTime":1169.1,"body":"email whenever that happens."},{"speaker":"Dhruv Batra","startTime":1169.1,"endTime":1171.379,"body":"So just tell us in"},{"speaker":"Dhruv Batra","startTime":1169.1,"endTime":1171.379,"body":"natural language and at"},{"speaker":"Dhruv Batra","startTime":1171.379,"endTime":1172.945,"body":"whatever frequency you'd"},{"speaker":"Dhruv Batra","startTime":1171.379,"endTime":1172.945,"body":"like to be monitored."},{"speaker":"Dhruv Batra","startTime":1173.81,"endTime":1176.06,"body":"The reason why we did that,"},{"speaker":"Dhruv Batra","startTime":1173.81,"endTime":1176.06,"body":"it was extremely important for"},{"speaker":"Dhruv Batra","startTime":1176.06,"endTime":1178.34,"body":"us to deliver this capability."},{"speaker":"Dhruv Batra","startTime":1178.7,"endTime":1180.59,"body":"This is a read-only capability."},{"speaker":"Dhruv Batra","startTime":1180.92,"endTime":1182.96,"body":"We're not making, I"},{"speaker":"Dhruv Batra","startTime":1180.92,"endTime":1182.96,"body":"recoverable mistakes."},{"speaker":"Dhruv Batra","startTime":1183.29,"endTime":1186.56,"body":"If we make a purchase decision"},{"speaker":"Dhruv Batra","startTime":1183.29,"endTime":1186.56,"body":"on your behalf, you will"},{"speaker":"Dhruv Batra","startTime":1186.56,"endTime":1188.84,"body":"get frustrated if the wrong"},{"speaker":"Dhruv Batra","startTime":1186.56,"endTime":1188.84,"body":"thing is purchased for you."},{"speaker":"Dhruv Batra","startTime":1189.17,"endTime":1192.08,"body":"Yet there is a certain"},{"speaker":"Dhruv Batra","startTime":1189.17,"endTime":1192.08,"body":"generality here in the kinds"},{"speaker":"Dhruv Batra","startTime":1192.08,"endTime":1195.23,"body":"of queries you can ask and the"},{"speaker":"Dhruv Batra","startTime":1192.08,"endTime":1195.23,"body":"surfaces you may be expecting"},{"speaker":"Dhruv Batra","startTime":1195.38,"endTime":1196.73,"body":"this information to appear in."},{"speaker":"Dhruv Batra","startTime":1197.434,"endTime":1200.914,"body":"From there on, you have to"},{"speaker":"Dhruv Batra","startTime":1197.434,"endTime":1200.914,"body":"climb the staircase of trust."},{"speaker":"Dhruv Batra","startTime":1201.245,"endTime":1204.215,"body":"Initially, we delivered"},{"speaker":"Dhruv Batra","startTime":1201.245,"endTime":1204.215,"body":"value without asking"},{"speaker":"Dhruv Batra","startTime":1204.215,"endTime":1206.495,"body":"you for any logins on"},{"speaker":"Dhruv Batra","startTime":1204.215,"endTime":1206.495,"body":"credit card information."},{"speaker":"Dhruv Batra","startTime":1206.884,"endTime":1210.814,"body":"However, after you've seen"},{"speaker":"Dhruv Batra","startTime":1206.884,"endTime":1210.814,"body":"certain value, your users"},{"speaker":"Dhruv Batra","startTime":1210.814,"endTime":1213.245,"body":"will naturally expect you"},{"speaker":"Dhruv Batra","startTime":1210.814,"endTime":1213.245,"body":"to be able to do more."},{"speaker":"Dhruv Batra","startTime":1213.544,"endTime":1216.215,"body":"If I'm tracking an artist"},{"speaker":"Dhruv Batra","startTime":1213.544,"endTime":1216.215,"body":"coming into town, the next"},{"speaker":"Dhruv Batra","startTime":1216.215,"endTime":1217.894,"body":"step is get me a ticket."},{"speaker":"Dhruv Batra","startTime":1217.894,"endTime":1220.384,"body":"If I'm tracking the"},{"speaker":"Dhruv Batra","startTime":1217.894,"endTime":1220.384,"body":"availability of a restaurant"},{"speaker":"Dhruv Batra","startTime":1220.384,"endTime":1222.694,"body":"reservation, the next thing"},{"speaker":"Dhruv Batra","startTime":1220.384,"endTime":1222.694,"body":"is to make that reservation."},{"speaker":"Dhruv Batra","startTime":1223.114,"endTime":1225.604,"body":"If I'm a recruiter and I'm"},{"speaker":"Dhruv Batra","startTime":1223.114,"endTime":1225.604,"body":"tracking the movement of"},{"speaker":"Dhruv Batra","startTime":1225.604,"endTime":1228.334,"body":"a particular candidate,"},{"speaker":"Dhruv Batra","startTime":1225.604,"endTime":1228.334,"body":"the next step is drafting"},{"speaker":"Dhruv Batra","startTime":1228.334,"endTime":1229.324,"body":"an outreach email."},{"speaker":"Dhruv Batra","startTime":1229.789,"endTime":1233.629,"body":"And so from a builder's"},{"speaker":"Dhruv Batra","startTime":1229.789,"endTime":1233.629,"body":"perspective, I am a newbie."},{"speaker":"Dhruv Batra","startTime":1233.779,"endTime":1234.86,"body":"I'm an AI researcher."},{"speaker":"Dhruv Batra","startTime":1234.86,"endTime":1237.979,"body":"I don't feel like I'm in a"},{"speaker":"Dhruv Batra","startTime":1234.86,"endTime":1237.979,"body":"state to be able to give advice."},{"speaker":"Dhruv Batra","startTime":1238.37,"endTime":1241.309,"body":"I can just point to the"},{"speaker":"Dhruv Batra","startTime":1238.37,"endTime":1241.309,"body":"caution that we adhere to,"},{"speaker":"Dhruv Batra","startTime":1241.61,"endTime":1244.309,"body":"which is that there is a"},{"speaker":"Dhruv Batra","startTime":1241.61,"endTime":1244.309,"body":"jagged nature of intelligence."},{"speaker":"Dhruv Batra","startTime":1244.37,"endTime":1246.079,"body":"You're not gonna be"},{"speaker":"Dhruv Batra","startTime":1244.37,"endTime":1246.079,"body":"some tasks you're going"},{"speaker":"Dhruv Batra","startTime":1246.079,"endTime":1246.799,"body":"to be able to solve."},{"speaker":"Dhruv Batra","startTime":1246.799,"endTime":1247.104,"body":"Some not."},{"speaker":"Dhruv Batra","startTime":1247.824,"endTime":1251.574,"body":"Typically the tasks that you"},{"speaker":"Dhruv Batra","startTime":1247.824,"endTime":1251.574,"body":"are able to solve are the ones"},{"speaker":"Dhruv Batra","startTime":1251.574,"endTime":1255.354,"body":"where you have the ability to"},{"speaker":"Dhruv Batra","startTime":1251.574,"endTime":1255.354,"body":"practice and therefore it has"},{"speaker":"Dhruv Batra","startTime":1255.354,"endTime":1258.594,"body":"to be tasked where the mistakes"},{"speaker":"Dhruv Batra","startTime":1255.354,"endTime":1258.594,"body":"are not too costly and you"},{"speaker":"Dhruv Batra","startTime":1258.594,"endTime":1260.635,"body":"build from there incrementally."},{"speaker":"Hannah Clark","startTime":1260.865,"endTime":1261.074,"body":"Okay."},{"speaker":"Hannah Clark","startTime":1261.074,"endTime":1264.29,"body":"This is very wise words,"},{"speaker":"Hannah Clark","startTime":1261.074,"endTime":1264.29,"body":"and I see this often where."},{"speaker":"Hannah Clark","startTime":1265.034,"endTime":1267.824,"body":"I completely see what you mean"},{"speaker":"Hannah Clark","startTime":1265.034,"endTime":1267.824,"body":"in terms of frustrating the"},{"speaker":"Hannah Clark","startTime":1267.824,"endTime":1270.884,"body":"users with having limitations"},{"speaker":"Hannah Clark","startTime":1267.824,"endTime":1270.884,"body":"that are just opaque to"},{"speaker":"Hannah Clark","startTime":1270.884,"endTime":1272.414,"body":"the user's experience."},{"speaker":"Hannah Clark","startTime":1272.414,"endTime":1274.695,"body":"You know, they're walking into"},{"speaker":"Hannah Clark","startTime":1272.414,"endTime":1274.695,"body":"a chat bot and they're going"},{"speaker":"Hannah Clark","startTime":1274.695,"endTime":1277.304,"body":"to naturally interact with it"},{"speaker":"Hannah Clark","startTime":1274.695,"endTime":1277.304,"body":"the way that you would expect"},{"speaker":"Hannah Clark","startTime":1277.304,"endTime":1279.134,"body":"a chat with a live agent."},{"speaker":"Hannah Clark","startTime":1279.374,"endTime":1281.654,"body":"And that can lead to a lot"},{"speaker":"Hannah Clark","startTime":1279.374,"endTime":1281.654,"body":"of frustration, which you"},{"speaker":"Hannah Clark","startTime":1281.654,"endTime":1284.175,"body":"know, there's a cost benefit"},{"speaker":"Hannah Clark","startTime":1281.654,"endTime":1284.175,"body":"analysis to not limiting the"},{"speaker":"Hannah Clark","startTime":1284.175,"endTime":1287.834,"body":"scope of what's possible and"},{"speaker":"Hannah Clark","startTime":1284.175,"endTime":1287.834,"body":"taking the risk that your"},{"speaker":"Hannah Clark","startTime":1287.834,"endTime":1291.639,"body":"consumers are going to take"},{"speaker":"Hannah Clark","startTime":1287.834,"endTime":1291.639,"body":"away return and have a lower"},{"speaker":"Hannah Clark","startTime":1291.639,"endTime":1294.159,"body":"degree of faith across the"},{"speaker":"Hannah Clark","startTime":1291.639,"endTime":1294.159,"body":"board with the technology."},{"speaker":"Dhruv Batra","startTime":1294.37,"endTime":1296.949,"body":"And nature,"},{"speaker":"Dhruv Batra","startTime":1294.37,"endTime":1296.949,"body":"if they don't find value in"},{"speaker":"Dhruv Batra","startTime":1296.949,"endTime":1299.979,"body":"what you said you could do,"},{"speaker":"Dhruv Batra","startTime":1296.949,"endTime":1299.979,"body":"they will have suboptimal"},{"speaker":"Dhruv Batra","startTime":1299.979,"endTime":1301.389,"body":"experiences and they will churn."},{"speaker":"Dhruv Batra","startTime":1301.419,"endTime":1302.409,"body":"They will not come back to you."},{"speaker":"Hannah Clark","startTime":1302.769,"endTime":1303.129,"body":"Yeah."},{"speaker":"Hannah Clark","startTime":1303.129,"endTime":1303.37,"body":"Okay."},{"speaker":"Hannah Clark","startTime":1303.37,"endTime":1304.6,"body":"So let's dive a little"},{"speaker":"Hannah Clark","startTime":1303.37,"endTime":1304.6,"body":"bit deeper in that."},{"speaker":"Hannah Clark","startTime":1304.6,"endTime":1307.86,"body":"I kind of think the trust is"},{"speaker":"Hannah Clark","startTime":1304.6,"endTime":1307.86,"body":"sort of, core element of why"},{"speaker":"Hannah Clark","startTime":1307.86,"endTime":1310.26,"body":"people are turning at that"},{"speaker":"Hannah Clark","startTime":1307.86,"endTime":1310.26,"body":"specific critical moment."},{"speaker":"Hannah Clark","startTime":1310.56,"endTime":1312.989,"body":"How should product leaders"},{"speaker":"Hannah Clark","startTime":1310.56,"endTime":1312.989,"body":"think about building trust"},{"speaker":"Hannah Clark","startTime":1313.199,"endTime":1315.27,"body":"with consumers without"},{"speaker":"Hannah Clark","startTime":1313.199,"endTime":1315.27,"body":"overpromising the capabilities"},{"speaker":"Hannah Clark","startTime":1315.27,"endTime":1316.979,"body":"that aren't ready yet or"},{"speaker":"Hannah Clark","startTime":1315.27,"endTime":1316.979,"body":"that they can't deliver on?"},{"speaker":"Dhruv Batra","startTime":1317.219,"endTime":1319.919,"body":"I think this goes"},{"speaker":"Dhruv Batra","startTime":1317.219,"endTime":1319.919,"body":"back to the previous question"},{"speaker":"Dhruv Batra","startTime":1319.919,"endTime":1320.879,"body":"that we were talking about."},{"speaker":"Dhruv Batra","startTime":1321.09,"endTime":1325.83,"body":"People have to see value"},{"speaker":"Dhruv Batra","startTime":1321.09,"endTime":1325.83,"body":"before they hand over"},{"speaker":"Dhruv Batra","startTime":1325.83,"endTime":1329.159,"body":"credentials or sensitive"},{"speaker":"Dhruv Batra","startTime":1325.83,"endTime":1329.159,"body":"information like credit cards."},{"speaker":"Dhruv Batra","startTime":1329.429,"endTime":1333.155,"body":"If you're asking consumers as"},{"speaker":"Dhruv Batra","startTime":1329.429,"endTime":1333.155,"body":"a very first step, and there"},{"speaker":"Dhruv Batra","startTime":1333.155,"endTime":1336.905,"body":"are certain apps out there that"},{"speaker":"Dhruv Batra","startTime":1333.155,"endTime":1336.905,"body":"have tried playing this where"},{"speaker":"Dhruv Batra","startTime":1337.084,"endTime":1340.894,"body":"give me your calendar, give"},{"speaker":"Dhruv Batra","startTime":1337.084,"endTime":1340.894,"body":"me your email inbox access."},{"speaker":"Dhruv Batra","startTime":1340.894,"endTime":1346.475,"body":"Give me a couple of other logins"},{"speaker":"Dhruv Batra","startTime":1340.894,"endTime":1346.475,"body":"before you even see what this"},{"speaker":"Dhruv Batra","startTime":1346.475,"endTime":1347.399,"body":"product is capable of doing."},{"speaker":"Dhruv Batra","startTime":1348.144,"endTime":1351.235,"body":"That is an extremely"},{"speaker":"Dhruv Batra","startTime":1348.144,"endTime":1351.235,"body":"risky strategy."},{"speaker":"Dhruv Batra","startTime":1351.235,"endTime":1355.524,"body":"It might make you go viral"},{"speaker":"Dhruv Batra","startTime":1351.235,"endTime":1355.524,"body":"on social media, but imagine"},{"speaker":"Dhruv Batra","startTime":1355.524,"endTime":1358.134,"body":"yourself, put yourself in"},{"speaker":"Dhruv Batra","startTime":1355.524,"endTime":1358.134,"body":"the shoes of that user."},{"speaker":"Dhruv Batra","startTime":1358.434,"endTime":1361.614,"body":"Do I really want to hand you my"},{"speaker":"Dhruv Batra","startTime":1358.434,"endTime":1361.614,"body":"work email that has sensitive"},{"speaker":"Dhruv Batra","startTime":1361.614,"endTime":1365.094,"body":"documentation on it or my"},{"speaker":"Dhruv Batra","startTime":1361.614,"endTime":1365.094,"body":"credit card without knowing"},{"speaker":"Dhruv Batra","startTime":1365.154,"endTime":1366.774,"body":"what you can or cannot deliver?"},{"speaker":"Dhruv Batra","startTime":1367.219,"endTime":1370.189,"body":"And so that's why"},{"speaker":"Dhruv Batra","startTime":1367.219,"endTime":1370.189,"body":"where we started was no"},{"speaker":"Dhruv Batra","startTime":1370.189,"endTime":1373.699,"body":"authentication, no writing"},{"speaker":"Dhruv Batra","startTime":1370.189,"endTime":1373.699,"body":"or no, no changing the state"},{"speaker":"Dhruv Batra","startTime":1373.699,"endTime":1374.87,"body":"of the world initially."},{"speaker":"Dhruv Batra","startTime":1374.87,"endTime":1375.679,"body":"It's just reading."},{"speaker":"Dhruv Batra","startTime":1375.889,"endTime":1378.529,"body":"And what that means is that"},{"speaker":"Dhruv Batra","startTime":1375.889,"endTime":1378.529,"body":"you can actually, you know."},{"speaker":"Dhruv Batra","startTime":1379.639,"endTime":1382.549,"body":"AI isn't promising you a"},{"speaker":"Dhruv Batra","startTime":1379.639,"endTime":1382.549,"body":"hundred percent accuracy,"},{"speaker":"Dhruv Batra","startTime":1382.549,"endTime":1386.089,"body":"which means you can retry"},{"speaker":"Dhruv Batra","startTime":1382.549,"endTime":1386.089,"body":"if you have made mistakes."},{"speaker":"Dhruv Batra","startTime":1386.419,"endTime":1388.939,"body":"Retrying is possible"},{"speaker":"Dhruv Batra","startTime":1386.419,"endTime":1388.939,"body":"in a read-only product."},{"speaker":"Dhruv Batra","startTime":1388.939,"endTime":1391.219,"body":"It's not possible in the"},{"speaker":"Dhruv Batra","startTime":1388.939,"endTime":1391.219,"body":"right product with irre"},{"speaker":"Dhruv Batra","startTime":1391.219,"endTime":1392.239,"body":"recoverable mistakes."},{"speaker":"Dhruv Batra","startTime":1392.659,"endTime":1394.969,"body":"So those are the kinds"},{"speaker":"Dhruv Batra","startTime":1392.659,"endTime":1394.969,"body":"of things I would, and we"},{"speaker":"Dhruv Batra","startTime":1394.969,"endTime":1397.339,"body":"certainly keep in mind when"},{"speaker":"Dhruv Batra","startTime":1394.969,"endTime":1397.339,"body":"we have to climb that sta"},{"speaker":"Dhruv Batra","startTime":1397.789,"endTime":1399.469,"body":"of trust with our users."},{"speaker":"Hannah Clark","startTime":1399.859,"endTime":1402.334,"body":"I can see this"},{"speaker":"Hannah Clark","startTime":1399.859,"endTime":1402.334,"body":"kind of notion of this is"},{"speaker":"Hannah Clark","startTime":1402.334,"endTime":1404.254,"body":"an unrelated example, but"},{"speaker":"Hannah Clark","startTime":1402.334,"endTime":1404.254,"body":"I feel like it illustrates"},{"speaker":"Hannah Clark","startTime":1404.254,"endTime":1405.034,"body":"a similar kind of point."},{"speaker":"Hannah Clark","startTime":1405.034,"endTime":1407.764,"body":"I had a friend who moved"},{"speaker":"Hannah Clark","startTime":1405.034,"endTime":1407.764,"body":"to Canada from Brazil, and"},{"speaker":"Hannah Clark","startTime":1407.764,"endTime":1409.894,"body":"she thought Canada is the"},{"speaker":"Hannah Clark","startTime":1407.764,"endTime":1409.894,"body":"safest country in the world."},{"speaker":"Hannah Clark","startTime":1409.924,"endTime":1411.124,"body":"Everywhere that I go is safe."},{"speaker":"Hannah Clark","startTime":1411.544,"endTime":1414.965,"body":"And then her first week in"},{"speaker":"Hannah Clark","startTime":1411.544,"endTime":1414.965,"body":"Canada, there was a robbery"},{"speaker":"Hannah Clark","startTime":1414.965,"endTime":1417.934,"body":"on her street and suddenly she"},{"speaker":"Hannah Clark","startTime":1414.965,"endTime":1417.934,"body":"thinks everywhere is unsafe."},{"speaker":"Hannah Clark","startTime":1418.235,"endTime":1420.935,"body":"So it's the similar"},{"speaker":"Hannah Clark","startTime":1418.235,"endTime":1420.935,"body":"kind of notion of."},{"speaker":"Dhruv Batra","startTime":1421.235,"endTime":1421.86,"body":"Time to value,"},{"speaker":"Hannah Clark","startTime":1422.21,"endTime":1424.1,"body":"time to delight,"},{"speaker":"Hannah Clark","startTime":1422.21,"endTime":1424.1,"body":"time to value, but also how"},{"speaker":"Hannah Clark","startTime":1424.37,"endTime":1426.8,"body":"fragile and kind of fraught"},{"speaker":"Hannah Clark","startTime":1424.37,"endTime":1426.8,"body":"that initial trust building"},{"speaker":"Hannah Clark","startTime":1426.8,"endTime":1430.1,"body":"period can be when something"},{"speaker":"Hannah Clark","startTime":1426.8,"endTime":1430.1,"body":"interrupts your expectation"},{"speaker":"Hannah Clark","startTime":1430.1,"endTime":1432.62,"body":"of what is going to be"},{"speaker":"Hannah Clark","startTime":1430.1,"endTime":1432.62,"body":"delivered and kind of shakes"},{"speaker":"Hannah Clark","startTime":1432.62,"endTime":1434.15,"body":"that foundational trust."},{"speaker":"Hannah Clark","startTime":1434.51,"endTime":1437.03,"body":"So I wanna dig in then"},{"speaker":"Hannah Clark","startTime":1434.51,"endTime":1437.03,"body":"into the technology side."},{"speaker":"Hannah Clark","startTime":1437.03,"endTime":1438.98,"body":"I think this is a really good"},{"speaker":"Hannah Clark","startTime":1437.03,"endTime":1438.98,"body":"time to kind of switch it up."},{"speaker":"Hannah Clark","startTime":1439.28,"endTime":1441.32,"body":"From your perspective as"},{"speaker":"Hannah Clark","startTime":1439.28,"endTime":1441.32,"body":"an AI researcher, which"},{"speaker":"Hannah Clark","startTime":1441.32,"endTime":1444.29,"body":"problems would you consider"},{"speaker":"Hannah Clark","startTime":1441.32,"endTime":1444.29,"body":"largely solved today?"},{"speaker":"Hannah Clark","startTime":1444.695,"endTime":1446.945,"body":"And which would you say"},{"speaker":"Hannah Clark","startTime":1444.695,"endTime":1446.945,"body":"are, and I know that this is"},{"speaker":"Hannah Clark","startTime":1446.945,"endTime":1449.045,"body":"loaded language that they,"},{"speaker":"Hannah Clark","startTime":1446.945,"endTime":1449.045,"body":"it's on the near term horizon"},{"speaker":"Hannah Clark","startTime":1449.075,"endTime":1450.305,"body":"'cause that can always shift."},{"speaker":"Hannah Clark","startTime":1450.305,"endTime":1453.77,"body":"But what feels like it's very"},{"speaker":"Hannah Clark","startTime":1450.305,"endTime":1453.77,"body":"much on the near term horizon"},{"speaker":"Hannah Clark","startTime":1453.77,"endTime":1456.08,"body":"versus, you know, let's say"},{"speaker":"Hannah Clark","startTime":1453.77,"endTime":1456.08,"body":"perpetually a few years away."},{"speaker":"Dhruv Batra","startTime":1456.35,"endTime":1458.78,"body":"The concrete"},{"speaker":"Dhruv Batra","startTime":1456.35,"endTime":1458.78,"body":"example I'll use here"},{"speaker":"Dhruv Batra","startTime":1459.08,"endTime":1462.58,"body":"because it's on my mind, is"},{"speaker":"Dhruv Batra","startTime":1459.08,"endTime":1462.58,"body":"of a problem of answering"},{"speaker":"Dhruv Batra","startTime":1462.67,"endTime":1464.05,"body":"questions about images."},{"speaker":"Dhruv Batra","startTime":1464.38,"endTime":1469.06,"body":"The reason why this is on my"},{"speaker":"Dhruv Batra","startTime":1464.38,"endTime":1469.06,"body":"mind is last week I was at a"},{"speaker":"Dhruv Batra","startTime":1469.12,"endTime":1472.33,"body":"conference ICCV, International"},{"speaker":"Dhruv Batra","startTime":1469.12,"endTime":1472.33,"body":"Conference in Computer Vision."},{"speaker":"Dhruv Batra","startTime":1472.62,"endTime":1475.949,"body":"My collaborators and I"},{"speaker":"Dhruv Batra","startTime":1472.62,"endTime":1475.949,"body":"received what is known as a"},{"speaker":"Dhruv Batra","startTime":1475.949,"endTime":1479.759,"body":"Mark Everingham prize for work"},{"speaker":"Dhruv Batra","startTime":1475.949,"endTime":1479.759,"body":"that we had done a decade ago."},{"speaker":"Dhruv Batra","startTime":1479.82,"endTime":1481.8,"body":"The work was called"},{"speaker":"Dhruv Batra","startTime":1479.82,"endTime":1481.8,"body":"Visual Question Answering."},{"speaker":"Dhruv Batra","startTime":1482.04,"endTime":1486.749,"body":"We introduced to the community"},{"speaker":"Dhruv Batra","startTime":1482.04,"endTime":1486.749,"body":"a dataset, a task, a benchmark,"},{"speaker":"Dhruv Batra","startTime":1486.749,"endTime":1489.899,"body":"and a set of methods for"},{"speaker":"Dhruv Batra","startTime":1486.749,"endTime":1489.899,"body":"building the first generation"},{"speaker":"Dhruv Batra","startTime":1489.899,"endTime":1492.81,"body":"of agents that could answer"},{"speaker":"Dhruv Batra","startTime":1489.899,"endTime":1492.81,"body":"any open-ended question"},{"speaker":"Dhruv Batra","startTime":1492.81,"endTime":1494.37,"body":"about any natural image."},{"speaker":"Dhruv Batra","startTime":1494.895,"endTime":1497.475,"body":"Over the last 10 years,"},{"speaker":"Dhruv Batra","startTime":1494.895,"endTime":1497.475,"body":"we've helped the community"},{"speaker":"Dhruv Batra","startTime":1497.475,"endTime":1501.405,"body":"track progress on this by"},{"speaker":"Dhruv Batra","startTime":1497.475,"endTime":1501.405,"body":"organizing annual competitions."},{"speaker":"Dhruv Batra","startTime":1501.615,"endTime":1505.335,"body":"We stopped organizing that"},{"speaker":"Dhruv Batra","startTime":1501.615,"endTime":1505.335,"body":"competition in 2021 because"},{"speaker":"Dhruv Batra","startTime":1505.544,"endTime":1508.665,"body":"initially when we started"},{"speaker":"Dhruv Batra","startTime":1505.544,"endTime":1508.665,"body":"in 2015, most methods"},{"speaker":"Dhruv Batra","startTime":1508.665,"endTime":1510.465,"body":"were incredibly poor."},{"speaker":"Dhruv Batra","startTime":1510.554,"endTime":1512.475,"body":"As you can imagine at"},{"speaker":"Dhruv Batra","startTime":1510.554,"endTime":1512.475,"body":"this task of answering"},{"speaker":"Dhruv Batra","startTime":1512.655,"endTime":1513.585,"body":"questions about images."},{"speaker":"Dhruv Batra","startTime":1513.97,"endTime":1516.79,"body":"In 2021 on that dataset"},{"speaker":"Dhruv Batra","startTime":1513.97,"endTime":1516.79,"body":"that we had created, we"},{"speaker":"Dhruv Batra","startTime":1516.79,"endTime":1519.91,"body":"basically met human accuracy."},{"speaker":"Dhruv Batra","startTime":1519.97,"endTime":1522.37,"body":"We had reached into human"},{"speaker":"Dhruv Batra","startTime":1519.97,"endTime":1522.37,"body":"agreement in answering these"},{"speaker":"Dhruv Batra","startTime":1522.37,"endTime":1525.01,"body":"questions, and so we stopped"},{"speaker":"Dhruv Batra","startTime":1522.37,"endTime":1525.01,"body":"organizing that competition."},{"speaker":"Dhruv Batra","startTime":1525.28,"endTime":1529.24,"body":"And as I'd mentioned, you know,"},{"speaker":"Dhruv Batra","startTime":1525.28,"endTime":1529.24,"body":"it's an interesting lifespan"},{"speaker":"Dhruv Batra","startTime":1529.24,"endTime":1531.91,"body":"where in the course of last"},{"speaker":"Dhruv Batra","startTime":1529.24,"endTime":1531.91,"body":"10 years, you know, I found"},{"speaker":"Dhruv Batra","startTime":1531.91,"endTime":1536.5,"body":"myself leading a team at FAIR"},{"speaker":"Dhruv Batra","startTime":1531.91,"endTime":1536.5,"body":"that built modern methods"},{"speaker":"Dhruv Batra","startTime":1536.5,"endTime":1539.71,"body":"that shipped on RayBan meta"},{"speaker":"Dhruv Batra","startTime":1536.5,"endTime":1539.71,"body":"sunglasses, where you can invoke"},{"speaker":"Dhruv Batra","startTime":1539.71,"endTime":1541.96,"body":"an assistant and you can say,"},{"speaker":"Dhruv Batra","startTime":1539.71,"endTime":1541.96,"body":"Hey, meta, take a picture."},{"speaker":"Dhruv Batra","startTime":1541.99,"endTime":1543.31,"body":"Tell me more about"},{"speaker":"Dhruv Batra","startTime":1541.99,"endTime":1543.31,"body":"this monument."},{"speaker":"Dhruv Batra","startTime":1543.635,"endTime":1545.555,"body":"That problem is a good loop."},{"speaker":"Dhruv Batra","startTime":1545.555,"endTime":1549.065,"body":"Closure from 10 years ago and"},{"speaker":"Dhruv Batra","startTime":1545.555,"endTime":1549.065,"body":"when we started, there were"},{"speaker":"Dhruv Batra","startTime":1549.065,"endTime":1551.764,"body":"just a host of problems that"},{"speaker":"Dhruv Batra","startTime":1549.065,"endTime":1551.764,"body":"were completely open-ended"},{"speaker":"Dhruv Batra","startTime":1551.764,"endTime":1555.425,"body":"problems answering questions"},{"speaker":"Dhruv Batra","startTime":1551.764,"endTime":1555.425,"body":"that required reading Text"},{"speaker":"Dhruv Batra","startTime":1555.485,"endTime":1557.764,"body":"in the Wild was hopeless."},{"speaker":"Dhruv Batra","startTime":1558.035,"endTime":1560.675,"body":"If you asked, what does"},{"speaker":"Dhruv Batra","startTime":1558.035,"endTime":1560.675,"body":"the sign say, most of those"},{"speaker":"Dhruv Batra","startTime":1560.675,"endTime":1563.945,"body":"methods weren't running OCR or"},{"speaker":"Dhruv Batra","startTime":1560.675,"endTime":1563.945,"body":"optical character recognition,"},{"speaker":"Dhruv Batra","startTime":1564.125,"endTime":1566.855,"body":"and so they couldn't read"},{"speaker":"Dhruv Batra","startTime":1564.125,"endTime":1566.855,"body":"the text on the sign."},{"speaker":"Dhruv Batra","startTime":1567.095,"endTime":1569.075,"body":"And so what methods"},{"speaker":"Dhruv Batra","startTime":1567.095,"endTime":1569.075,"body":"are having to do is."},{"speaker":"Dhruv Batra","startTime":1569.409,"endTime":1571.33,"body":"Answer based on priors."},{"speaker":"Dhruv Batra","startTime":1571.57,"endTime":1573.1,"body":"What do signs usually say?"},{"speaker":"Dhruv Batra","startTime":1573.399,"endTime":1575.02,"body":"Signs say, stop or go."},{"speaker":"Dhruv Batra","startTime":1575.02,"endTime":1577.09,"body":"And so they would just, you"},{"speaker":"Dhruv Batra","startTime":1575.02,"endTime":1577.09,"body":"know, make common guesses."},{"speaker":"Dhruv Batra","startTime":1577.419,"endTime":1580.57,"body":"We found that this was a"},{"speaker":"Dhruv Batra","startTime":1577.419,"endTime":1580.57,"body":"common problem, that most"},{"speaker":"Dhruv Batra","startTime":1580.87,"endTime":1584.05,"body":"image question answering"},{"speaker":"Dhruv Batra","startTime":1580.87,"endTime":1584.05,"body":"models were heavily dominated"},{"speaker":"Dhruv Batra","startTime":1584.29,"endTime":1585.969,"body":"by linguistic priors."},{"speaker":"Dhruv Batra","startTime":1586.209,"endTime":1589.689,"body":"So if you ever took a picture"},{"speaker":"Dhruv Batra","startTime":1586.209,"endTime":1589.689,"body":"of bananas and you asked what"},{"speaker":"Dhruv Batra","startTime":1589.689,"endTime":1592.749,"body":"color are the bananas, the"},{"speaker":"Dhruv Batra","startTime":1589.689,"endTime":1592.749,"body":"model was most likely going"},{"speaker":"Dhruv Batra","startTime":1592.749,"endTime":1595.57,"body":"to say yellow, because most"},{"speaker":"Dhruv Batra","startTime":1592.749,"endTime":1595.57,"body":"bananas in the world are yellow."},{"speaker":"Dhruv Batra","startTime":1595.6,"endTime":1597.219,"body":"It knows that from"},{"speaker":"Dhruv Batra","startTime":1595.6,"endTime":1597.219,"body":"the training dataset."},{"speaker":"Dhruv Batra","startTime":1597.53,"endTime":1599.27,"body":"It actually can't see very well."},{"speaker":"Dhruv Batra","startTime":1599.54,"endTime":1603.11,"body":"You can think of it as squinting"},{"speaker":"Dhruv Batra","startTime":1599.54,"endTime":1603.11,"body":"at the image, and so it could be"},{"speaker":"Dhruv Batra","startTime":1603.11,"endTime":1604.25,"body":"a picture of the green banana."},{"speaker":"Dhruv Batra","startTime":1604.25,"endTime":1607.22,"body":"It'll say the banana's yellow,"},{"speaker":"Dhruv Batra","startTime":1604.25,"endTime":1607.22,"body":"because most bananas are yellow."},{"speaker":"Dhruv Batra","startTime":1607.76,"endTime":1611.36,"body":"We had extended question"},{"speaker":"Dhruv Batra","startTime":1607.76,"endTime":1611.36,"body":"answering to dialogue with"},{"speaker":"Dhruv Batra","startTime":1611.36,"endTime":1614.899,"body":"chatbots and core reference"},{"speaker":"Dhruv Batra","startTime":1611.36,"endTime":1614.899,"body":"was an extremely hard problem."},{"speaker":"Dhruv Batra","startTime":1615.29,"endTime":1617.54,"body":"If you ask, is there"},{"speaker":"Dhruv Batra","startTime":1615.29,"endTime":1617.54,"body":"a person in the image?"},{"speaker":"Dhruv Batra","startTime":1617.54,"endTime":1617.99,"body":"Yes."},{"speaker":"Dhruv Batra","startTime":1618.05,"endTime":1621.8,"body":"What are they doing or what"},{"speaker":"Dhruv Batra","startTime":1618.05,"endTime":1621.8,"body":"is he doing now that is a"},{"speaker":"Dhruv Batra","startTime":1621.8,"endTime":1624.439,"body":"core reference into a visual"},{"speaker":"Dhruv Batra","startTime":1621.8,"endTime":1624.439,"body":"entity that we just talked"},{"speaker":"Dhruv Batra","startTime":1624.439,"endTime":1625.939,"body":"about in the previous round."},{"speaker":"Dhruv Batra","startTime":1626.379,"endTime":1627.61,"body":"That was a hard problem."},{"speaker":"Dhruv Batra","startTime":1627.639,"endTime":1628.93,"body":"The model was already confused."},{"speaker":"Dhruv Batra","startTime":1628.93,"endTime":1631.419,"body":"It didn't know what he referred"},{"speaker":"Dhruv Batra","startTime":1628.93,"endTime":1631.419,"body":"to or what they referred to."},{"speaker":"Dhruv Batra","startTime":1631.81,"endTime":1633.705,"body":"Those problems today"},{"speaker":"Dhruv Batra","startTime":1631.81,"endTime":1633.705,"body":"are considered solved."},{"speaker":"Dhruv Batra","startTime":1634.345,"endTime":1636.295,"body":"To the degree that we can"},{"speaker":"Dhruv Batra","startTime":1634.345,"endTime":1636.295,"body":"measure, these problems"},{"speaker":"Dhruv Batra","startTime":1636.295,"endTime":1637.345,"body":"are not open problems."},{"speaker":"Dhruv Batra","startTime":1637.705,"endTime":1639.535,"body":"However, there are still"},{"speaker":"Dhruv Batra","startTime":1637.705,"endTime":1639.535,"body":"some problems that are"},{"speaker":"Dhruv Batra","startTime":1639.535,"endTime":1640.855,"body":"extremely open problems."},{"speaker":"Dhruv Batra","startTime":1641.185,"endTime":1644.845,"body":"Counting objects and images"},{"speaker":"Dhruv Batra","startTime":1641.185,"endTime":1644.845,"body":"is still an open problem."},{"speaker":"Dhruv Batra","startTime":1645.085,"endTime":1649.075,"body":"Take a picture today where there"},{"speaker":"Dhruv Batra","startTime":1645.085,"endTime":1649.075,"body":"are more than 10 people in a"},{"speaker":"Dhruv Batra","startTime":1649.075,"endTime":1652.195,"body":"crowd, and I say 10 because"},{"speaker":"Dhruv Batra","startTime":1649.075,"endTime":1652.195,"body":"small number of objects you"},{"speaker":"Dhruv Batra","startTime":1652.195,"endTime":1653.785,"body":"can make reasonable guesses on."},{"speaker":"Dhruv Batra","startTime":1654.145,"endTime":1657.35,"body":"But take more than 10 people"},{"speaker":"Dhruv Batra","startTime":1654.145,"endTime":1657.35,"body":"in or a crowd shot, upload"},{"speaker":"Dhruv Batra","startTime":1657.35,"endTime":1658.7,"body":"it to your favorite chat bot."},{"speaker":"Dhruv Batra","startTime":1658.73,"endTime":1660.74,"body":"Ask it how many people there"},{"speaker":"Dhruv Batra","startTime":1658.73,"endTime":1660.74,"body":"are in the image, and just"},{"speaker":"Dhruv Batra","startTime":1660.74,"endTime":1661.879,"body":"look at what response you get."},{"speaker":"Dhruv Batra","startTime":1662.274,"endTime":1664.435,"body":"And that is still an"},{"speaker":"Dhruv Batra","startTime":1662.274,"endTime":1664.435,"body":"open research question."},{"speaker":"Dhruv Batra","startTime":1664.834,"endTime":1667.745,"body":"Asking about 3D"},{"speaker":"Dhruv Batra","startTime":1664.834,"endTime":1667.745,"body":"spatial understanding."},{"speaker":"Dhruv Batra","startTime":1667.925,"endTime":1670.504,"body":"For example, take a picture"},{"speaker":"Dhruv Batra","startTime":1667.925,"endTime":1670.504,"body":"where there's a table at"},{"speaker":"Dhruv Batra","startTime":1670.504,"endTime":1674.074,"body":"the far end and maybe a"},{"speaker":"Dhruv Batra","startTime":1670.504,"endTime":1674.074,"body":"bookcase closer to the camera."},{"speaker":"Dhruv Batra","startTime":1674.344,"endTime":1676.594,"body":"Ask it about the height"},{"speaker":"Dhruv Batra","startTime":1674.344,"endTime":1676.594,"body":"of the table and the"},{"speaker":"Dhruv Batra","startTime":1676.594,"endTime":1677.584,"body":"height of the bookend."},{"speaker":"Dhruv Batra","startTime":1677.824,"endTime":1682.084,"body":"What most chatbots today will"},{"speaker":"Dhruv Batra","startTime":1677.824,"endTime":1682.084,"body":"answer is pixel heights, like"},{"speaker":"Dhruv Batra","startTime":1682.084,"endTime":1684.995,"body":"whatever seems closer to camera,"},{"speaker":"Dhruv Batra","startTime":1682.084,"endTime":1684.995,"body":"they will say that one is"},{"speaker":"Dhruv Batra","startTime":1684.995,"endTime":1688.955,"body":"taller because they don't have"},{"speaker":"Dhruv Batra","startTime":1684.995,"endTime":1688.955,"body":"a spatial understanding of depth"},{"speaker":"Dhruv Batra","startTime":1689.014,"endTime":1691.685,"body":"that things that are really"},{"speaker":"Dhruv Batra","startTime":1689.014,"endTime":1691.685,"body":"far away can actually be taller"},{"speaker":"Dhruv Batra","startTime":1691.685,"endTime":1694.699,"body":"than things that are closer"},{"speaker":"Dhruv Batra","startTime":1691.685,"endTime":1694.699,"body":"to the camera because there's"},{"speaker":"Dhruv Batra","startTime":1694.699,"endTime":1696.059,"body":"a 3D world behind the scenes."},{"speaker":"Dhruv Batra","startTime":1696.389,"endTime":1699.599,"body":"Those are still open"},{"speaker":"Dhruv Batra","startTime":1696.389,"endTime":1699.599,"body":"questions and more closer"},{"speaker":"Dhruv Batra","startTime":1699.599,"endTime":1701.759,"body":"to AI and building agents."},{"speaker":"Dhruv Batra","startTime":1701.759,"endTime":1702.989,"body":"For example, web agents."},{"speaker":"Dhruv Batra","startTime":1703.319,"endTime":1706.619,"body":"There is still a notion of"},{"speaker":"Dhruv Batra","startTime":1703.319,"endTime":1706.619,"body":"drift that happens in agents"},{"speaker":"Dhruv Batra","startTime":1706.619,"endTime":1709.439,"body":"over time that you may, you"},{"speaker":"Dhruv Batra","startTime":1706.619,"endTime":1709.439,"body":"know, you utility builds"},{"speaker":"Dhruv Batra","startTime":1709.439,"endTime":1710.579,"body":"monitoring agents, right?"},{"speaker":"Dhruv Batra","startTime":1710.639,"endTime":1713.369,"body":"Our monitoring agents"},{"speaker":"Dhruv Batra","startTime":1710.639,"endTime":1713.369,"body":"are running for months"},{"speaker":"Dhruv Batra","startTime":1713.399,"endTime":1714.689,"body":"monitoring certain topics."},{"speaker":"Dhruv Batra","startTime":1714.689,"endTime":1717.059,"body":"So you may ask for a"},{"speaker":"Dhruv Batra","startTime":1714.689,"endTime":1717.059,"body":"particular news topic"},{"speaker":"Dhruv Batra","startTime":1717.359,"endTime":1718.349,"body":"and you may monitor that."},{"speaker":"Dhruv Batra","startTime":1719.009,"endTime":1719.82,"body":"Over months."},{"speaker":"Dhruv Batra","startTime":1720.12,"endTime":1724.199,"body":"And what can happen is that"},{"speaker":"Dhruv Batra","startTime":1720.12,"endTime":1724.199,"body":"slowly the agents will drift"},{"speaker":"Dhruv Batra","startTime":1724.29,"endTime":1727.29,"body":"into tracking something"},{"speaker":"Dhruv Batra","startTime":1724.29,"endTime":1727.29,"body":"that is deviating from your"},{"speaker":"Dhruv Batra","startTime":1727.29,"endTime":1731.699,"body":"original request because"},{"speaker":"Dhruv Batra","startTime":1727.29,"endTime":1731.699,"body":"nobody has built agents that"},{"speaker":"Dhruv Batra","startTime":1731.699,"endTime":1733.32,"body":"run for months at a time."},{"speaker":"Dhruv Batra","startTime":1733.32,"endTime":1736.949,"body":"And then we can do credit"},{"speaker":"Dhruv Batra","startTime":1733.32,"endTime":1736.949,"body":"assignment and reward them"},{"speaker":"Dhruv Batra","startTime":1736.949,"endTime":1740.219,"body":"for success or failures"},{"speaker":"Dhruv Batra","startTime":1736.949,"endTime":1740.219,"body":"on those long horizons."},{"speaker":"Hannah Clark","startTime":1740.61,"endTime":1743.58,"body":"This is a really"},{"speaker":"Hannah Clark","startTime":1740.61,"endTime":1743.58,"body":"interesting pocket here."},{"speaker":"Hannah Clark","startTime":1744.404,"endTime":1748.004,"body":"Because I hadn't thought"},{"speaker":"Hannah Clark","startTime":1744.404,"endTime":1748.004,"body":"about what is the criteria"},{"speaker":"Hannah Clark","startTime":1748.004,"endTime":1751.634,"body":"for how we tell an agent that"},{"speaker":"Hannah Clark","startTime":1748.004,"endTime":1751.634,"body":"has done something correctly."},{"speaker":"Hannah Clark","startTime":1751.634,"endTime":1754.274,"body":"Generally speaking, when"},{"speaker":"Hannah Clark","startTime":1751.634,"endTime":1754.274,"body":"you get a correct output,"},{"speaker":"Hannah Clark","startTime":1754.544,"endTime":1755.745,"body":"you move on with your life."},{"speaker":"Hannah Clark","startTime":1755.745,"endTime":1758.324,"body":"You don't necessarily say, good"},{"speaker":"Hannah Clark","startTime":1755.745,"endTime":1758.324,"body":"job, that was great, or give"},{"speaker":"Hannah Clark","startTime":1758.324,"endTime":1760.634,"body":"it, you know, details about"},{"speaker":"Hannah Clark","startTime":1758.324,"endTime":1760.634,"body":"what it did correctly or not."},{"speaker":"Hannah Clark","startTime":1761.054,"endTime":1762.945,"body":"So this is interesting"},{"speaker":"Hannah Clark","startTime":1761.054,"endTime":1762.945,"body":"about feedback loops"},{"speaker":"Hannah Clark","startTime":1762.975,"endTime":1764.594,"body":"for the technology."},{"speaker":"Hannah Clark","startTime":1764.895,"endTime":1767.955,"body":"Is there a user behavior that"},{"speaker":"Hannah Clark","startTime":1764.895,"endTime":1767.955,"body":"we should be adopting in order"},{"speaker":"Hannah Clark","startTime":1767.955,"endTime":1770.205,"body":"to better train the models that"},{"speaker":"Hannah Clark","startTime":1767.955,"endTime":1770.205,"body":"we're currently depending on?"},{"speaker":"Hannah Clark","startTime":1770.205,"endTime":1772.004,"body":"Or is this something that"},{"speaker":"Hannah Clark","startTime":1770.205,"endTime":1772.004,"body":"I feel like this could be a"},{"speaker":"Hannah Clark","startTime":1772.004,"endTime":1774.87,"body":"whole other show, but how do"},{"speaker":"Hannah Clark","startTime":1772.004,"endTime":1774.87,"body":"we close the feedback loop?"},{"speaker":"Dhruv Batra","startTime":1775.665,"endTime":1779.205,"body":"Internally we do"},{"speaker":"Dhruv Batra","startTime":1775.665,"endTime":1779.205,"body":"evaluations and feedback at"},{"speaker":"Dhruv Batra","startTime":1779.205,"endTime":1780.735,"body":"multiple levels of abstraction."},{"speaker":"Dhruv Batra","startTime":1780.735,"endTime":1784.255,"body":"So we will browser automation"},{"speaker":"Dhruv Batra","startTime":1780.735,"endTime":1784.255,"body":"agents or browser use agents"},{"speaker":"Dhruv Batra","startTime":1784.555,"endTime":1786.415,"body":"We have to manually annotate."},{"speaker":"Dhruv Batra","startTime":1786.415,"endTime":1788.965,"body":"For example, every"},{"speaker":"Dhruv Batra","startTime":1786.415,"endTime":1788.965,"body":"click it does."},{"speaker":"Dhruv Batra","startTime":1789.265,"endTime":1791.785,"body":"Was it the right thing to"},{"speaker":"Dhruv Batra","startTime":1789.265,"endTime":1791.785,"body":"do at that webpage or was"},{"speaker":"Dhruv Batra","startTime":1791.785,"endTime":1792.685,"body":"it the wrong thing to do?"},{"speaker":"Dhruv Batra","startTime":1792.96,"endTime":1795.87,"body":"Now that you can imagine it's"},{"speaker":"Dhruv Batra","startTime":1792.96,"endTime":1795.87,"body":"too low level, it's too noisy."},{"speaker":"Dhruv Batra","startTime":1795.87,"endTime":1798.45,"body":"Sometimes a task can be"},{"speaker":"Dhruv Batra","startTime":1795.87,"endTime":1798.45,"body":"done in multiple ways."},{"speaker":"Dhruv Batra","startTime":1798.45,"endTime":1800.61,"body":"Maybe sometimes you"},{"speaker":"Dhruv Batra","startTime":1798.45,"endTime":1800.61,"body":"search type an item in a"},{"speaker":"Dhruv Batra","startTime":1800.61,"endTime":1801.96,"body":"search query on a webpage."},{"speaker":"Dhruv Batra","startTime":1801.96,"endTime":1805.08,"body":"Maybe sometimes you click"},{"speaker":"Dhruv Batra","startTime":1801.96,"endTime":1805.08,"body":"on a tab directly to go to"},{"speaker":"Dhruv Batra","startTime":1805.11,"endTime":1806.25,"body":"that source of information."},{"speaker":"Dhruv Batra","startTime":1806.46,"endTime":1807.99,"body":"So that's too low"},{"speaker":"Dhruv Batra","startTime":1806.46,"endTime":1807.99,"body":"level, too noisy."},{"speaker":"Dhruv Batra","startTime":1808.26,"endTime":1812.375,"body":"However, after a task is"},{"speaker":"Dhruv Batra","startTime":1808.26,"endTime":1812.375,"body":"done, maybe you asked an."},{"speaker":"For whether a 6","startTime":1813.129,"endTime":1815.86,"body":"30 PM"},{"speaker":"For whether a 6","startTime":1813.129,"endTime":1815.86,"body":"reservation was available"},{"speaker":"For whether a 6","startTime":1815.86,"endTime":1817.659,"body":"at a restaurant or not,"},{"speaker":"For whether a 6","startTime":1815.86,"endTime":1817.659,"body":"and it clicked through a"},{"speaker":"For whether a 6","startTime":1817.659,"endTime":1820.57,"body":"bunch of buttons, found a"},{"speaker":"For whether a 6","startTime":1817.659,"endTime":1820.57,"body":"restaurant, and said yes or no."},{"speaker":"For whether a 6","startTime":1820.84,"endTime":1823.959,"body":"At the end of that trajectory"},{"speaker":"For whether a 6","startTime":1820.84,"endTime":1823.959,"body":"is a proof of work, and"},{"speaker":"For whether a 6","startTime":1823.959,"endTime":1826.03,"body":"in many of these tasks"},{"speaker":"For whether a 6","startTime":1823.959,"endTime":1826.03,"body":"there is what is known as"},{"speaker":"For whether a 6","startTime":1826.03,"endTime":1827.979,"body":"a generator verifier gap."},{"speaker":"For whether a 6","startTime":1828.435,"endTime":1832.455,"body":"Verifying proof of work is"},{"speaker":"For whether a 6","startTime":1828.435,"endTime":1832.455,"body":"easier than actually solving"},{"speaker":"For whether a 6","startTime":1832.455,"endTime":1835.215,"body":"the task because solving"},{"speaker":"For whether a 6","startTime":1832.455,"endTime":1835.215,"body":"the task requires clicking"},{"speaker":"For whether a 6","startTime":1835.215,"endTime":1837.225,"body":"lots of buttons, typing the"},{"speaker":"For whether a 6","startTime":1835.215,"endTime":1837.225,"body":"right thing in the right"},{"speaker":"For whether a 6","startTime":1837.225,"endTime":1839.505,"body":"search box, going to the"},{"speaker":"For whether a 6","startTime":1837.225,"endTime":1839.505,"body":"right place in the website."},{"speaker":"For whether a 6","startTime":1839.685,"endTime":1841.725,"body":"But if an agent comes"},{"speaker":"For whether a 6","startTime":1839.685,"endTime":1841.725,"body":"back to you and says, yes,"},{"speaker":"I have found a 6","startTime":1841.755,"endTime":1844.785,"body":"30 PM"},{"speaker":"I have found a 6","startTime":1841.755,"endTime":1844.785,"body":"reservation, it, there's"},{"speaker":"I have found a 6","startTime":1844.785,"endTime":1846.315,"body":"a screenshot of a webpage."},{"speaker":"I have found a 6","startTime":1846.315,"endTime":1847.395,"body":"We can read that webpage."},{"speaker":"I have found a 6","startTime":1847.395,"endTime":1848.985,"body":"We can see whether the"},{"speaker":"I have found a 6","startTime":1847.395,"endTime":1848.985,"body":"agent was right or not."},{"speaker":"I have found a 6","startTime":1849.225,"endTime":1851.175,"body":"And so we build"},{"speaker":"I have found a 6","startTime":1849.225,"endTime":1851.175,"body":"evaluations based on that."},{"speaker":"I have found a 6","startTime":1851.46,"endTime":1854.28,"body":"Then of course there are"},{"speaker":"I have found a 6","startTime":1851.46,"endTime":1854.28,"body":"consumer facing feedback"},{"speaker":"I have found a 6","startTime":1854.28,"endTime":1858.29,"body":"mechanisms where every time our"},{"speaker":"I have found a 6","startTime":1854.28,"endTime":1858.29,"body":"agents send emails to people can"},{"speaker":"I have found a 6","startTime":1858.29,"endTime":1859.355,"body":"do thumbs up and thumbs down."},{"speaker":"I have found a 6","startTime":1860.024,"endTime":1862.814,"body":"This then naturally ties"},{"speaker":"I have found a 6","startTime":1860.024,"endTime":1862.814,"body":"into personalization."},{"speaker":"I have found a 6","startTime":1862.905,"endTime":1865.334,"body":"Sometimes there aren't"},{"speaker":"I have found a 6","startTime":1862.905,"endTime":1865.334,"body":"right or wrong answers."},{"speaker":"I have found a 6","startTime":1865.334,"endTime":1866.895,"body":"Sometimes there are"},{"speaker":"I have found a 6","startTime":1865.334,"endTime":1866.895,"body":"just preferences."},{"speaker":"I have found a 6","startTime":1867.195,"endTime":1871.185,"body":"If you are tracking a certain"},{"speaker":"I have found a 6","startTime":1867.195,"endTime":1871.185,"body":"news item and maybe you're just"},{"speaker":"I have found a 6","startTime":1871.185,"endTime":1874.544,"body":"bored of a certain direction"},{"speaker":"I have found a 6","startTime":1871.185,"endTime":1874.544,"body":"that news is heading into."},{"speaker":"I have found a 6","startTime":1874.814,"endTime":1875.83,"body":"If you were talking to a person."},{"speaker":"I have found a 6","startTime":1876.534,"endTime":1879.204,"body":"You would say, no, I"},{"speaker":"I have found a 6","startTime":1876.534,"endTime":1879.204,"body":"wanna see less of this,"},{"speaker":"I have found a 6","startTime":1879.204,"endTime":1880.284,"body":"I wanna see more of that."},{"speaker":"I have found a 6","startTime":1880.524,"endTime":1883.194,"body":"And ideally, you wanna say"},{"speaker":"I have found a 6","startTime":1880.524,"endTime":1883.194,"body":"that in natural language"},{"speaker":"I have found a 6","startTime":1883.194,"endTime":1884.814,"body":"because that's convenient."},{"speaker":"I have found a 6","startTime":1884.964,"endTime":1888.774,"body":"And so you have to build in"},{"speaker":"I have found a 6","startTime":1884.964,"endTime":1888.774,"body":"feedback mechanisms that take"},{"speaker":"I have found a 6","startTime":1888.774,"endTime":1893.094,"body":"in natural language feedback"},{"speaker":"I have found a 6","startTime":1888.774,"endTime":1893.094,"body":"and change the course of"},{"speaker":"I have found a 6","startTime":1893.58,"endTime":1895.379,"body":"agents operating in the future."},{"speaker":"Hannah Clark","startTime":1895.649,"endTime":1896.55,"body":"This"},{"speaker":"Hannah Clark","startTime":1895.649,"endTime":1896.55,"body":"is so interesting."},{"speaker":"Hannah Clark","startTime":1896.55,"endTime":1899.73,"body":"I'm thinking about this in"},{"speaker":"Hannah Clark","startTime":1896.55,"endTime":1899.73,"body":"terms of also how people tend"},{"speaker":"Hannah Clark","startTime":1899.73,"endTime":1903.81,"body":"to look at the outputs of"},{"speaker":"Hannah Clark","startTime":1899.73,"endTime":1903.81,"body":"something like ChatGPT through"},{"speaker":"Hannah Clark","startTime":1903.81,"endTime":1907.11,"body":"the lens of are we happy"},{"speaker":"Hannah Clark","startTime":1903.81,"endTime":1907.11,"body":"with this as a service rather"},{"speaker":"Hannah Clark","startTime":1907.11,"endTime":1909.54,"body":"than, are we happy with this"},{"speaker":"Hannah Clark","startTime":1907.11,"endTime":1909.54,"body":"as a technology perspective?"},{"speaker":"Hannah Clark","startTime":1909.54,"endTime":1912.29,"body":"So for example, if I'm next"},{"speaker":"Hannah Clark","startTime":1909.54,"endTime":1912.29,"body":"to a colleague and the two of"},{"speaker":"Hannah Clark","startTime":1912.29,"endTime":1914.75,"body":"us are generating, let's say,"},{"speaker":"Hannah Clark","startTime":1912.29,"endTime":1914.75,"body":"meal prep plans for the week."},{"speaker":"Hannah Clark","startTime":1915.5,"endTime":1918.62,"body":"I generate a meal prep plan and"},{"speaker":"Hannah Clark","startTime":1915.5,"endTime":1918.62,"body":"they generate a meal prep plan"},{"speaker":"Hannah Clark","startTime":1918.62,"endTime":1921.59,"body":"and it's the same meal prep"},{"speaker":"Hannah Clark","startTime":1918.62,"endTime":1921.59,"body":"plan, but I feel like it's not"},{"speaker":"Hannah Clark","startTime":1921.59,"endTime":1924.409,"body":"really got the right macros for"},{"speaker":"Hannah Clark","startTime":1921.59,"endTime":1924.409,"body":"what I was trying to target."},{"speaker":"Hannah Clark","startTime":1924.74,"endTime":1927.23,"body":"And it's just from a service"},{"speaker":"Hannah Clark","startTime":1924.74,"endTime":1927.23,"body":"perspective, it's a thumbs down."},{"speaker":"Hannah Clark","startTime":1927.409,"endTime":1929.3,"body":"But the person next to"},{"speaker":"Hannah Clark","startTime":1927.409,"endTime":1929.3,"body":"me says, well, they did"},{"speaker":"Hannah Clark","startTime":1929.3,"endTime":1930.35,"body":"exactly what I asked."},{"speaker":"Hannah Clark","startTime":1930.379,"endTime":1932.419,"body":"The output is technically"},{"speaker":"Hannah Clark","startTime":1930.379,"endTime":1932.419,"body":"correct for the"},{"speaker":"Hannah Clark","startTime":1932.419,"endTime":1933.709,"body":"specifications in the prompt."},{"speaker":"Hannah Clark","startTime":1933.8,"endTime":1934.669,"body":"This is a thumbs up."},{"speaker":"Hannah Clark","startTime":1934.879,"endTime":1937.669,"body":"It sounds a very confusing,"},{"speaker":"Hannah Clark","startTime":1934.879,"endTime":1937.669,"body":"and there's a real nuance"},{"speaker":"Hannah Clark","startTime":1937.669,"endTime":1941.6,"body":"there about how we understand"},{"speaker":"Hannah Clark","startTime":1937.669,"endTime":1941.6,"body":"what our role as givers of"},{"speaker":"Hannah Clark","startTime":1941.81,"endTime":1943.909,"body":"feedback to these machines is."},{"speaker":"Hannah Clark","startTime":1944.269,"endTime":1946.069,"body":"That's a whole other"},{"speaker":"Hannah Clark","startTime":1944.269,"endTime":1946.069,"body":"data set that can be very"},{"speaker":"Hannah Clark","startTime":1946.069,"endTime":1946.939,"body":"difficult to work with."},{"speaker":"Dhruv Batra","startTime":1947.299,"endTime":1950.389,"body":"The traditional"},{"speaker":"Dhruv Batra","startTime":1947.299,"endTime":1950.389,"body":"notions of AB testing."},{"speaker":"Dhruv Batra","startTime":1950.629,"endTime":1952.669,"body":"You know, anytime you're"},{"speaker":"Dhruv Batra","startTime":1950.629,"endTime":1952.669,"body":"building a feature, split users"},{"speaker":"Dhruv Batra","startTime":1952.669,"endTime":1956.479,"body":"into two groups, show one set of"},{"speaker":"Dhruv Batra","startTime":1952.669,"endTime":1956.479,"body":"responses to one or as strategy."},{"speaker":"Dhruv Batra","startTime":1956.479,"endTime":1959.149,"body":"Pity does show parallel"},{"speaker":"Dhruv Batra","startTime":1956.479,"endTime":1959.149,"body":"responses to the same user."},{"speaker":"Dhruv Batra","startTime":1959.149,"endTime":1960.259,"body":"Ask them to pick one."},{"speaker":"Dhruv Batra","startTime":1960.559,"endTime":1962.719,"body":"That breaks down"},{"speaker":"Dhruv Batra","startTime":1960.559,"endTime":1962.719,"body":"in a lot of cases."},{"speaker":"Dhruv Batra","startTime":1963.049,"endTime":1966.049,"body":"For example, anytime you"},{"speaker":"Dhruv Batra","startTime":1963.049,"endTime":1966.049,"body":"have to execute a workflow"},{"speaker":"Dhruv Batra","startTime":1966.049,"endTime":1968.809,"body":"and buy something or do"},{"speaker":"Dhruv Batra","startTime":1966.049,"endTime":1968.809,"body":"something, there's no AB test"},{"speaker":"Dhruv Batra","startTime":1968.809,"endTime":1971.089,"body":"'cause you're not going to"},{"speaker":"Dhruv Batra","startTime":1968.809,"endTime":1971.089,"body":"do the same thing two times."},{"speaker":"Dhruv Batra","startTime":1971.329,"endTime":1972.829,"body":"Your user is frustrated by that."},{"speaker":"Dhruv Batra","startTime":1973.194,"endTime":1976.944,"body":"The second, sometimes thumbs"},{"speaker":"Dhruv Batra","startTime":1973.194,"endTime":1976.944,"body":"up and thumbs down or AB"},{"speaker":"Dhruv Batra","startTime":1976.944,"endTime":1981.294,"body":"reactions are just too coarse"},{"speaker":"Dhruv Batra","startTime":1976.944,"endTime":1981.294,"body":"for a user really to convey"},{"speaker":"Dhruv Batra","startTime":1981.294,"endTime":1982.254,"body":"what they're trying to say."},{"speaker":"Dhruv Batra","startTime":1982.614,"endTime":1985.734,"body":"And sometimes you want to give"},{"speaker":"Dhruv Batra","startTime":1982.614,"endTime":1985.734,"body":"them the ability, if you're"},{"speaker":"Dhruv Batra","startTime":1985.734,"endTime":1989.334,"body":"sending them textual responses,"},{"speaker":"Dhruv Batra","startTime":1985.734,"endTime":1989.334,"body":"is to highlight something"},{"speaker":"Dhruv Batra","startTime":1989.334,"endTime":1994.254,"body":"and say, not this, or be more"},{"speaker":"Dhruv Batra","startTime":1989.334,"endTime":1994.254,"body":"editorial in their feedback as"},{"speaker":"Dhruv Batra","startTime":1994.254,"endTime":1995.904,"body":"they would to another human."},{"speaker":"Dhruv Batra","startTime":1996.114,"endTime":1999.465,"body":"You know, if you were taking a"},{"speaker":"Dhruv Batra","startTime":1996.114,"endTime":1999.465,"body":"pass on someone's Google Doc,"},{"speaker":"Dhruv Batra","startTime":1999.735,"endTime":2002.284,"body":"you wouldn't just give them"},{"speaker":"Dhruv Batra","startTime":1999.735,"endTime":2002.284,"body":"a thumbs up or a thumbs down."},{"speaker":"Hannah Clark","startTime":2003.425,"endTime":2004.504,"body":"Oh, that"},{"speaker":"Hannah Clark","startTime":2003.425,"endTime":2004.504,"body":"would be horrible."},{"speaker":"Hannah Clark","startTime":2004.985,"endTime":2005.435,"body":"A thumbs down."},{"speaker":"Hannah Clark","startTime":2005.435,"endTime":2006.844,"body":"What part of it is thumbs down."},{"speaker":"Dhruv Batra","startTime":2006.844,"endTime":2007.324,"body":"Exactly."},{"speaker":"Dhruv Batra","startTime":2008.135,"endTime":2008.405,"body":"Yeah."},{"speaker":"Dhruv Batra","startTime":2008.645,"endTime":2010.625,"body":"This is like, you know,"},{"speaker":"Dhruv Batra","startTime":2008.645,"endTime":2010.625,"body":"going to your editor and"},{"speaker":"Dhruv Batra","startTime":2010.625,"endTime":2012.995,"body":"just hearing No, fix it."},{"speaker":"Dhruv Batra","startTime":2013.205,"endTime":2013.625,"body":"Fix what?"},{"speaker":"Hannah Clark","startTime":2013.805,"endTime":2013.865,"body":"Yeah."},{"speaker":"Hannah Clark","startTime":2015.155,"endTime":2016.14,"body":"Do the whole thing over again."},{"speaker":"Hannah Clark","startTime":2016.715,"endTime":2017.225,"body":"Yeah."},{"speaker":"Hannah Clark","startTime":2017.285,"endTime":2017.825,"body":"Oh wow."},{"speaker":"Hannah Clark","startTime":2018.004,"endTime":2020.254,"body":"And of course, you know,"},{"speaker":"Hannah Clark","startTime":2018.004,"endTime":2020.254,"body":"that's asking a lot."},{"speaker":"Hannah Clark","startTime":2020.254,"endTime":2023.015,"body":"Even if we did have the"},{"speaker":"Hannah Clark","startTime":2020.254,"endTime":2023.015,"body":"capabilities to say, you"},{"speaker":"Hannah Clark","startTime":2023.015,"endTime":2027.065,"body":"know, go into an output on"},{"speaker":"Hannah Clark","startTime":2023.015,"endTime":2027.065,"body":"an LLMs output or an LLMs"},{"speaker":"Hannah Clark","startTime":2027.065,"endTime":2030.245,"body":"response to us and give that"},{"speaker":"Hannah Clark","startTime":2027.065,"endTime":2030.245,"body":"kind of critical feedback,"},{"speaker":"Hannah Clark","startTime":2030.245,"endTime":2033.185,"body":"that's a lot to ask of an user"},{"speaker":"Hannah Clark","startTime":2030.245,"endTime":2033.185,"body":"that just wants it to work."},{"speaker":"Hannah Clark","startTime":2033.514,"endTime":2035.264,"body":"Generally speaking it's"},{"speaker":"Hannah Clark","startTime":2033.514,"endTime":2035.264,"body":"difficult enough to get"},{"speaker":"Hannah Clark","startTime":2035.264,"endTime":2037.485,"body":"people to, you know, respond"},{"speaker":"Hannah Clark","startTime":2035.264,"endTime":2037.485,"body":"to surveys even if they've"},{"speaker":"Hannah Clark","startTime":2037.485,"endTime":2040.215,"body":"got a referral code or some"},{"speaker":"Hannah Clark","startTime":2037.485,"endTime":2040.215,"body":"kind of bonus in it for them."},{"speaker":"Hannah Clark","startTime":2040.575,"endTime":2040.814,"body":"Yeah."},{"speaker":"Hannah Clark","startTime":2040.814,"endTime":2044.445,"body":"It makes a very difficult"},{"speaker":"Hannah Clark","startTime":2040.814,"endTime":2044.445,"body":"co-authoring task to ask folks"},{"speaker":"Hannah Clark","startTime":2044.445,"endTime":2046.215,"body":"to, to help you co-author."},{"speaker":"Hannah Clark","startTime":2046.425,"endTime":2048.165,"body":"Anyway, what I'm getting from"},{"speaker":"Hannah Clark","startTime":2046.425,"endTime":2048.165,"body":"this is that we really need"},{"speaker":"Hannah Clark","startTime":2048.165,"endTime":2051.444,"body":"to expect a lot less from you."},{"speaker":"Dhruv Batra","startTime":2051.844,"endTime":2054.364,"body":"And I think"},{"speaker":"Dhruv Batra","startTime":2051.844,"endTime":2054.364,"body":"they have to feel like that"},{"speaker":"Dhruv Batra","startTime":2054.364,"endTime":2058.594,"body":"feedback is an investment into"},{"speaker":"Dhruv Batra","startTime":2054.364,"endTime":2058.594,"body":"personalization of the chat"},{"speaker":"Dhruv Batra","startTime":2058.594,"endTime":2061.564,"body":"bot towards something that"},{"speaker":"Dhruv Batra","startTime":2058.594,"endTime":2061.564,"body":"they want to be able to do."},{"speaker":"Dhruv Batra","startTime":2061.894,"endTime":2065.854,"body":"That the user cannot"},{"speaker":"Dhruv Batra","startTime":2061.894,"endTime":2065.854,"body":"be your QA engineer."},{"speaker":"Dhruv Batra","startTime":2066.064,"endTime":2068.284,"body":"They cannot tell you all the"},{"speaker":"Dhruv Batra","startTime":2066.064,"endTime":2068.284,"body":"things that are wrong with the"},{"speaker":"Dhruv Batra","startTime":2068.284,"endTime":2071.734,"body":"product, but what they can, the"},{"speaker":"Dhruv Batra","startTime":2068.284,"endTime":2071.734,"body":"experience you want them to have"},{"speaker":"Dhruv Batra","startTime":2071.944,"endTime":2073.774,"body":"is that this is my assistant."},{"speaker":"Dhruv Batra","startTime":2073.955,"endTime":2077.475,"body":"And therefore any feedback"},{"speaker":"Dhruv Batra","startTime":2073.955,"endTime":2077.475,"body":"I give to this assistant is"},{"speaker":"Dhruv Batra","startTime":2077.745,"endTime":2081.074,"body":"personalizing it and making"},{"speaker":"Dhruv Batra","startTime":2077.745,"endTime":2081.074,"body":"it better and aligning"},{"speaker":"Dhruv Batra","startTime":2081.074,"endTime":2082.755,"body":"it to my preferences."},{"speaker":"Dhruv Batra","startTime":2083.055,"endTime":2085.455,"body":"That feels like the"},{"speaker":"Dhruv Batra","startTime":2083.055,"endTime":2085.455,"body":"right relationship or the"},{"speaker":"Dhruv Batra","startTime":2085.455,"endTime":2087.675,"body":"engagement mechanism, why"},{"speaker":"Dhruv Batra","startTime":2085.455,"endTime":2087.675,"body":"they might put in time."},{"speaker":"Hannah Clark","startTime":2088.434,"endTime":2089.244,"body":"Yeah,"},{"speaker":"Hannah Clark","startTime":2088.434,"endTime":2089.244,"body":"I would agree."},{"speaker":"Hannah Clark","startTime":2089.244,"endTime":2092.214,"body":"I tend to feel that I'm a"},{"speaker":"Hannah Clark","startTime":2089.244,"endTime":2092.214,"body":"lot more patient with a model"},{"speaker":"Hannah Clark","startTime":2092.214,"endTime":2095.664,"body":"that is more forthcoming with"},{"speaker":"Hannah Clark","startTime":2092.214,"endTime":2095.664,"body":"trying to learn my preferences."},{"speaker":"Hannah Clark","startTime":2096.304,"endTime":2099.004,"body":"I feel often when you're"},{"speaker":"Hannah Clark","startTime":2096.304,"endTime":2099.004,"body":"doing a query and some kind"},{"speaker":"Hannah Clark","startTime":2099.004,"endTime":2102.424,"body":"of an LLM and it right off"},{"speaker":"Hannah Clark","startTime":2099.004,"endTime":2102.424,"body":"the bat asks for questions"},{"speaker":"Hannah Clark","startTime":2102.424,"endTime":2104.914,"body":"to further refine, even if"},{"speaker":"Hannah Clark","startTime":2102.424,"endTime":2104.914,"body":"they seem a little trivial."},{"speaker":"Hannah Clark","startTime":2104.914,"endTime":2108.244,"body":"To me, it kind of reinforces"},{"speaker":"Hannah Clark","startTime":2104.914,"endTime":2108.244,"body":"this behavior that whatever"},{"speaker":"Hannah Clark","startTime":2108.244,"endTime":2111.244,"body":"I'm telling them has to be"},{"speaker":"Hannah Clark","startTime":2108.244,"endTime":2111.244,"body":"a lot more specific than"},{"speaker":"Hannah Clark","startTime":2111.244,"endTime":2113.524,"body":"I anticipate in order to"},{"speaker":"Hannah Clark","startTime":2111.244,"endTime":2113.524,"body":"get the output that I want."},{"speaker":"Hannah Clark","startTime":2113.644,"endTime":2116.044,"body":"And it kind of prepares"},{"speaker":"Hannah Clark","startTime":2113.644,"endTime":2116.044,"body":"me for disappointment if"},{"speaker":"Hannah Clark","startTime":2116.044,"endTime":2117.634,"body":"I'm not quite on base."},{"speaker":"Hannah Clark","startTime":2117.934,"endTime":2118.894,"body":"And so I think that this is."},{"speaker":"Hannah Clark","startTime":2119.219,"endTime":2122.189,"body":"Something important to kind"},{"speaker":"Hannah Clark","startTime":2119.219,"endTime":2122.189,"body":"of keep in mind when we're"},{"speaker":"Hannah Clark","startTime":2122.189,"endTime":2126.089,"body":"developing features that require"},{"speaker":"Hannah Clark","startTime":2122.189,"endTime":2126.089,"body":"some sort of give and take from"},{"speaker":"Hannah Clark","startTime":2126.089,"endTime":2128.819,"body":"a user in order to kind of get"},{"speaker":"Hannah Clark","startTime":2126.089,"endTime":2128.819,"body":"the output that we all want."},{"speaker":"Dhruv Batra","startTime":2129.059,"endTime":2131.159,"body":"This is where"},{"speaker":"Dhruv Batra","startTime":2129.059,"endTime":2131.159,"body":"we go back to the, you know,"},{"speaker":"Dhruv Batra","startTime":2131.189,"endTime":2133.169,"body":"climbing the staircase of trust."},{"speaker":"Dhruv Batra","startTime":2133.229,"endTime":2136.439,"body":"If the very first thing"},{"speaker":"Dhruv Batra","startTime":2133.229,"endTime":2136.439,"body":"you do to a user who's just"},{"speaker":"Dhruv Batra","startTime":2136.439,"endTime":2140.279,"body":"trying to experience your"},{"speaker":"Dhruv Batra","startTime":2136.439,"endTime":2140.279,"body":"product is give them a 20"},{"speaker":"Dhruv Batra","startTime":2140.279,"endTime":2141.659,"body":"question questionnaire."},{"speaker":"Dhruv Batra","startTime":2142.199,"endTime":2144.179,"body":"They're just trying to get"},{"speaker":"Dhruv Batra","startTime":2142.199,"endTime":2144.179,"body":"to delight and they wanna"},{"speaker":"Dhruv Batra","startTime":2144.179,"endTime":2147.089,"body":"build a quick model of what"},{"speaker":"Dhruv Batra","startTime":2144.179,"endTime":2147.089,"body":"you can do and then they"},{"speaker":"Dhruv Batra","startTime":2147.089,"endTime":2148.469,"body":"will iterate from there."},{"speaker":"Dhruv Batra","startTime":2148.739,"endTime":2151.709,"body":"So it can't be the very first"},{"speaker":"Dhruv Batra","startTime":2148.739,"endTime":2151.709,"body":"thing you bombard your user"},{"speaker":"Dhruv Batra","startTime":2151.709,"endTime":2156.049,"body":"with, but as they see some"},{"speaker":"Dhruv Batra","startTime":2151.709,"endTime":2156.049,"body":"value, you can inject in those"},{"speaker":"Dhruv Batra","startTime":2156.049,"endTime":2157.129,"body":"questions and preferences."},{"speaker":"Hannah Clark","startTime":2157.399,"endTime":2159.47,"body":"I'm curious"},{"speaker":"Hannah Clark","startTime":2157.399,"endTime":2159.47,"body":"at this point, why now?"},{"speaker":"Hannah Clark","startTime":2159.47,"endTime":2160.759,"body":"Why have you started Yutori now?"},{"speaker":"Hannah Clark","startTime":2160.939,"endTime":2164.859,"body":"Why is this the moment that"},{"speaker":"Hannah Clark","startTime":2160.939,"endTime":2164.859,"body":"you've decided to start"},{"speaker":"Hannah Clark","startTime":2164.859,"endTime":2167.889,"body":"this project and what's"},{"speaker":"Hannah Clark","startTime":2164.859,"endTime":2167.889,"body":"fundamentally different about"},{"speaker":"Hannah Clark","startTime":2167.889,"endTime":2171.129,"body":"the landscape right now that"},{"speaker":"Hannah Clark","startTime":2167.889,"endTime":2171.129,"body":"makes this possible to exist"},{"speaker":"Hannah Clark","startTime":2171.339,"endTime":2173.739,"body":"versus, you know, you've been"},{"speaker":"Hannah Clark","startTime":2171.339,"endTime":2173.739,"body":"in the game for a long time."},{"speaker":"Hannah Clark","startTime":2173.739,"endTime":2174.279,"body":"Why not then?"},{"speaker":"Dhruv Batra","startTime":2174.609,"endTime":2177.159,"body":"I am of course,"},{"speaker":"Dhruv Batra","startTime":2174.609,"endTime":2177.159,"body":"susceptible to hindsight"},{"speaker":"Dhruv Batra","startTime":2177.159,"endTime":2181.059,"body":"bias, but my feeling is that"},{"speaker":"Dhruv Batra","startTime":2177.159,"endTime":2181.059,"body":"this is a unique time in"},{"speaker":"Dhruv Batra","startTime":2181.059,"endTime":2185.229,"body":"building certain kinds of"},{"speaker":"Dhruv Batra","startTime":2181.059,"endTime":2185.229,"body":"AI powered products that we"},{"speaker":"Dhruv Batra","startTime":2185.229,"endTime":2186.369,"body":"couldn't build in the past."},{"speaker":"Dhruv Batra","startTime":2187.029,"endTime":2190.989,"body":"I was doing robotics before"},{"speaker":"Dhruv Batra","startTime":2187.029,"endTime":2190.989,"body":"I could have spun out and"},{"speaker":"Dhruv Batra","startTime":2190.989,"endTime":2193.929,"body":"started a robotics startup, and"},{"speaker":"Dhruv Batra","startTime":2190.989,"endTime":2193.929,"body":"there's no shortage of those."},{"speaker":"Dhruv Batra","startTime":2193.929,"endTime":2194.769,"body":"There's plenty of those."},{"speaker":"Dhruv Batra","startTime":2195.069,"endTime":2198.849,"body":"I don't think this is the right"},{"speaker":"Dhruv Batra","startTime":2195.069,"endTime":2198.849,"body":"time to start a consumer or a"},{"speaker":"Dhruv Batra","startTime":2198.909,"endTime":2202.959,"body":"unstructured focused robotics"},{"speaker":"Dhruv Batra","startTime":2198.909,"endTime":2202.959,"body":"company because the kinds of"},{"speaker":"Dhruv Batra","startTime":2202.959,"endTime":2206.024,"body":"problems to be solved, there"},{"speaker":"Dhruv Batra","startTime":2202.959,"endTime":2206.024,"body":"are still decades ahead of us."},{"speaker":"Dhruv Batra","startTime":2206.599,"endTime":2207.529,"body":"I think people forget."},{"speaker":"Dhruv Batra","startTime":2207.829,"endTime":2211.91,"body":"2004 is when this government"},{"speaker":"Dhruv Batra","startTime":2207.829,"endTime":2211.91,"body":"agency called DARPA organized"},{"speaker":"Dhruv Batra","startTime":2211.91,"endTime":2216.2,"body":"the DARPA Grand Challenge,"},{"speaker":"Dhruv Batra","startTime":2211.91,"endTime":2216.2,"body":"asking universities to build"},{"speaker":"Dhruv Batra","startTime":2216.2,"endTime":2219.229,"body":"an autonomous self-driving"},{"speaker":"Dhruv Batra","startTime":2216.2,"endTime":2219.229,"body":"cars that could drive from"},{"speaker":"Dhruv Batra","startTime":2219.229,"endTime":2220.939,"body":"point A to point B in a desert."},{"speaker":"Dhruv Batra","startTime":2221.329,"endTime":2223.339,"body":"2004 was the first time"},{"speaker":"Dhruv Batra","startTime":2221.329,"endTime":2223.339,"body":"that was organized."},{"speaker":"Dhruv Batra","startTime":2223.579,"endTime":2224.959,"body":"No car finished."},{"speaker":"Dhruv Batra","startTime":2225.019,"endTime":2226.769,"body":"I was at CMU at 2005."},{"speaker":"Dhruv Batra","startTime":2226.769,"endTime":2229.109,"body":"CMU, you know, went the"},{"speaker":"Dhruv Batra","startTime":2226.769,"endTime":2229.109,"body":"furthest and the first"},{"speaker":"Dhruv Batra","startTime":2229.109,"endTime":2232.619,"body":"attempt, 2005, is when multiple"},{"speaker":"Dhruv Batra","startTime":2229.109,"endTime":2232.619,"body":"university teams finished."},{"speaker":"Dhruv Batra","startTime":2233.329,"endTime":2236.389,"body":"Late two thousands is when a"},{"speaker":"Dhruv Batra","startTime":2233.329,"endTime":2236.389,"body":"bunch of Stanford researchers"},{"speaker":"Dhruv Batra","startTime":2236.389,"endTime":2237.739,"body":"get absorbed into Google."},{"speaker":"Dhruv Batra","startTime":2237.739,"endTime":2240.889,"body":"It becomes initially Google"},{"speaker":"Dhruv Batra","startTime":2237.739,"endTime":2240.889,"body":"X and then mid two thousands"},{"speaker":"Dhruv Batra","startTime":2240.889,"endTime":2242.119,"body":"with the Waymo project."},{"speaker":"Dhruv Batra","startTime":2242.509,"endTime":2246.229,"body":"And then ultimately in"},{"speaker":"Dhruv Batra","startTime":2242.509,"endTime":2246.229,"body":"2023 or 2024 is when we"},{"speaker":"Dhruv Batra","startTime":2246.229,"endTime":2248.419,"body":"get consumer facing apps."},{"speaker":"Dhruv Batra","startTime":2248.479,"endTime":2252.229,"body":"Where in San Francisco, you can"},{"speaker":"Dhruv Batra","startTime":2248.479,"endTime":2252.229,"body":"call a Waymo to your doorstep"},{"speaker":"Dhruv Batra","startTime":2252.229,"endTime":2253.789,"body":"or to certain pickup locations."},{"speaker":"Dhruv Batra","startTime":2254.089,"endTime":2258.229,"body":"And think about that journey"},{"speaker":"Dhruv Batra","startTime":2254.089,"endTime":2258.229,"body":"from 2004 or 2005, which was the"},{"speaker":"Dhruv Batra","startTime":2258.229,"endTime":2262.939,"body":"first research prototype demo"},{"speaker":"Dhruv Batra","startTime":2258.229,"endTime":2262.939,"body":"to a consumer facing product."},{"speaker":"Dhruv Batra","startTime":2263.324,"endTime":2265.304,"body":"Is available, at least"},{"speaker":"Dhruv Batra","startTime":2263.324,"endTime":2265.304,"body":"in certain geographic"},{"speaker":"Dhruv Batra","startTime":2265.304,"endTime":2267.824,"body":"locations, it's still not"},{"speaker":"Dhruv Batra","startTime":2265.304,"endTime":2267.824,"body":"been universally rolled out."},{"speaker":"Dhruv Batra","startTime":2268.274,"endTime":2270.254,"body":"Universal rollout is,"},{"speaker":"Dhruv Batra","startTime":2268.274,"endTime":2270.254,"body":"you know, still maybe"},{"speaker":"Dhruv Batra","startTime":2270.254,"endTime":2271.304,"body":"another decade ahead of us."},{"speaker":"Dhruv Batra","startTime":2271.679,"endTime":2276.449,"body":"That is the challenge"},{"speaker":"Dhruv Batra","startTime":2271.679,"endTime":2276.449,"body":"of hardware plus AI in"},{"speaker":"Dhruv Batra","startTime":2276.449,"endTime":2279.959,"body":"software plus AI development"},{"speaker":"Dhruv Batra","startTime":2276.449,"endTime":2279.959,"body":"cycles are much closer."},{"speaker":"Dhruv Batra","startTime":2280.259,"endTime":2284.429,"body":"We are finally at a place"},{"speaker":"Dhruv Batra","startTime":2280.259,"endTime":2284.429,"body":"where AI systems can talk"},{"speaker":"Dhruv Batra","startTime":2284.489,"endTime":2287.999,"body":"to people, so there's broad"},{"speaker":"Dhruv Batra","startTime":2284.489,"endTime":2287.999,"body":"knowledge of the world being"},{"speaker":"Dhruv Batra","startTime":2287.999,"endTime":2288.814,"body":"able to hold a dialogue."},{"speaker":"Dhruv Batra","startTime":2289.404,"endTime":2292.554,"body":"Perception systems have"},{"speaker":"Dhruv Batra","startTime":2289.404,"endTime":2292.554,"body":"matured, at least on the web."},{"speaker":"Dhruv Batra","startTime":2292.614,"endTime":2296.514,"body":"So we can take a screenshot"},{"speaker":"Dhruv Batra","startTime":2292.614,"endTime":2296.514,"body":"of the web and we can know"},{"speaker":"Dhruv Batra","startTime":2296.514,"endTime":2299.814,"body":"how websites are laid out,"},{"speaker":"Dhruv Batra","startTime":2296.514,"endTime":2299.814,"body":"which buttons do what."},{"speaker":"Dhruv Batra","startTime":2300.084,"endTime":2302.364,"body":"There's certain broad-based"},{"speaker":"Dhruv Batra","startTime":2300.084,"endTime":2302.364,"body":"common sense understanding."},{"speaker":"Dhruv Batra","startTime":2302.724,"endTime":2307.074,"body":"And finally, the third thing,"},{"speaker":"Dhruv Batra","startTime":2302.724,"endTime":2307.074,"body":"open source models have been"},{"speaker":"Dhruv Batra","startTime":2307.074,"endTime":2310.074,"body":"released over the last couple"},{"speaker":"Dhruv Batra","startTime":2307.074,"endTime":2310.074,"body":"of years, which allow smaller"},{"speaker":"Dhruv Batra","startTime":2310.074,"endTime":2312.744,"body":"players such as ourselves"},{"speaker":"Dhruv Batra","startTime":2310.074,"endTime":2312.744,"body":"to at least get started."},{"speaker":"Dhruv Batra","startTime":2313.154,"endTime":2317.174,"body":"A few years ago, if we had to"},{"speaker":"Dhruv Batra","startTime":2313.154,"endTime":2317.174,"body":"build a web automation or a web"},{"speaker":"Dhruv Batra","startTime":2317.174,"endTime":2320.324,"body":"agent startup, we would have"},{"speaker":"Dhruv Batra","startTime":2317.174,"endTime":2320.324,"body":"to start from pre-training."},{"speaker":"Dhruv Batra","startTime":2320.654,"endTime":2323.714,"body":"Pre-training of language models"},{"speaker":"Dhruv Batra","startTime":2320.654,"endTime":2323.714,"body":"and vision language models is"},{"speaker":"Dhruv Batra","startTime":2323.714,"endTime":2328.304,"body":"an entirely different enterprise"},{"speaker":"Dhruv Batra","startTime":2323.714,"endTime":2328.304,"body":"with an entirely different"},{"speaker":"Dhruv Batra","startTime":2328.604,"endTime":2331.364,"body":"set of capital investments"},{"speaker":"Dhruv Batra","startTime":2328.604,"endTime":2331.364,"body":"and compute requirements"},{"speaker":"Dhruv Batra","startTime":2331.364,"endTime":2332.384,"body":"and data requirements."},{"speaker":"Dhruv Batra","startTime":2332.744,"endTime":2336.704,"body":"Today, we post train models,"},{"speaker":"Dhruv Batra","startTime":2332.744,"endTime":2336.704,"body":"meaning that we start from open"},{"speaker":"Dhruv Batra","startTime":2336.704,"endTime":2337.899,"body":"source models that have been."},{"speaker":"Dhruv Batra","startTime":2338.539,"endTime":2340.729,"body":"Open source vision language"},{"speaker":"Dhruv Batra","startTime":2338.539,"endTime":2340.729,"body":"models, and we post them"},{"speaker":"Dhruv Batra","startTime":2340.729,"endTime":2343.329,"body":"for browser automation,"},{"speaker":"Dhruv Batra","startTime":2340.729,"endTime":2343.329,"body":"clicking buttons filling"},{"speaker":"Dhruv Batra","startTime":2343.329,"endTime":2344.229,"body":"out forms and so on."},{"speaker":"Dhruv Batra","startTime":2344.439,"endTime":2346.544,"body":"That will not be"},{"speaker":"Dhruv Batra","startTime":2344.439,"endTime":2346.544,"body":"possible a few years ago."},{"speaker":"Dhruv Batra","startTime":2347.194,"endTime":2351.934,"body":"And simultaneously, this is"},{"speaker":"Dhruv Batra","startTime":2347.194,"endTime":2351.934,"body":"not a problem that has long"},{"speaker":"Dhruv Batra","startTime":2351.934,"endTime":2356.284,"body":"iteration cycles and is still"},{"speaker":"Dhruv Batra","startTime":2351.934,"endTime":2356.284,"body":"a decade plus ahead of us."},{"speaker":"Dhruv Batra","startTime":2356.554,"endTime":2360.874,"body":"The way I think of it is there"},{"speaker":"Dhruv Batra","startTime":2356.554,"endTime":2360.874,"body":"is no possible world in which"},{"speaker":"Dhruv Batra","startTime":2360.934,"endTime":2364.054,"body":"robots have arrived into our"},{"speaker":"Dhruv Batra","startTime":2360.934,"endTime":2364.054,"body":"homes, but we are still sitting"},{"speaker":"Dhruv Batra","startTime":2364.054,"endTime":2366.964,"body":"on our laptops, typing our"},{"speaker":"Dhruv Batra","startTime":2364.054,"endTime":2366.964,"body":"names into browser fields like"},{"speaker":"Dhruv Batra","startTime":2367.024,"endTime":2371.584,"body":"digital assistance will arrive"},{"speaker":"Dhruv Batra","startTime":2367.024,"endTime":2371.584,"body":"before physical assistance"},{"speaker":"Dhruv Batra","startTime":2371.584,"endTime":2373.474,"body":"do and digital assistance."},{"speaker":"Dhruv Batra","startTime":2373.849,"endTime":2375.649,"body":"Because it's a"},{"speaker":"Dhruv Batra","startTime":2373.849,"endTime":2375.649,"body":"purely digital realm."},{"speaker":"Dhruv Batra","startTime":2375.919,"endTime":2377.869,"body":"The world of bits"},{"speaker":"Dhruv Batra","startTime":2375.919,"endTime":2377.869,"body":"just moves faster."},{"speaker":"Dhruv Batra","startTime":2378.019,"endTime":2382.309,"body":"It has faster ation cycles,"},{"speaker":"Dhruv Batra","startTime":2378.019,"endTime":2382.309,"body":"and a lot of the substrate"},{"speaker":"Dhruv Batra","startTime":2382.339,"endTime":2385.429,"body":"on which we can develop"},{"speaker":"Dhruv Batra","startTime":2382.339,"endTime":2385.429,"body":"these intelligent systems has"},{"speaker":"Dhruv Batra","startTime":2385.429,"endTime":2389.119,"body":"commoditized so we can focus"},{"speaker":"Dhruv Batra","startTime":2385.429,"endTime":2389.119,"body":"on the last mile problems."},{"speaker":"Hannah Clark","startTime":2389.629,"endTime":2391.279,"body":"Oh, that's"},{"speaker":"Hannah Clark","startTime":2389.629,"endTime":2391.279,"body":"a very eloquent answer."},{"speaker":"Hannah Clark","startTime":2391.489,"endTime":2393.859,"body":"Also, love the use of"},{"speaker":"Hannah Clark","startTime":2391.489,"endTime":2393.859,"body":"the word substrate."},{"speaker":"Hannah Clark","startTime":2394.249,"endTime":2397.729,"body":"This has been a thoroughly"},{"speaker":"Hannah Clark","startTime":2394.249,"endTime":2397.729,"body":"fascinating conversation."},{"speaker":"Hannah Clark","startTime":2397.729,"endTime":2400.219,"body":"I feel like we could have"},{"speaker":"Hannah Clark","startTime":2397.729,"endTime":2400.219,"body":"gone so much deeper, and"},{"speaker":"Hannah Clark","startTime":2400.219,"endTime":2401.749,"body":"I'm sure that a lot of"},{"speaker":"Hannah Clark","startTime":2400.219,"endTime":2401.749,"body":"folks would love to do that."},{"speaker":"Hannah Clark","startTime":2401.749,"endTime":2404.089,"body":"So where can folks"},{"speaker":"Hannah Clark","startTime":2401.749,"endTime":2404.089,"body":"follow your work online?"},{"speaker":"Dhruv Batra","startTime":2404.329,"endTime":2406.829,"body":"I'm available"},{"speaker":"Dhruv Batra","startTime":2404.329,"endTime":2406.829,"body":"personally at dhruvbatra.com."},{"speaker":"Dhruv Batra","startTime":2406.849,"endTime":2407.959,"body":"That's my webpage."},{"speaker":"Dhruv Batra","startTime":2407.989,"endTime":2411.679,"body":"My work is available"},{"speaker":"Dhruv Batra","startTime":2407.989,"endTime":2411.679,"body":"at yutori.com and our"},{"speaker":"Dhruv Batra","startTime":2411.709,"endTime":2413.209,"body":"product is called Scouts."},{"speaker":"Dhruv Batra","startTime":2413.209,"endTime":2415.329,"body":"It's available at"},{"speaker":"Dhruv Batra","startTime":2413.209,"endTime":2415.329,"body":"scouts.yutori.com."},{"speaker":"Hannah Clark","startTime":2415.519,"endTime":2415.879,"body":"Amazing."},{"speaker":"Hannah Clark","startTime":2415.879,"endTime":2417.499,"body":"Well, thank you so much"},{"speaker":"Hannah Clark","startTime":2415.879,"endTime":2417.499,"body":"for joining me Dhruv, I"},{"speaker":"Hannah Clark","startTime":2417.499,"endTime":2418.459,"body":"really appreciate this."},{"speaker":"Dhruv Batra","startTime":2418.669,"endTime":2419.569,"body":"Thank"},{"speaker":"Dhruv Batra","startTime":2418.669,"endTime":2419.569,"body":"you for having me."},{"speaker":"Dhruv Batra","startTime":2419.629,"endTime":2420.199,"body":"This was wonderful."},{"speaker":"Hannah Clark","startTime":2423.349,"endTime":2425.089,"body":"Next on The"},{"speaker":"Hannah Clark","startTime":2423.349,"endTime":2425.089,"body":"Product Manager podcast."},{"speaker":"Hannah Clark","startTime":2425.449,"endTime":2428.389,"body":"Leading product in the age of AI"},{"speaker":"Hannah Clark","startTime":2425.449,"endTime":2428.389,"body":"means solving many of the same"},{"speaker":"Hannah Clark","startTime":2428.389,"endTime":2430.189,"body":"problems in very different ways."},{"speaker":"Hannah Clark","startTime":2430.489,"endTime":2432.799,"body":"From development processes"},{"speaker":"Hannah Clark","startTime":2430.489,"endTime":2432.799,"body":"to distribution tactics,"},{"speaker":"Hannah Clark","startTime":2432.889,"endTime":2435.439,"body":"just about every playbook"},{"speaker":"Hannah Clark","startTime":2432.889,"endTime":2435.439,"body":"that worked a year ago is"},{"speaker":"Hannah Clark","startTime":2435.499,"endTime":2438.769,"body":"already outdated—which Webflow"},{"speaker":"Hannah Clark","startTime":2435.499,"endTime":2438.769,"body":"CPO Rachel Wolan considers"},{"speaker":"Hannah Clark","startTime":2438.769,"endTime":2441.139,"body":"both a challenge and an"},{"speaker":"Hannah Clark","startTime":2438.769,"endTime":2441.139,"body":"incredible opportunity."},{"speaker":"Hannah Clark","startTime":2441.529,"endTime":2443.239,"body":"You'll get the answers"},{"speaker":"Hannah Clark","startTime":2441.529,"endTime":2443.239,"body":"and clarity you've been"},{"speaker":"Hannah Clark","startTime":2443.239,"endTime":2445.849,"body":"waiting for on topics like"},{"speaker":"Hannah Clark","startTime":2443.239,"endTime":2445.849,"body":"answer engine optimization,"},{"speaker":"Hannah Clark","startTime":2446.139,"endTime":2448.909,"body":"build-versus-buy, and the right"},{"speaker":"Hannah Clark","startTime":2446.139,"endTime":2448.909,"body":"way to enter the AI market."},{"speaker":"Hannah Clark","startTime":2449.029,"endTime":2450.469,"body":"Subscribe now so"},{"speaker":"Hannah Clark","startTime":2449.029,"endTime":2450.469,"body":"you don't miss it."}]}