Welcome to AIAW News, a special segment of the Artificial Intelligence After Work (AIAW) Podcast, where we bring you the latest and most impactful developments in the world of AI. This week, we explore innovations from industry giants, revealing how AI is reshaping our digital experiences.
1. Sam Altman Seeks Trillions of Dollars to Reshape Business of Chips and AI (WSJ): Sam Altman, the CEO of OpenAI and a prominent figure in Silicon Valley, is leading a bold initiative to raise trillions of dollars to transform the chip and AI industries. This ambitious endeavor aims to fund advancements in AI research and development, particularly in the realm of large-scale models like GPT. Altman envisions a future where AI technologies become more efficient and accessible, enabling breakthroughs in various fields such as healthcare, transportation, and entertainment. By harnessing the power of AI and reimagining the traditional semiconductor business model, Altman hopes to revolutionize the way society interacts with technology.
1. Memory and New Controls for ChatGPT (OpenAI Blog): OpenAI introduces enhancements to ChatGPT, a state-of-the-art language model, focusing on memory and control mechanisms. These improvements aim to address limitations in conversation context retention and model behavior management. With the introduction of a memory mechanism, ChatGPT can now better recall previous parts of the conversation, facilitating more coherent and context-aware responses. Additionally, new control mechanisms provide users with greater influence over the model's output, allowing for fine-tuning of responses based on specific preferences or guidelines. These advancements represent significant strides in improving the performance and usability of ChatGPT, enhancing its capabilities for various applications ranging from customer service to creative writing.
Follow us on youtube: https://www.youtube.com/@aiawpodcast
Speaker 1:
It's time for AI News brought to you by AI AW podcast.
Speaker 2:
So we've been trying this new thing during the autumn to have a small break in the middle of the podcast and then we go back to the discussion and hopefully back to the open source question, which I'd love to discuss more with you, anastasia, about. But let's do a few minutes of some topic that we all speak about. I can start because I have one connected to the very topic we just spoke about.
Speaker 1:
Yeah. So just, anastasia, if you have a topic of something you read in the news that you think is newsworthy. The last week more or less, so everything was happening so fast so we thought, okay, what is the major headline news in the field of AI? If you have it, you have it, otherwise, no worry about it.
Speaker 2:
Okay, miss last week.
Speaker 1:
Anders, you go first.
Speaker 2:
Well, during the last week I think it happened last week before this, but anyway it's been one story that's been over the media quite a lot and that's at Sam Oldman, the. Now still again the CEO of OpenAI is apparently raising money for a new ship company, and it's nothing new. We heard about Rain AI and it was like a couple of billions of dollars, like I need 50 billion dollars for that, but now suddenly they are speaking about raising five to seven trillion dollars.
Speaker 1:
Which is an obscene amount if you think about the GDP of countries in the world.
Speaker 2:
It is absurd. I mean, if you take the, I think the market cap for Microsoft now is three billion. Apple is like, yeah, it's likely below, and then you say they are raising this amount of money. You know, I'm an investor myself and you know if they are raising that amount of money, it should be valued at least four or five, perhaps ten times this. If you take a company that's valued, let's say, five times, to have it in a low range to that is like 30, 40 billion sorry, trillion dollars, that's like. That's like amount of all the publicly traded companies combined, but it's like insane amount of money.
Speaker 1:
But why is he doing it then? Because then you need to unpack this. Is this used to marketing stunt? Like the onslaught of comments on this obscene number? There are many angles to this. So how did you want to unpack that? Because that he said it could Is the marketing stunt. You know what was your take on it.
Speaker 2:
I really don't know and I hate to speculate this much, but I think it's such an important topic that we have to speculate even though we know nothing basically about it. But you know, sam has himself commented on it on XO. It can't be completely rumored, but perhaps it's a marketing stunt.
Speaker 1:
But OK.
Speaker 1:
So the backdrop is maybe important if you, if not fully into this is like we were talking about the semiconductor business and that has been super concentrated to Taiwan and to actually one company in the world.
Speaker 1:
Who's who has sort of such a world dominance. And I think during the covid, in different ways, we have seen how fragile are the whole supply chains has been on this. So I think everybody grew up, if not before, so from the scone, yes, to whatever company that we have, the semiconductor shortage and in the end in the geopolitical powers. I think Sam is basically doing a very simple job is going to the people that has a geopolitical interest and say, hey, man, it's time to get into the game. And then if you, if you go back then and have sort of studied the semiconductor business and there is some really interesting books you can read on on the history of semiconductors, the entry ticket, you know, into that game, you know we're talking now building foundries and stuff like that, the foundational stuff you know to to to get stuff done, and this is massive. And then you add the new morphic to that story.
Speaker 2:
This is not. This is a rain.
Speaker 1:
I don't think this is going to rain, going to go new morphic I think.
Speaker 2:
Yeah, but I don't think the seven trillion thing OK.
Speaker 1:
Do you mean the seven trillion? Is you semiconductor in general? I?
Speaker 2:
don't know what it is, but I think it's more than rain.
Speaker 1:
Yeah, but I think rain could be part of it, but I don't think that's no, but I think the bottom line is that this is a geopolitical play by some old man where he basically raises the super riches and the super powers, who sort of thinks we need to be in control of this destiny here and we we need to, we need to dominate this, and then maybe those money makes sense. I don't know.
Speaker 2:
Imagine going to some investor. You know he's going to. He went to like.
Speaker 1:
Saudi.
Speaker 2:
Arabia, or this Saudi Aramaic, the biggest oil producer in the world, and they are currently invested in rain, I believe. But they were declined later by US because of your political reasons, exactly. But you know, to go to someone and say I want to raise seven trillion dollars, and then someone, what? What do you mean? They have to have such a pitch deck to this one to say that you're going to invest more money than any company in the world is even worth today. I mean they must have you know. Then you can see so many conspiracies, theories about this. They are saying of course this is AGI, of course they have now approved, you know, if anyone going to put in seven trillion, of course they have been able to prove that they have AGI in house and that's why they're getting this.
Speaker 1:
But you know that is just conspiracy theories.
Speaker 2:
We don't know if this is true.
Speaker 1:
But in the end you know if you take it all the way back, even if it's just a stunt. Yeah, it works, yeah it works because it raises the stock price of Microsoft. Even it raises all this.
Speaker 2:
What do you think, anastasia, about this crazy racing money funding? I'm on the cynical side. You don't think it's a stunt?
Speaker 1:
Yeah, but I think there was some other interesting comments in relation to that. It's I can't exactly phrase the article I read, I can't quote it, but it was more or less like a little bit like what has the world come to when someone? You know, how are we thinking philosophically as human species when we can, and how can we let them capitalist view on this dictate these topics? So something is fundamental. I mean, like there was an article that there is some fundamentally flawed thinking here, and not not precise amount minus stuff like that, but more what has the world come to?
Speaker 1:
I mean like I don't know if you read a couple of those articles as well, so there was a lot of commentary on this.
Speaker 2:
It's the person of obscene, obscene. Yeah, all right, let's leave that.
Speaker 1:
I have another one and, but I almost let you do it, but I can lead into it. Open eye rolls out chat GPT memory to select users. What is that all about, Anders? Oh, thank you for dropping that. I put the news on, but you but okay, so.
Speaker 2:
I can start it. I think it is an interesting one, right? Yeah, it's very interesting.
Speaker 1:
But I can start, but you need to take it up. So open AI has begun rolling out memory capabilities to select number of jeopardy users. Okay, interesting. So we can now control the memory. We can put it off and on, but I think you know the interesting point that I think to some degree is missing in some of these comments is what it means. I think the articles I read now has done a pretty poor job in sort of wow, what's the wow factor of the memory topic here?
Speaker 2:
So help me here. No, but this is back to the rag. I mean, if you were to guess what they have done, it's simply adding rag to chatty bt and then putting that you know for every user, and they put it to GPTS as well as separate you know memories. So, in short, it's the since chatty bt can't be fine tuned quickly and the only added or other way to go forward to be able to quickly adapt to what you have said recently is to have some kind of memory added to it. So this is perfectly the short term working memory kind of thing that you add on top of the large language model that contain the basic knowledge and you think but it has no short term knowledge versus long term knowledge than in two separate parts.
Speaker 2:
And, of course, it's super powerful. It can remember. You know, if you I want to always summarize the lay a quarterly report from this company in this format, then you don't have to say it the next time. You just, you know, send it in and it remembers. You know your preferences and whatnot, and it knows your children.
Speaker 2:
It knows everything you wanted to change, but that should. It did have a feature, if I don't recall incorrectly, to raise memory. This was kind of interesting. You can, of course, turn it off If you don't want it to have memory of what you have said before. You can turn it off completely. You can also say this I want you to memorize and never forget, maybe, but you can also go in and see what it has memorized and delete parts that you don't like. Imagine if I could do that to you, henry. Henry, please remove these memories from the death nights.
Speaker 1:
Exactly, you know the karaoke. Please remove this karaoke experience. It would be awesome. But, anders, you almost said it like. This is, you know, the short term memory, or adding memory is a little bit, but you know you could call that is what we are doing with the rag. So if this is a large language model and when we add in rag, as we discussed before, it's a little bit like the short term memory, do you think? Do you think that's the technique here?
Speaker 2:
Or is it something else? I don't think that. Short term yes.
Speaker 1:
You think that's what it do. You understand that that's literally what. When they say memory, it seems fancy and all this, but it's something that allows you to then put in your, your own text. I'm kind of sure of it. I'm not sure if you haven't looked into it, but no, I don't, because it's so interesting. Right, the technicians get a hold of it and we call it something you know strange rag retrieval what?
Speaker 2:
is it Retrieval? Augmented generation?
Speaker 1:
Retrieval, augmented generation, and then, when the marketeers get ahead of get, get a hold of it. Memory. Well, you know.
Speaker 2:
so I mean it's obviously some kind of rag based technique. They simply have some passage of text that they or other type of content.
Speaker 1:
They remember over a session, but and and do you think people would like this? Because I can take another angle on this. Like that, it feels kind of safe. I feel like if I'm, if I'm an enterprise, we have using them over there. But the rag thing I want to be having my own control and I do it, even if I'm doing it shitty it's in my server, sort of thing. Well, now I'm going to do my thing inside the other thing. So I think there's a there's a question here. Will, okay, you can use the memory feature, but do you want to use the memory feature? Rather, do your own rag at home? I think it's also a matter of you know, controlling your data here.
Speaker 2:
Yeah, but so many people are not aware of that problem, I think. Yeah, and then maybe it's it's Gary, the first time and our first months, but then you get used to it.
Speaker 1:
It's going to be so much more seamless, of course.
Speaker 2:
It's like putting data on Facebook, you know it's.
Speaker 1:
It's scary, but everyone does it. Yeah, Anyway, so the memory part. And then they launched that this is some sort of alpha beta. I guess it's not really out there yet for us to try, so we don't know yet.