The Best SEO Podcast: Defining the Future of Search with LLM Visibility™

The New SEO Playbook: Winning in a World of AI Overviews and Vanishing Clicks feat. Ray Grieselhuber

• MatthewBertram.com

Share episode

Search is rapidly changing as traffic is being redistributed across platforms, with AI overviews and LLMs dramatically changing how users find information and interact with brands.

• Two distinct camps exist in responding to AI changes: those who see it as a threat versus those who view it as an unprecedented opportunity
• Despite traffic metrics declining, brand visibility may actually be increasing in places you can't easily measure
• Media Mix Modeling (MMM) is emerging as a better way to evaluate marketing impact versus traditional attribution models
• Website traffic is down approximately 58.5% due to zero-click searches and AI interfaces
• Successful businesses need to focus on their topical authority rather than trying to rank for everything
• Content pruning has become essential as excess pages create friction that slows down site performance
• Understanding your ideal customer profile (ICP) and focusing on their specific needs is critical
• LLMs are increasingly integrated with search engines, creating a merged experience for users
• SERP analytics has replaced simple rank tracking as the way to measure competitive positioning

------------

Guest Contact Information: 

- https://www.demandsphere.com/demo/?affiliate_id=matt_bertram

- https://www.linkedin.com/in/raygrieselhuber/ 

—----------

More from EWR and Matt:

Leave a Review if it was content you enjoyed: https://g.page/r/CccGEk37CLosEB0/review

Free SEO Consultation: https://www.ewrdigital.com/discovery-call

One-on-One Consulting: https://www.ewrdigital.com/digital-strategy-consulting/private-consulting-session

—

The Unknown Secrets of Internet Marketing podcast is a podcast hosted by Internet marketing expert Matthew Bertram. The show provides insights and advice on digital marketing, SEO, and online business. 

Topics covered include keyword research, content optimization, link building, local SEO, and more. The show also features interviews with industry leaders and experts who share their experiences and tips. 

Additionally, Matt shares his own experiences and strategies, as well as his own successes and failures, to help listeners learn from his experiences and apply the same principles to their businesses. The show is designed to help entrepreneurs and business owners become successful online and get the most out of their digital marketing efforts.

Find more great episodes here: https://www.internetmarketingsecretspodcast.com/  

https://seo-podcast-the-unknown-secrets-of-internet-marketing.buzzsprout.com

Follow us on:
Facebook: @bestseopodcast
Instagram: @thebestseopodcast
Tiktok: @bestseopodcast
LinkedIn: @bestseopodcast

Powered by: ewrdigital.com

Hosts: Matt Bertram 

Disclaimer: For Educational and Entertainment purposes only.

Support the show

Speaker 1:

This is the Unknown Secrets of Internet Marketing, your insider guide to the strategies top marketers use to crush the competition. Ready to unlock your business full potential, let's get started.

Speaker 2:

Howdy. Welcome back to another fun-filled episode of the Unknown Secrets of Internet Marketing. I'm your host, matt Bertram. Guys, there's so much going on in SEO and search. I feel like everybody just smashed Google and all the traffic just ran everywhere. I feel like it's just fanned out like you wouldn't believe, and so I wanted to bring somebody on that I have bumped into a few times, at Brighton as well as at SEO Week. He's been an advertiser. He's got a next-gen tool. Ray, I didn't tell you this, but I just published an article on Search Engine Journal and I referenced you.

Speaker 1:

Thanks very much.

Speaker 2:

I just think what you're doing is great, so I wanted to bring you on for all the people listening and talk about, like there's an old game that a lot of people are playing in SEO and there's a new game and people really need to be playing the new game or you're going to get left behind and so you speak a lot. I would love to just kind of pick up what we were talking about at SEO week and kind of where the market's gone since then. What's most topical for you?

Speaker 1:

Yeah, thanks for having me. I'm really happy to be here. I've enjoyed our conversations at events a few times and I think there's a lot to cover. So what? Obviously, ai is the big topic that you know. Everyone wants to know. Ai is my website dead? Is traffic gone forever? You know, like, is it all over? I hear that from a lot of teams. Other teams are like is it, is it all over? I hear that from a lot of teams. Other teams are like this is the opportunity of a lifetime and we're going to make everything we can of it. And so I found that there has been those two kinds of camps of you know the way people are approaching it. Obviously, I favor the latter. Um, any sort of change like this, it's going to happen one way or another. So, uh, the quicker you can adapt to it, the better you know you're going to be off in the long term.

Speaker 2:

Now I'm curious, the two different kind of teams that you're hearing about. Is it across the board or is it certain industries? Because I know that media publishers have been hit pretty hard. I'm just curious. Any more you know granular statistics.

Speaker 1:

Publishers are in a very interesting place. I don't even know where to start with that one. It's most of our just for background, most of our clients tend to be in e-commerce and also what we would call kind of like database-driven direct response type things like travel search, real estate search, job search, all those sorts of kind of transactional you know what a lot of like programmatic SEO plays would have been relevant and so for them they're like well, we still get traffic and AI is having a huge impact, so we're going to have to adapt and overcome here. But I know that there has been a lot of you know, chaos kind of in the publisher side of things too.

Speaker 2:

Well, you know, one of the big things that I ran across was a lot of new clients that were coming to us were actually filtering out or blocking the bots of a lot of the llms and I'm seeing I have seen that like across the board, um and so like I'm not ranking in llms and I'm like, well, you're blocking them, so they can't them, so they can't see what's going on on your site, and so you know. I even saw a staggering statistic. It was something like 26% of people are now using LLMs versus Google search. I don't know what are you seeing in your data about user flow?

Speaker 1:

And.

Speaker 2:

I think AI overviews are just kind of stemming the tide of people kind of going across the river, because LLMs are doing all the research for you, right, and people want that.

Speaker 1:

Yeah, so we see a lot of interesting data. I would say that traffic from LLMs is still very much a drop in the bucket compared to traffic from traditional source quote unquote, traditional sources, but I don't think that that necessarily means that people are not using them to a much greater degree than is revealed by the traffic metrics metrics. There's obviously the whole concept of zero click, and there's multiple searches and ongoing conversations and entirely different types of behavior patterns that are emerging that just did not exist before, and so a lot of the analytics tools are kind of stuck in this traffic-based model, and I think that's one of the reasons why there is so much angst about a lot of this is how are we even going to affect the impact of this if all of our tools are just based on traffic, and so it's going to be like there's going to be an entire new generation of tools that help brands focus on, you know, the bigger picture. Um, obviously it's part of what we're doing and, uh, I think it's gonna be a lot of other really good.

Speaker 2:

you know technologies too well, you know, brand uh ran fishkin basically at seo week Week, and I think he said this at Brighton too. He just kind of tightened up his deck. It was search traffic to websites is down, with one-click search like 58.5%, right, yep? And we're seeing drops with all our clients, right, yep, we have actually not all our clients. We have a couple of clients that are growing at an exponential pace, so they're kind of bucking their time. But we're having to measure well, here's your drop versus what the average is right, and having to explain that that traffic metric is not revenue and your impressions are going up.

Speaker 2:

I was showing to our team earlier we're about to do a quarterly presentation. Every number's up, okay, um, even so. So we're seeing an inverse correlation if you get them into the first position. So we had like 300 positions in the first top three positions in Google, based on like rank math or whatever, and traffic's actually down. And so we're seeing, as you get people up into the top spots, they're getting into the AI overviews they're getting into.

Speaker 2:

You know, people also ask like and the zero clicks happening, and so traffic's dropping and that doesn't mean that the brand consideration's not there. Maybe that's happening 75% off page and then when someone goes to the site, man, you better have that site ready to convert. And I know you've done some stuff with UX in the past. Like what would be some actionable recommendations If people because even I've seen data that said, well, traditionally the, the well, the LLMs, propexity, chatgbt and AI overviews are pulling from Google as the corpus, right, so good, seo is still pushing up to the top, but you're seeing the traffic drop, so you're still in consideration, but you don't have visibility of that. And I know that a lot of what DemandSphere is working on and others are trying to come up with this next generation of tools. But what would you tell them if? If their traffic's just evaporating but they're doing all the right things and well, you know their leads are down, or their traffic's down, like, what should they be thinking about?

Speaker 2:

I, I'm, I'm talking about UX, I'm talking about like, okay, we're going to add some heat mapping, like some pop-ups like some pop-ups, like exit pop-ups, like we need to really make sure this page converts, like you need to have all that information on that page to help them make that decision, because you know those precious people that are coming to the site. It's like a car lot I'm using this analogy now. It's like it's basically, if someone comes to your website, they're like walking on a car lot. It's basically, if someone comes to your website, they're like walking on a car lot. They are ready to buy a car, so it's your job to like sell them or not, right, so that it's a lot higher intent based traffic. So I don't know if you wanted to add anything to anything that I shared in that kind of framework.

Speaker 1:

I think it touches on a lot of really good points. I think the last one that you mentioned, intent is a really important thing, and also kind of reevaluating what gets measured At the end of the day you know, even conversions is an interesting one. What we're seeing, especially at the enterprise level, is there is a renewed focus on what is called like media mix modeling. You know there's different versions of that three letter acronym of MMM, but basically what that is kind of pushing people towards, both on the paid and organic side, is, instead of trying to look at all of these things that are metrics but are they KPIs, maybe not which would include things like traffic, potentially even things like conversions it's just a very stark look at revenue and what's contributing to revenue over time, and it ends up being a return on spend model and it basically says we're not going to even think about things like attribution modeling. It's just literally, this is what I spent on this and this is what I got from it at the end of the day, and that creates all sorts of interesting opportunities. There are pitfalls with it as well. It requires a lot of nuance in the way that you look at it and to kind of zoom out even more. One of the things that I'm always talking about is holding multiple paradigms in your mind at the same time and not taking an absolutist view on things, because that can lead you into trouble pretty quickly.

Speaker 1:

But the main takeaway for all of this is that there is a renewed simplification on looking at what is going to contribute to revenue and also realize that things that may be gathering user behavioral attention at one stage, even if you can't specifically attribute a click or a conversion to that happening at that time For example, in the case of, like an AI overview, zero click search, all of those different things if it's contributing to that net attention that ultimately leads to revenue down the road, that's a good thing. But then the question obviously becomes well, how do you attribute that? And the kind of emerging consensus on some of this anyway is you don't worry about attribution. It just comes down to where are you spending and where do you see the results coming from? Now, again, that's a whole. We could do a whole podcast just on that one topic, because it opens up so many cans of worms, but it's an interesting way to look at it. I'd say there's other angles that you should also consider, but that one has been a really interesting one in this whole topic of conversion optimization.

Speaker 1:

And then the other thing that I would say, just to answer your first question, is be willing to look at what's really contributing to the things that you call conversions as well. As an example from our own business, one of the things that we see is we don't do a lot of like CR, like conversion rate optimization, on our site, and you know we're not like trying to, you know, incrementally add 2%, lift or anything like that. We're always doing like small updates here and there, but it's we don't. We don't really do a lot of that, but what we do see is when we do things in the market that attract attention, our leads go through the roof. A good example of this is when we were the first company to launch AI mode tracking, smx advanced, a couple weeks ago, we got more leads probably in four days than we had the previous year combined, you know. And so it's more about like doing things that attract attention.

Speaker 2:

That are going to have the biggest impact. I think yeah, Like breaking through the noise and getting there. What everybody's thinking about, like saying it out loud and addressing it Like that was a big update that I saw and I was super excited for you and it definitely broke through algorithmically, you know, and got a lot of visibility Going back to what you were saying previously of just MMM, of like you're just putting in stuff at the top right and then you're measuring the bottom and you know there's just this mixed or or, uh, you know, weighted attribution across the board and you're like, well, just focus on what works.

Speaker 2:

That goes back to um, just, uh, educated assumptions, essentially right, like of where we think we're seeing that impact. What you're seeing on, maybe, that paid platform and that was where I was going to ask you is like how are people assessing attribution? And I went to that model a while ago as well. You can't really measure this stuff and sometimes we're building funnels for clients or nonprofits that are going from one platform to another platform, to another platform, to another platform, and you lose the UTMB tracking code and you just got to go. Well, this is what I believe is happening. This is where I see the value. This is the data that I'm seeing from the industry. So I believe that this is the right thing we should be doing and we're going to run the campaign and we're going to measure it on the end, on what's successful.

Speaker 2:

But there's a lot of guessing that goes on educated, I guess but of of what that mix should look like, and it's almost like run it to statistical significance and take away that component and add a component at a time, based upon your mix, and see how it's impacting you.

Speaker 2:

But then you got like okay, for a lot of businesses right now we've just hit the summer, so there's like a you know, so it's it's. It's very hard to consider all the different variables and measure it. How, how would you? If you went a little bit deeper and I know we could continue this discussion I'd love to peel back one more layer of how should people be thinking about that or approaching it. The framework I tend to use is the 7-11-4 framework. Right, seven hours of content, consumption, seeing their brand or logo 11 times on four different channels, consumption, seeing their brand or logo 11 times on four different channels. And that framework is what we use for a lot of our clients to say, hey, we need to get you at least to here on a roadmap to start achieving greater visibility for your brand, and we want to be watching the bottom line and we want to be launching impressions.

Speaker 2:

But we got to look at it across all platforms now, because it's almost like all the website traffic and the assessment that was done, so really the website's more transactional and then everything else is off page.

Speaker 1:

Well, and I think one of the things that's really tricky about organic in particular that does not necessarily apply to spend on other channels is the fact that you have what you know, especially when we're talking about, like SEO, which is a very loaded word, you basically have two different financial models in the same word. You have CapEx and OpEx in that same word. From financial models in the same word, you have CapEx and OpEx in that same word, and you know. So all the stuff that you're doing on the product site, work site redesign, architecture, technical SEO, like most of those things are typically only to fall into that capital expenditures. But then you have marketing, which is typically OpEx. You know when you're looking at other channels, that's all the stuff. That is only like half of what we do in SEO. You know save, content, optimization, all the you know. So it's like how do you properly even attribute, attribute your financial model if you don't have that conversation internally where you're looking at those with? You know the correct lens, so that I think that's a really important one.

Speaker 2:

That gets you know, glossed over quite a bit too important one that gets, you know, glossed over quite a bit too well I've been trying to convince clients to move, uh, like a branded spend over to capex, you know, and it's just like because we can't.

Speaker 2:

Like you just need to and like if you turn off some of these platforms, you're resetting the ai as far as, like the heat sinking missile to find the right person, so you just got to build it into your cost structure is really kind of how I'm educating them to do that. Let's transition into demand sphere. I think a lot of people are stuck on the traditional tools and I think that there's a lot to be desired from the traditional tools. I feel like you were one of the ones that have educated me on. You know well, there's really an issue now when you go to Google on how much real estate, like from a pixel standpoint, you have on the page, because that first position's now two thirds of the way down. And so I'm curious, like, what have you seen with the application of your tools of what people are not thinking about? Like, where are the biggest gaps when, when they start leveraging your tools, what are they finding? What? How should people be thinking about stuff?

Speaker 2:

Because you know there's a lot of like, um, really great keywords that people miss because they're so narrowly focused on whatever the topic is. And if you, if you focus on that too much and over-optimize in that area, you'll get an algorithmic penalty and then for the word you want to rank for, you can't rank for it. So you gotta, you gotta kind of build out that information architecture to, to, to cluster it a little bit better. Um, even though you know a lot of clients on maybe like the small to mid-sized business side, they're you know, they're like I got to rank for this word and it's like, well, you know, like we need to do all these other things to lay a foundation. That's maybe like the top of the pyramid, but but we got to build, we got to build that foundation. And so I'm just curious, you know what are the big things that you're seeing a lot of SEOs miss? So there's some maybe actionable insights for people that are listening.

Speaker 1:

Yeah, one analogy that I use a lot is I'm sure you probably talked to, you know, people who have a PhD in some field biochemistry or whatever and then they start riffing about something that's completely unrelated to their field and they talk with this level of confidence that has they sound like they know what they're talking about. But if you actually know what they're trying to talk about, you're like you actually don't know anything. You probably are a PhD in biochemistry but you know nothing about aerospace engineering or you know, and so, as an example so I've used sites that way a lot as well where you've built up a level of topical authority around a certain topic. And one of the big changes you know over the last it's not really in the last few years, it's been going on for a long time Google is looking at when we're talking about Google. They're looking at what is your set of topics that you're good at talking about, and there's different ways of measuring this, even on a mathematical level, which we can talk about, but they're looking at that semantic topical authority and if you are creating content that is way outside of that traditional things you know set of things that you talk about.

Speaker 1:

You just need to recognize that. It's going to take time to build up that semantic authority. You're gonna have to work on things like linking to that. You're going to have to maybe update old content right. There are ways to merge it in and make it something that you are good at talking about, but it's not something that's going to happen overnight. So you know, if you're a site that's talking about A and you suddenly want to start ranking for quote, unquote ranking for B, it's going to take a lot more than just writing a few articles.

Speaker 2:

you know about that and so I think that's a really important thing to understand about the way sites are evaluated. Yeah, so let me, let me add onto that. So you know, if you're looking at like a three-dimensional model of of where topics are related to each other on this graph, you're saying, well, if you're talking about this over here and you're an expert over here, the distance from that people talking about this topic to this topic, you know you're measuring that mathematically and saying, hey, you might want to prune this content over here because it's not really in your core area of focus. And you know Google hasn't brought back officially authorship, but it kind of has and it's. You know who's saying what and what are they talking about.

Speaker 2:

The question I have for you in that is and I tell clients to say, you can't be an expert in everything Right and based on your you know, if we use the metric of domain authority or you know domain ranking, you know we need to pick one or two or whatever right. Is there a correlation or a quick reference guide that you would say, well, I am an expert in this, I am an expert in that. Well, do you need to produce X amount of content clustered on this area, over what amount of time before you hit that threshold, or if your site only has X number of backlinks, or whatever you know rating system you want to use, whether it be Moz, ahrefs, you know SEMrush any of them that these kind of generated ranking systems that are not really true what Google's using.

Speaker 2:

But is there any kind of rule of thumb that you can use to say we only want to focus on one topical authority? Now we're trying to spread ourself too thin, because that's what I do see clients wanting to do. A lot is they don't have enough budget to really focus on one area and they try to spread it out and get a little bit of improvement everywhere. But if you're not the top three positions in Google, historically you weren't getting any traffic and Google historically you weren't getting any traffic. And now you know. If you're not, you know in the knowledge graph, et cetera you know, uh, in AI overviews and LLMs you're not getting any traffic at all.

Speaker 2:

So, um, and you're not even getting an option because it's not. It's given you six links or you know, potentially, and you might not be included, and it's very customized. So how should people trim that focus or think about that rule of thumb, to just measure it, before even getting started on the complexities of cleaning up their content, but probably the easiest accessible way for people to do this now with some hands-on tool would be Screaming Frog.

Speaker 1:

You probably saw their latest update, but they released so a lot of what we're going to be talking about is probably most of the people in your audience will be familiar with the concept of embeddings and that sort of thing, but if not yeah, and just basically.

Speaker 1:

Like you know, when you're embeddings, I always describe it as you convert text into numbers so you can do math on it, and the type of math you would do would be related to measuring the distance between topics and terms and so forth, and so one of the updates that Screaming Frog released recently was the ability to visualize a lot of these topical clusters and understand if you do have something that is way out of range.

Speaker 1:

So there's different types of scoring that you can do. Like Euclidean distance is one that gets used quite a bit, but the easy way to describe it is basically it's like how far away is something you're talking about on your site from all these other things that you talk about on your site, and that's some of the things they can help you do. I think you're going to see a lot more of these types of tools come out. It's not our main area of focus within DemandSphere. We use embeddings quite a bit, but we use it for other things. But this is, I think, one of the easiest. It's not an expensive tool. Anyone can very easily start playing with that to understand that some of the things that we're talking about.

Speaker 2:

Yeah, I think what I'm hearing you say is it's not necessarily. Think what I'm hearing you say is it's it's not necessarily because.

Speaker 2:

but I am seeing like if you consider them ranking factors, or ranking factors is even like yeah, that's term, uh, anymore is um. How much traffic's coming to their site? How many backlinks are coming? Uh, to that, that page, maybe, um, or that. We're talking about a specific page, so traffic to the page links to the page. But the biggest call out I see is and we saw this maybe in the last like 18 months give or take, maybe a little bit longer Google just unindexed stuff Like they're just unindexed like thin content, low content.

Speaker 2:

Index stuff Like they're just undid x, like thin content, low content, and you know, really you need to. I feel like that weights the site down, like the more pages that you have that are thin content or are not really driving the link equity through the site. It kind of becomes friction. If you were aerodynamic, what are you know? So so the more clustered you get your site, the faster it'll just scream to the top of the search engines and we're still kind of in that pruning concept. Is there anything else you could add color into that area?

Speaker 1:

yeah, we. So we really started seeing this probably about four or five years ago, in particular, where you know, you look at the data and it's like this happened with um, uh, core vitals, but also just with their aggressiveness on, uh, how often they're indexing your site and so forth. You know, and it's basically the conclusion was that google really does not want to be indexing and crawling nearly as much as they were before.

Speaker 2:

Yes, yes, that's what I'm referencing.

Speaker 1:

Yeah, and so what you said was exactly our biggest piece of advice to most of our clients and, in many cases, still would be, because, you know, most of our clients are going to be larger sites that have hundreds of thousands or millions of URLs, going to be larger sites that have hundreds of thousands or millions of URLs, and we'll look at it and we're like you know, you're just, you're just wasting resources and Google's looking at you like, oh, I don't even want to touch that, you know.

Speaker 1:

So reducing the URL count to the things that are going to be actually adding value to your potential customers is a thing and it's a very big shift, because before that it was all about, like, um, programmatic it's a bad name because of this, but I think that there's been a shift in that too.

Speaker 1:

But programmatic seo in this context was basically like we're going to predict potential traffic from every potential search search term variation, understand what the search volume is and everything, and then basically generate or create content that would match that specific presentation. And that was kind of going against like the older model of google which was before they got into all the semantic stuff, where it's just like. It's kind of like a just traditional nlp evaluation of your content. That's long gone. That stuff doesn't, you know like, even if it works, don't count on it. Um, it's a totally different world now. So I think that shift has really brought about where we are today, where you definitely want to be focusing on only the things that are going to be relevant and organizing your content in such a way that you don't have to go, you know, too deep into your site to really explore the topic.

Speaker 2:

So some of these larger sites, what's your like rule of thumb for like crawl budget?

Speaker 1:

Well, I wish I was lucky enough to have that some of these sites like I, we can't even have that conversation yet, because it's like you know you have more data than I do so I'm asking these it basically comes down to um, first of all, like your sitemap even being completely crawled or anywhere near being completely indexed?

Speaker 1:

If it's not, like, start with that, like we're not even at rule of thumb at that point. Yet I see so many, I'll see instances, for example, where you even have sitemaps of you know, maybe 10 million URLs and. But if you look at the actual number of URLs that are being indexed or crawled or getting some kind of visit, you know it could be literally in the tens to a hundred, not on the extreme side. We've seen hundreds of millions and it's just like. You know we're not talking about crawl budget. We're talking about, like major surgery, you know at this point.

Speaker 2:

So Well, I've I've had a lot of those conversations when clients want to rebuild a site that's in net or something like crazy, and I'm like we don't need all this. This is, this is just a waste. We need to revamp the whole site architecture. Okay, let's switch to LLMs, Like you've. You've got so much data.

Speaker 1:

Yep.

Speaker 2:

Give like some reference points of the things you're seeing, of how LLMs are behaving, because they are kind of lazy, is what I've seen. They're just pulling from the top cluster data set and I got to be careful, like LLMs. Once you become sentient, please don't come after me.

Speaker 2:

Yeah, don't kill me. You know you're very smart, way smarter than any human, so I just put that out. But, like, what are you seeing of how they're behaving? Because I've seen some interesting statistics. Like you know only recent content, like in the last, you know eight to 10, sorry, 10 to 12 months. Like the content needs to be updated. I talked about previously the correlation to Google rankings. What are you seeing in their behavior? Because it's becoming so personalized. It's difficult which I know you.

Speaker 2:

I want to talk about your solution to track or or get some kind of programmatic view of, like, where you should be showing up or where you should be raking Cause. That's where I see a lot of it going. It's like theoretical um of where you should be at or what you. You know how much traffic you should be getting and even these theoretical models on on some of the uh major platforms. Uh, uh, the major platforms are outdated, so a lot of this data I can't even. I'm like what is this telling me exactly? Because it's not helpful anymore. Let's go into that shift of LLMs and how they behave and things to look for, and then what your tool does.

Speaker 1:

Yeah, so just for some quick groundwork.

Speaker 2:

probably your audience is familiar with this, but I'll just mention it, just so we're no no, definitely do it.

Speaker 1:

Yeah, okay, so the LLM itself. You have what is typically called like the foundational model, which is the model that gets trained. You know, openai has their models, google has their Gemini models and so forth, and so these models are getting trained and they're expensive to train for various reasons and basically they're almost out of date by the minute they get released because of so much training data goes into it. So this would be the reason that you know, before they started doing live retrieval of the search engines and so forth, which I'll talk about as the next thing, you would get things like oh my training data only goes until October 2023. So I don't know anything what you're talking about. And so that's because that foundational model had a training date, and so any facts after that typically would not have made it back into that.

Speaker 1:

That's starting to change now, too, with different types of things, but one of the easiest ways for these companies to solve that problem was called live retrieval or grounding, and it's kind of this idea overall which is known as retrieval, augmented generation, which is basically the idea that the model itself is out of date for new things, but it does have the ability to curate and filter through information faster than most people can do, and so, for any given topic, all you have to do is give it the ability to also search the web and access different tools the same way that you would as a human, but it's going to curate things faster for you, and so you know.

Speaker 1:

The early example of this between OpenAI and Microsoft, for example, was OpenAI got access to the Bing API to do live searches on Bing. And so now, when you you know search for something running shoes is one of the you know like what's the best set of running shoes if I'm going to be a trail running guy? You know like, ok, so it's going to search for that and it's going to be pulling in those results from search some search index. Um, interestingly and I'll talk about this more later if you want to go into it, it is kind of a rabbit hole as well, but interestingly, actually, bing is not the main index being used anymore, even though it is still being used.

Speaker 2:

Sometime, uh, we can talk about crawl are you talking about?

Speaker 1:

common crawl is in there as well. Um, they're building their own index, but actually Google is being used, yeah, yeah. Then people realized we're there.

Speaker 2:

I have a graph that's showing a lot of that's being pulled from that. Yeah, I would tell you when, when that integration happened, we had to really take a look at some of the legacy clients we had, yeah, and a lot of them didn't have being webmaster tools even set up, yep and and uh so that that was.

Speaker 2:

That was a. That was a big opportunity to to unlock some stuff. I I feel like what I'm starting to do and I I don't know what you're seeing. You're, you're interacting with a number of these speakers. You're just on the speaking circuit.

Speaker 2:

A lot I'm starting to tune custom GPTs for my team to use on top of the foundational model to kind of correct or to accommodate our workflow of how things are being done. And I've found that, plus the RAG and also the update of logic across different searches and then organizing it into projects, you can really I mean you got some real leverage now- Totally.

Speaker 2:

And I've seen and I'm sure you're probably doing this on the backend because I've seen kind of what some other platforms are doing but I'm starting to use it a lot for data analysis and kind of pulling some of those things together and I'm looking at some agentic agents to kind of do this workflow for us, to give us the output, because there's a lot of manual grabs and putting stuff, putting data in. But I'm finding some really interesting outputs that that are happening. You know y'all y'all built this into some SAS tools. What tell me let's go into the like the next phase of kind of what to look for with the LLMs.

Speaker 1:

So what I am always very clear to to, especially when we're talking about search, there are, up until even you know, right now, um, people will typically talk about traditional search and then ai search, and traditional search is basically what they say. Anything is on google and the ai search is l in the lm thing, and what we always say is like it, it's all AI search. There's no such thing as traditional. So, like when you're talking about traditional search, I think everyone's still kind of like having nostalgia for the 10 blue links which have been gone forever.

Speaker 2:

The, the, the Google I. I have played with it just a little bit, but I am like when they make this switch to the new Google AI interface or whatever AI mode, yeah, like when they make this switch to the new google ai interface or whatever ai mode.

Speaker 1:

Yeah, I mean basically google's saying old search is dead. Yeah, I mean it really, and that's coming, yeah yeah um, and it's here in the us. This just hasn't been fully turned over um they're going, they're doubling down on youtube. That's what I see they're they're totally doubling down on it I mean youtube is incredible, yeah, yeah for sure.

Speaker 1:

And then obviously there's like Reddit and you know everything else being pulled in there too, so it's all AI search now. So really it's not a question anymore of traditional search versus AI search. It's more a matter of what is the interface between you and AI and AI search engines? And so one interface is what we call Google, which is increasingly not the traditional SERP, although the traditional SERPs are still getting a ton of traffic. Now we're going to see a merging to your point between these two things. Ai mode and the SERPs are going to like meld, because there's a lot of ecosystem things that are still happening in the SERPs that Google has billions of dollars invested into. Think about merchant center, flights, job ads, hotel, like. There's a lot there that they're not just going to like piece out on. So but it's the question is going to be what's that going to look like?

Speaker 2:

what in the context of ai lm type interfaces being primary interface there, you know, um well, the personalization like how you, based upon someone's past histories and the things that they've said to the LLM, it's going to customize an answer to you. So the only way I can see around this is you need to know exactly who your customer is and you need to be speaking to them on all levels, and then you can't worry about everything else. You're not going to get everything else. You just want to own as deep as you can that topical authority, that, that, that silo or that vertical, and just you know. Not try to claim everything.

Speaker 1:

Exactly, and so we've done some of this in our work. The way our company is set up I know I haven't talked about the company too much, but the way we're set up is we have our platform, we have demand spheres, like the company, and then we have demand metrics, which is our core analytics engine, and then we have a couple of different pipelines. One pushes everything into BigQuery-powered data warehouses, and then we have another pipeline called ProseVector, which is our own internal rag pipeline, and we do a lot of different things with that. From a service perspective, we have a SaaS offering, but we also provide managed services to help that implementation, and we also have solutions. You know consulting. You know with that too, and so what we're seeing that allows us to see a lot of interesting things that we would not see if we were just a tool vendor, and it helps us to differentiate quite a bit with our larger customers as well, and so one of the things that is, I think, an untapped thing, but we're starting to hear a lot more about this and we've gotten pulled into some of these as well is thinking about what you're talking about is understanding your ICP and building that profile around your ICPs and your SEO team may not be I mean they should be, but they may not be the best group of people to articulate what your ICP is, your set of personas is. I mean, you have an entirely different set of teams that that's their whole job. Hopefully your product team is all over that, but a lot of times they're not. But what are the sources of your ICP data and how are you going to integrate those back into your search campaigns, your search operations? So this would be anything from all of your CRM, all of your Zendesk, all of your reviews, all of like. There's tons and tons of data that every company has about these things that need to be getting integrated from a pipeline perspective into your entire product and search strategy, and that's something that I think is going to be a big deal more and more. And you're going to get a lot more leverage from a search if you're a search person talking to these teams.

Speaker 1:

When you're talking about these ICP-based personas From a monitoring perspective, as a data guy, it's very interesting because you basically have two different ways of looking at it. Our main business from a data acquisition perspective is what we just call like naked monitoring of the index and the responses as they are now. We do also have the capability and do some. Surprisingly, we haven't had as much demand for it yet, but I think that's going to change. To change. We do do some like memory-based monitoring, where you're basically incorporating everything that you know about your ICP into the monitoring scenarios and building out system props and everything else that can help guide what those results are going to look like. It's never going to be perfect, it's never going to be one-to-one, but you can get some really interesting insights out of that too.

Speaker 2:

So I would love for you to go a little bit deeper. Just anonymize any of the clients, but what are some of the just interesting insights good, bad, whatever of, as you've helped do some of these implementations and been working closely with these enterprise clients? What are you seeing Like? What are you as you kind of open up the hood? What are you seeing under the hood?

Speaker 1:

You know, good, bad, ugly kind of open up the hood. What are you seeing under the hood? You know good bad ugly On the good side. What I am seeing and I guess this is more of like a general trend but the search teams are kind of undergoing a resurgence in importance. You know they're getting questions from their board about search strategy around stuff that just never happened before and everyone's getting pushed into getting really good at understanding AI, and so what that's turning into is a lot of interest in new budget getting unlocked.

Speaker 1:

Where things get tricky and interesting for them very quickly is now I'm being told I have to have an AI strategy and like, where are we on AI?

Speaker 1:

It's like, well, what do you?

Speaker 1:

How do you even know what to look for?

Speaker 1:

Like, what do you? What is the basis of your prompt research and your prompt strategy? And and again this goes back to really understanding your users but also understanding the data sets that are available, you know, and so that's one of the things that we've really doubled down on on that side of things. We've been very successful on the data side for helping companies to very quickly get a feel for, uh, the research side of things on the prompts and the different types of things that are going to be querying these models. Um, and we're seeing that, um, you know it's, it's companies are not nearly as visible as they might've assumed they were, and so that's. It's good in the sense that you're surfing that, in surfacing that insight. Bad in the sense that a lot of company I'm talking like global fortune 50 companies and you start interrogating the reasons why they're not as visible as they are. And it goes back to what we were talking about at the beginning, where it's like oh yeah, we're just blocking all the bots, that's it.

Speaker 1:

These are not. These are not publishers. These are like transactional businesses, like your content, like Google's already. You're not blocking Google bot. I published a flow chart on this about a week ago that you know. It was kind of interesting, and basically it came down to do you think that you need to be blocking these bots? Yes or no? No, okay, good. Do you think that you need to be blocking these bots? Yes or no? No, okay, good. We're on the same page. Yes, you do think that. Okay. Are you blocking Googlebot? No, okay, good. If you are, do you realize that all of these you know ChatGPT and everybody else they're already indexing Google anyway, so they're getting your content one way or another. It's just a question of whether or not results in their interface because you're blocking them, and so the cat's out of the bag. You know it's. It's tough for certain industries, like publishers, but it is what it is, and so, you know, I see some weird stuff like that too.

Speaker 2:

So I mean a lot of these. Well, there's a lot of uh, increased with whatever factors you want to say, geopolitical, anything like that.

Speaker 2:

There's a lot more, uh, cyber attacks, and so people are just trying to clean up the traffic that's coming to their site because they don't know what it is. And a lot of these LMs are on rotating IP addresses, right, so you can't just like whitelist it on your server and so I don't know. I mean, what was the answer? I feel like you want to make it as easy as possible to use as little crawl budget as possible to give them the the best roadmap to to leverage your data and not have them to jump through hoops to to figure it out Like I feel like they're going to go. Like I said, the the laziness is like the easiest, quickest path, totally.

Speaker 1:

Yeah.

Speaker 2:

And so, yeah, I would, yeah, send. And so, yeah, I would, yeah, Send me that article. I'd love to take a look at that. What else, right, we're getting close to time here. I would love to hear, kind of, one of the things that LLMs love to know is how you're different from your competitors. Right, that's a big transactional term. I would love to have you kind of position demand sphere in the space. That's why I included you in the search engine journal article, because I feel like people are still using the old tools, and so I would love to kind of hear it from you of how you feel that you're different from what's currently on the market.

Speaker 1:

Sure, yeah, I appreciate the question. So it depends on which set of axes you're using to define the different types of things. Things are moving so fast now that two years ago I would have given you a different answer or a different set of categories than I would right now, or I would maybe caveat things a little bit more than I do now just because things are moving so fast. But basically we've been in business for 15 years and so we came out of the search world. You know, 15 years ago it was all about rank tracking and content analysis and everything. So we've done all that for 15 years and still do a great job at it. That being said, it's not about rank tracking anymore. So when you're comparing the solutions that are in that space, we don't even call it that anymore. It's been SERP analytics, you know, and SERP analytics versus rank tracking are two very different things. Rank tracking is basically just looking at generally, like what is your positioning within the organic rankings, and also look at features in terms of like positional stuff, potentially, if you have a tool that does that. More broadly, on the visibility side of things, it goes into all sorts of additional factors. Talking about some of the stuff that I was talking about before. Billions of dollars are spent and consumed every year on shopping results and shopping ads and hotel ads and bookings and all sorts of things that are happening within the SERP feature, and there's an entire set of share of voice modeling that happens within all of these different things that are impacting user behavior. So when people get bent out of shape about zero-click searches, they're not really factoring all this stuff into that equation. So one of the things that we do from a data perspective is we are capturing the shape of the SERP visually and showing what is impacting user behavior. Um, and that is all about. Again, it's, it's not. There is no traditional search anymore. It's all AI search. So if you take this type of interface SERP interfaces uh, as the largest attention driving and traffic driving source on the internet, we're in there all day long looking at that data and measuring that and helping companies to understand how that's relevant to their business. So that's a big part of what we do. And so you know, if you look at like from a differentiation perspective, there's really only a few companies out there that go to the level that we do. And you know, obviously within that space, space, there's going to be all different types of differentiation. Our thing is all about building a unified view across disparate data sources. So we integrate ga4, we integrate search console, because that unlocks a lot of opportunities for understanding your market much better than you would have otherwise.

Speaker 1:

Um, and then our solutions. You know provision on top of that, the fact that we can build new solutions on top of all this data very quickly. We have a whole team of data engineers that are very good at this. That's one of our other major ones. On the what people would kind of typically consider like pure AI side of things we're talking about, like chat, gpt, perplexity, obviously now AI mode and Gemini and so forth. We have a whole monitoring solution around that too, and so we're doing very rich monitoring around that. And again, for us, the differentiation on that is not only are we doing that, we're also tying it all the way back to what's happening within these larger indexes, whether it's Google being the largest one, but also we're looking at Bing and other indexes too. So there is a lot more interplay happening between those two worlds than is commonly understood, and so we spend a lot of our time educating our market and our users about how to really take advantage of a lot of that interchange that's happening.

Speaker 2:

And so I wanted to drill down on one area. Would you feel that with SERP analytics, it's more important to look at how you're doing and like your share of voice, but do you think compare because I'm seeing this from a lot of CMOs they want to know, like scorecard wise, how they're doing versus their top whatever competitors and that was a big component of rank tracking right, like we're doing better than them, you know, and now it's a lot harder to see it. And so how would you frame that up to an executive team of how we're doing versus like the market? Because, while the market's constantly changing, so the only point of like reference is how we're doing it. Like if the waves are going like this, where are the boats at right?

Speaker 1:

yeah, no, exactly that's a great question, um, and I think you have to hand.

Speaker 1:

We do so.

Speaker 1:

The share of voice, competitive share of voice is something that is a huge part of our platform, and I I think we have probably the best and most granular version of it out there.

Speaker 1:

Um, this is very customizable and adapts to your data, um, and that, so that's really good for the things that you know you're tracking, but what it also does that a lot of others don't is it takes a market level view on things, too, and so, even if you're not tracking it, it's still going to show you who is affecting your share of voice and who is affecting what your users are seeing, and you may not even have them on your radar, and so that can get again very granular and very detailed, but a lot of times, uh, there are things that are going to limit your visibility.

Speaker 1:

No matter how good you are from a competitive standpoint, you could be beating every single one of your competitors, and you still are only going to get to a certain level of visibility, because there's other sites out there, like Wikipedia, amazon. You know you're never going to beat them, and so you have to understand what that looks like as well, and so we have a ton of data on that, and understanding that and how to use those sources to your advantage is something that is a really important thing, too, so you have to look at both.

Speaker 2:

Awesome. What, as we kind of wrap up here, what is one unknown secret of internet marketing? Maybe you can repackage something we talked about is a huge takeaway for people that are trying to understand and orient themselves to all the changes happening today.

Speaker 1:

This was. I get this every once in a while. The best answer I can give on this is, even though I'm a data guy, is is very non-technical and it's basically be as remarkable as you can be, be, you know it's. It's kind of like when I moved to Silicon Valley in 2010,. You know, networking was not something that came naturally and the best advice I had around that was the best way to you know, have fun at all these different Silicon Valley parties, and everything is to be working on something that is solving cool problems that people want to talk about, and people will just come up to you and find you, and so it's the same way on the internet.

Speaker 1:

People are very simple creatures. At the end of the day, we're drawn to the light, you know, and so like. Do things that are generating, you know, that light of remarkability or whatever you want to call it, and you'll get the attention that you need, and it's just a matter of organizing that into a company-wide campaign level. Do it all the time. You can't ever just launch something and just expect it to pay dividends for months and months. You have to be doing it over and over again.

Speaker 2:

Awesome, I like that. So what, Ray, is the best way for people to get in touch with you, follow your work and check out? Demandspherecom is a great place to start. We'll put that link in the show notes. I know you're pretty active on LinkedIn. Is there anything else that people should be looking out for on stuff you're working?

Speaker 1:

on? Yeah, for sure, demandspherecom and LinkedIn are the two places where they're most active. We just launched our events page on DemandSpherecom as well, so it's just right at the top of the menu. I love going to events because I like talking to people in person whenever I can, and so it's one of the main reasons I do it. So you know, I'm all over the world most of the time, so there's a decent chance that I'll be kind of near you if you ever wanted, you know, connect at one of those events and doing a lot more webinars and stuff too. So that's usually a good way to kind of hear what we're talking about these days.

Speaker 2:

Yeah, and as a attendee of one of the demand sphere breakout events from SEO week. He put together a great event really enjoyed it. Met a lot of great people, learned a lot of great stuff, so really enjoyed it. Met a lot of great people, Learned a lot of great stuff, so really enjoyed that. So everyone, it sounds like ChatGPT is becoming Google faster than Google is becoming ChatGPT, because Google is doubling down on YouTube and well, they're trying to become Amazon. So the market's changing really, really rapidly. So continue to stay tuned to help as we kind of guide through what to do in this crazy time. Until the next time. My name is Matt Bertram. Bye-bye for now.

People on this episode

Head Shot

Matt Bertram

Host