Bonus Episode: Why Confidence Drops Around Certain People

Ever notice how your confidence can vanish the moment a certain person walks into the room? We dig into the real reasons your state shifts so fast, showing how your brain’s hierarchy scan, memory-based pattern matching, and sensitivity to judgment can nudge you from calm to cautious in seconds. Rather than labelling it as weakness, we explain why it’s a smart—if sometimes unhelpful—defence from an ancient nervous system doing its best to keep you safe.

We break down perceived hierarchy and why your posture, tone, and word choice can change even when the other person is warm and fair. Then we explore the subtle power of echoes from the past: how a voice, glance, or cadence can trigger old templates of criticism or dismissal and make your reaction feel bigger than the moment. Finally, we look at the approval trap—how caring too much about being liked or chosen ramps up self-monitoring and chokes your natural flow.

You’ll also get four practical steps to bring your steadier self into higher-stakes rooms. First, name what’s happening to create space between trigger and response. Second, reframe inflated status so intimidating figures become more human and proportionate. Third, prepare with evidence by recalling concrete wins to preload your working memory with competence instead of doubt. Fourth, use gradual exposure—brief, low-stakes interactions that teach your nervous system the situation is safe—so confidence has room to return.

The bottom line: dips in confidence say more about context and prediction than about your capability. With a clearer map of what your brain is doing, you can guide it back to enough safety for your best voice to show up. If this helped you rethink confidence, follow the show, share it with a friend, and leave a quick review so more people can find it.

Transcript

Framing The Confidence Question

Confidence Is Contextual

Hierarchy And Nervous System Response

Pattern Matching And Old Echoes

Perceived Judgment And Vigilance

Four Practical Steps To Rebuild Confidence

Your Capability Remains Intact

Integrating The Model And Closing

Speaker 0:12

Let's talk about confidence bonus episode. Why you feel less confident with some people? Welcome to Let's Talk About Confidence. Let's talk about confidence bonus episode. Why you feel less confident with some people? Welcome to Let's Talk About Confidence. I'm John M. Walsh. Today's bonus episode comes from a listener's question that I think most people recognise. How come we feel less confident with some people than we do with others? You know the experience. You're confident in one setting, comfortable, articulate yourself. Then you walk into a room with certain people and something shifts. You shrink, your voice changes, you second guess in yourself, that solid sense of I've got this, it just evaporates. It's frustrating because if confidence were stable, it would travel with you. But it doesn't always work that way. So let's look at what's actually happening and what you can do about it. First, a reframe that might help. Confidence isn't a single trait you either have or you don't have. It's contextual. It shifts depending on the situation, the task, and crucially, the people involved. You might be confident presenting to your team but nervous present to the board. Confident with close friends, but awkward at parties with strangers. Confident in your expertise, but uncertain when someone with more experience enters a room. Now this isn't a flaw, it's how confidence actually works. Your brain assesses each situation separately. Do I have evidence that I can handle this specific context? If yes, confidence shows up. If no, or if something about the context triggers old threat responses, confidence withdraws. So when you feel less confident with certain people, your brain is responding to something specific about that interaction. The question is what? One of the biggest factors is perceived hierarchy. Your brain is constantly, often unconsciously, assessing where you sit in relation to others. Now this is ancient wiring. In tribal environments, no new position in the social hierarchy was survival information. When you perceive someone as above you, more senior, more successful, more experienced, more powerful, your nervous system responds. Stress hormones increase slightly, you become more vigilant about saying the wrong thing, and you monitor their reactions more closely. Your body language might shift, less expansive, more contained. None of this is conscious. You don't decide to feel smaller around, say, your CEO or that colleague who always seems to have it together. Your brain just does it. And here's what's interesting. This often has very little to do with how the other person is actually behaving. They might be perfectly warm and approachable, but if your brain has categorized them as a higher status, the hierarchy response kicks in anyway. You're not being irrational, you're being mammalian. Second factor's pattern matching. Your brain is constantly scanning for familiar patterns, often outside of your awareness. When you meet someone your brain asks, Who does this person remind me of? And what happened last time? So that colleague who makes you feel inadequate might at some level remind your nervous system of a critical parent, a dismissive teacher, or a boss who undermined you years ago. They're not that person, but something about them, their tone, their posture, the way they hold eye contact, it triggers an old pattern. And suddenly you're not responding to who's actually in front of you, you're responding to an echo from the past. This explains why your reaction can feel disproportionate. You're wondering, why does this person throw me off so much? While your nervous system is quietly processing something from fifteen years ago. This isn't weakness, it's how memory works. Your brain stores emotional experiences and uses them to predict the present. Mostly that's helpful. Sometimes it misfires. The third factor is perceived judgment. Your confidence often dips around people you believe are judging you or whose judgment you particularly care about. Think about it. You're probably more comfortable making mistakes in front of close friends than in front of people you're trying to impress. You're more relaxed with people who've seen you fail and still stuck around. When you sense rightly or wrongly that someone's evaluating you, your threat system activates, the stakes feel higher, you become more self-conscious, more careful, more edited. And the more you care about their opinion, the stronger the effect becomes. This is why people feel less confident around people they want to impress, potential employers, romantic interests, industry leaders. The desire for approval activates vigilance, and vigilance is the opposite of relaxed confidence. So if confidence drops around certain people, what helps? Well, four things. First of all, name what's happening. Awareness itself reduces the threat response. When you notice I'm feeling smaller around this person, you've created a gap between the stimulus and your reaction. You might silently acknowledge my brain has categorized this person as higher status, or something about them is triggering an old pattern. You're not trying to fix it in that moment, you're just seeing it clearly, and seeing it clearly loosens its grip. Second, reframe the hierarchy. Perceived hierarchy is often inflated. The person who intimidates you probably has their own insecurities, their own people who make them feel small, their own moments of doubt. A useful question. What would I think of this person if I'd met them in a completely different context? A barbecue on a holiday, when they were struggling with something. Stripping away the status markers often reveals they're just a person. No more human than you, no less flawed than you. We've often spoken about doing a presentation and imagining the audience naked. It brings them to a human level and often takes away that fear that we have. The third thing is to prepare different for higher stakes people. If certain people consistently throw you off, don't walk in cold before interacting with them. Take two minutes to recall a time when you handled something difficult well. Reconnect with evidence of your own capability. This isn't positive thinking, it's accessing your own data, your own proof, your own evidence. Your brain can only hold so much in work and memory. If you fill it with evidence of your competence before walking in, there's less room for the doubt spiral. And the fourth is increase exposure gradually. Confidence with specific people builds the same way all confidence builds through repeated, survivable experiences. If someone intimidates you, look for low-stakes ways to interact with them more often. Brief conversations, small exchanges, each one that goes okay becomes evidence that your nervous system can be used to recalibrate. You're not trying to become best friends, you're trying to give your brain enough data to stop treating them as a threat. And here's something worth remembering. When you feel less confident around someone, that feeling says nothing about your actual capability. It says something about your nervous system's threat assessment in that specific context. You're still the same person who's confident in other rooms with other people in other situations. That competence doesn't disappear just because your brain is firing a warning signal. Confidence isn't about feeling equally steady with everyone. That's not realistic. Even the most confident people have someone who throws them off, someone whose approval they seek too much, someone who triggers all patterns. The goal isn't to eliminate the variation, it's to recognise it, understand it, and work with it. Rather than concluding there's something fundamentally wrong with you. So, why do you feel less confident with some people? Because your brain's doing its job. It's assessing the hierarchy, it's pattern matching from the past, it's monitoring for judgment. That's not a flaw to fix, it's wiring to understand. Once you understand it, you can work with it. Name what's happening, reframe the hierarchy, prepare with your own evidence and build familiarity gradually. The confidence you feel with people you're comfortable with, that's not a different version of you. That's just with a quieter threat system. The task is helping your nervous system learn that more people and more situations are safe enough to let that version show up. Thanks for listening. I'm John M. Walsh. This is Let's Talk About Confidence, and I'll see you next time.