Naavi's Podcast

Use of AI in Judiciary-1

Naavi

Use Left/Right to seek, Home/End to jump to start or end. Hold shift to jump forward or backward.

0:00 | 18:00

Naavi discusses the draft guidance on AI usage in Judiciary

SPEAKER_01

Imagine a courtroom in the year 2026. The judge presiding over the case is, you know, human, wearing the traditional robes, listening to the arguments. Right. But the clerk whispering in their ear, like rapidly drafting the case summaries and pulling up decades of obscure legal precedence in milliseconds. Exactly. But that clerk is actually a black box algorithm. And that algorithm is owned and maintained by a private tech billionaire.

SPEAKER_00

Aaron Ross Powell Which is a terrifying thought.

SPEAKER_01

Aaron Powell It really is. So when you look at that scenario, the immediate question that hits you is well, how on earth do you regulate a ghost in the machine? How do you ensure justice isn't just quietly outsourced to a piece of proprietary code?

SPEAKER_00

Aaron Ross Powell I mean, it is the ultimate modern paradox for any legal system. You're trying to build this rigid, reliable structure of law in order to contain a technology that is inherently fluid.

SPEAKER_01

Trevor Burrus Right. It's constantly changing.

SPEAKER_00

Aaron Ross Powell Exactly. It's often opaque and it's evolving at a speed that traditional legislation simply cannot match.

SPEAKER_01

Aaron Powell Welcome to the Deep Dive. We are thrilled you're joining us today because we are looking at an absolute masterclass in solving that exact paradox.

SPEAKER_00

We really are.

SPEAKER_01

Our source material today is a detailed, highly technical commentary by Navi. And just for context, Navi is a leading authority and expert on data protection in India.

SPEAKER_00

Yeah, and Navi has analyzed a freshly released draft from the Supreme Court of India. It's titled Regulations for Use of Artificial Intelligence in Courts 2026.

SPEAKER_01

Which is currently out for public comment, right? So this is the perfect time to dissect it.

SPEAKER_00

Absolutely. And, you know, this is not just some internal memo for the IT staff. It is arguably one of the most comprehensive, ambitious judicial AI governance frameworks proposed anywhere in the world.

SPEAKER_01

Okay, let's unpack this because the sheer scale of what the Supreme Court is proposing here is just, well, it's staggering.

SPEAKER_00

It really is massive.

SPEAKER_01

We're looking at a document featuring 57 distinct clauses systematically spread across 10 distinct chapters. When I was reading through Navi's notes, it struck me that this doesn't read like a simple checklist of best practices.

SPEAKER_00

Aaron Powell No, not at all.

SPEAKER_01

Aaron Powell It reads more like a highly detailed architectural blueprint for I don't know, an entirely new digital civilization. So looking at these ten chapters, what stands out to you about how they've organized this massive undertaking?

SPEAKER_00

Aaron Ross Powell Well, what's fascinating here is how the commentary explicitly notes that the draft is exhaustive. It is so meticulously structured that it's essentially ready to be enacted as a formal law in its own right.

SPEAKER_01

Wow. Just on its own?

SPEAKER_00

Yeah. They haven't just addressed the software itself, they've broken down the entire life cycle of the technology, anticipating problems before they even occur.

SPEAKER_01

That makes sense.

SPEAKER_00

So rather than walking through it chapter by chapter like a textbook, it helps to look at the actual mechanisms. You can sort of group these ten chapters into three operational zones.

SPEAKER_01

Okay, lay them out for us.

SPEAKER_00

You've got the foundation, the engine room, and the safety net.

SPEAKER_01

Okay, so let's start with the foundation, because um, before you plug anything in, you really need to know where the boundary lines are. The source highlights that the early chapters, chapters one through three, they don't just set up general principles, they explicitly define permissible and prohibited uses. Right. And that feels like a massive philosophical stake in the ground. I mean, in a typical corporate setting, a terms of service agreement might vaguely say, you know, don't use this for illegal activities. But here, the judiciary is proactively fencing off specific cognitive tasks. Aaron Ross Powell, Jr.

SPEAKER_00

They are establishing the ground rules from day one. And you know, that is absolutely vital in a judicial setting. Right. Defining a prohibited use means drawing a hard line that the algorithm just cannot cross, regardless of how advanced it gets.

SPEAKER_01

Aaron Powell So what's an example of that?

SPEAKER_00

Aaron Powell Well, for instance, an AI might be permitted to collate scheduling data or uh summarize a thousand-page financial document. Those are permissible administrative assists. Right. But the framework structurally prohibits the AI from weighing the credibility of a witness or determining the final legal culpability of a defendant.

SPEAKER_01

Aaron Powell Because I mean you can't put an algorithm on the stand and cross-examine it to find out why it decided a witness was lying. Precisely. If a human judge makes a biased call, there is a paper trail of human reasoning that can be appealed. But if a black box AI makes a biased call because its training data was flawed, it just looks like cold hard math. Exactly. It's just a black box.

SPEAKER_00

And by defining these boundaries up front in the foundation, they avoid the reactive trap of waiting for a machine to ruin a trial before deciding it shouldn't have been used in the first place.

SPEAKER_01

That is smart.

SPEAKER_00

Yeah. And once those foundational boundaries are locked in, the framework moves into what we call the engine room.

SPEAKER_01

Right. Chapters four, five, and six. Aaron Powell Right.

SPEAKER_00

This is where the daily mechanics of the policy live.

SPEAKER_01

So this includes policymaking, oversight, audits, and crucially chapter six, which covers procurement and private sector engagement.

SPEAKER_00

Yes. Very important.

SPEAKER_01

And I actually want to spend some time on procurement because to a layperson, that sounds like the most tedious bureaucratic function imaginable. It sounds like, you know, buying office supplies.

SPEAKER_00

Aaron Powell I know, it sounds dry.

SPEAKER_01

But in the context of court AI, procurement is really the front line of defense, isn't it?

SPEAKER_00

It is the gateway for every potential vulnerability. When a judicial body procures an AI system, they are not buying off-the-shelf word processing software.

SPEAKER_01

No, definitely not.

SPEAKER_00

They are frequently engaging with highly complex proprietary models developed by external private tech companies.

SPEAKER_01

Right.

SPEAKER_00

So the inclusion of private sector engagement right next to procurement is a stark acknowledgement by the Supreme Court of a massive security risk.

SPEAKER_01

Aaron Ross Powell Because courts are repositories for the most sensitive, confidential data in a society.

SPEAKER_00

Exactly.

SPEAKER_01

It goes back to that scenario we opened with. It's like inviting a brilliant but incredibly secretive consultant to sit in on every closed door trial, read every sealed document, and analyze every piece of protected evidence.

SPEAKER_00

Yeah, it's a huge risk.

SPEAKER_01

You need absolute ironclad rules about what that consultant can see, what they are allowed to remember, and who they report back to.

SPEAKER_00

And how do you enforce that when the consultant is just a piece of code?

SPEAKER_01

Wow, right.

SPEAKER_00

That is exactly why Chapter V mandates rigorous oversight, audits, and incident management. An AI audit isn't a financial review, it's a technical stress test.

SPEAKER_01

So they're looking for what exactly?

SPEAKER_00

It means actively checking the algorithm for data drift, testing the model to see if it has developed latent biases over time, and ensuring the private vendor hasn't created a backdoor.

SPEAKER_01

Oh, a backdoor that funnels sensitive court data back to their corporate servers to train their next commercial model.

SPEAKER_00

Precisely. Which naturally leads us to the final operational zone you mentioned, the safety net.

SPEAKER_01

Okay. Chapters seven through nine.

SPEAKER_00

Right. If the foundation sets the rules and the engine room runs the machine, the safety net is there to catch the inevitable human and technical failures.

SPEAKER_01

Right, because things will go wrong. So this encompasses data protection, capacity building, and grievance redressal.

SPEAKER_00

Yes. It recognizes that even the best procured system is totally vulnerable if the people using it are uninformed or if there's no mechanism to fix a mistake.

SPEAKER_01

Capacity building is a really interesting inclusion to me. It essentially means training and upskilling, right?

SPEAKER_00

Yes, absolutely.

SPEAKER_01

Because you can spend millions of dollars installing a state-of-the-art AI system, but if the judges and the clerks don't fundamentally understand how a large language model generates text, the tool is dangerous.

SPEAKER_00

It's extremely dangerous. If you do not train the humans, you simply cannot have meaningful oversight. A judge needs to be trained to spot an AI hallucination, you know, where the system confidently invents a fake legal precedent.

SPEAKER_01

Right. They have to spot that just as readily as they can spot a flaw in a lawyer's argument.

SPEAKER_00

Exactly. And if a hallucination does slip through, well, that is why Grievance Redressal has its own dedicated chapter.

SPEAKER_01

Let's explore the mechanism of that for a second. Let's say a citizen's case is negatively impacted because an AI tool incorrectly summarized a key piece of exonerating evidence, and the clerk missed it.

SPEAKER_00

Okay, a worst case scenario.

SPEAKER_01

Right. The framework provides a predefined legal pathway for that citizen to halt the process, demand an audit of the AI's log, and seek a remedy.

SPEAKER_00

Yeah.

SPEAKER_01

So the accountability doesn't just evaporate into the cloud.

SPEAKER_00

Aaron Powell It's a marvel of administrative foresight, really. When you analyze the mechanics, the proactive boundaries, the rigorous audits, the capacity building, you understand why Navi's commentary elevates this draft. Yeah, it's so thorough. But the architecture is only half the story. The true core of this document is the philosophy driving it. Okay. The source material specifically notes that this draft adopts a distinctly Indian approach to artificial intelligence.

SPEAKER_01

And the commentary defines that approach with a very specific pivotal phrase. It says, AI is welcomed as an assistant to justice, but never as a substitute for judicial reasoning.

SPEAKER_00

That is the anchor of the entire framework. It is a fundamental philosophical stance.

SPEAKER_01

Right.

SPEAKER_00

It asserts that the actual act of judicial reasoning, weighing human context, understanding intent, applying empathy, and interpreting the spirit of the law is a uniquely human endeavor.

SPEAKER_01

Aaron Powell I love that. But um let me play devil's advocate here for a minute, because I think a lot of tech developers would push back on this pretty hard.

SPEAKER_00

Oh, they definitely would.

SPEAKER_01

I mean, Indian courts and frankly, judicial systems all over the world are drowning in massive backlogs.

SPEAKER_00

Yes, millions of cases.

SPEAKER_01

Civil cases can take decades to resolve. People literally pass away before seeing a verdict. So if we have an AI that is demonstrably 99.9% accurate, an AI that could process millions of pages of case law and clear a 10-year backlog in a single month, well, isn't this distinctly Indian approach of forcing a human to remain the ultimate bottleneck actually a denial of justice?

SPEAKER_00

It's a tough question.

SPEAKER_01

Aren't we just preserving the tradition of the human judge at the expense of a citizen who desperately needs a rapid decision?

SPEAKER_00

Look, it is a compelling counterargument, and it's exactly the tension between Silicon Valley tech solutionism and constitutional law.

SPEAKER_01

Right.

SPEAKER_00

But the framework stance is that speed cannot supersede constitutional safeguards.

SPEAKER_01

Interesting.

SPEAKER_00

An AI can process a million pages of precedent, yes. That is the assistant function, and it will radically speed up the preparation of cases. But an AI does not understand justice.

SPEAKER_01

No, it doesn't.

SPEAKER_00

It predicts text based on historical data. And you know, if historical data contains systemic biases, an AI will rapidly and efficiently replicate those biases at scale.

SPEAKER_01

Oh wow. Yeah, it optimizes for patterns, not for equity.

SPEAKER_00

Exactly. When you cross the line from the machine summarizing the data to the machine making the final call, you violate the core tenet of the justice system, which is accountability. Right. A citizen has the constitutional right to be judged by a human being who is legally and morally accountable for that judgment.

SPEAKER_01

Aaron Powell Because you cannot penalize an algorithm in any meaningful way.

SPEAKER_00

No. You cannot hold a server rack in contempt of court. The accountability must stop with a human wearing a robe.

SPEAKER_01

It's a very sober, grounded way to view the technology, really cutting through all the utopian hype. The courts are basically saying, yes, we want the speed, we want the innovation, but this is merely a tool. Exactly. It's a highly advanced hammer, but it is not the carpenter.

SPEAKER_00

That's a great way to put it. And by drawing such a definitive line in the sand regarding human accountability, the Supreme Court is doing something much larger than just managing its own courtrooms. The implications of these 2026 regulations extend far beyond the judiciary.

SPEAKER_01

Well, here is where it gets really interesting. We are talking about a massive ripple effect across the entire country.

SPEAKER_00

Absolutely.

SPEAKER_01

Because the Supreme Court has just publicly published this 10-chapter 57 clause masterclass in AI safety, they have effectively set a towering high watermark for everyone else.

SPEAKER_00

If we connect this to the broader national picture, the source material explicitly states that this judicial framework will now set the baseline platform for AI regulations across the board. The commentary notes that whatever broader regulations the government was previously planning will now have to be reevaluated through the lens of this guideline.

SPEAKER_01

Wait, really? So the government's own tech ministries are suddenly playing catch-up to the courts?

SPEAKER_00

In many ways, yes. The judiciary has established a rigorous standard of care. Even though, legally speaking, this draft is currently restricted to the operations of the courts. Right. Practically speaking, it is going to be viewed as an indicative due diligence standard for the entire private sector.

SPEAKER_01

Aaron Powell Okay. Because this sets an indicative due diligence standard. Any private company, say, a bank using AI for loan approvals or a hospital using it for diagnostics that get sued for AI malpractice is going to face a very specific problem.

SPEAKER_00

Aaron Ross Powell Oh, a massive problem.

SPEAKER_01

Trevor Burrus When they end up in court, the judge is going to look at the tech company and ask, did you act responsibly? Did you audit your systems? Did you define prohibited uses? Right. And if the tech company's internal safety policies are weaker than the 2026 rules the judge uses in their own courtroom, well, that company is going to have a nearly impossible time defending itself. Trevor Burrus, Jr.

SPEAKER_00

It is a brilliant indirect mechanism for regulating the wider ecosystem.

SPEAKER_01

It really is.

SPEAKER_00

The courts do not need to wait for a sweeping national technology law to be passed by Parliament, which can, you know, take years of debate.

SPEAKER_01

Yeah, forever. Trevor Burrus, Jr.

SPEAKER_00

By setting their own internal house rules so incredibly high, they force every private enterprise to level up their compliance just to avoid being penalized by those same courts later.

SPEAKER_01

Aaron Powell It is regulation by rigorous example. And we are already seeing the practical application of this ripple effect happening in real time. We are. The source material mentions that data protection professionals are not waiting around. Navi and the FDPPI, which is the foundation of data protection professionals in India, are proactively stepping up to integrate these rules.

SPEAKER_00

Yes. The commentary highlights that they are already working on upgrading the existing DGPSI AI framework.

SPEAKER_01

So for those listening who might not know, how does the DGPSI AI framework function in this context?

SPEAKER_00

Aaron Powell So the DGPSI AI is an established comprehensive framework used by data governance professionals to audit and assess corporate compliance.

SPEAKER_01

Okay.

SPEAKER_00

It is essentially the tool experts use to look at a company and determine if they're handling data and AI safely. What Navi and the FTPPI are doing is taking the incredibly robust principles from the Supreme Court's 2026 draft. You know, the strict procurement audits, the clear boundary lines, the incident management protocols. Yeah. And they are coding them directly into the DGPSI AI assessment structure.

SPEAKER_01

Oh, I see. They are actively translating the Supreme Court's blueprint of justice into a practical checklist for corporate compliance.

SPEAKER_00

Exactly.

SPEAKER_01

They are taking that high watermark set by the judiciary and building a ladder so the private tech sector can actually climb up and reach it.

SPEAKER_00

Precisely. They recognize that the Supreme Court has just handed the country a gold standard for AI governance.

SPEAKER_01

Yeah, why reinvent the wheel?

SPEAKER_00

Right. Instead of waiting for a legislative mandate, these professionals are adapting the judicial principles for immediate voluntary use in the private sector. It really demonstrates how judicial foresight can rapidly accelerate industry-wide best practices.

SPEAKER_01

It really flips the usual narrative on its head. I mean, we are so used to the story being that the legal system is always ten steps behind technology, constantly scrambling to figure out what a new app does.

SPEAKER_00

Usually, yeah.

SPEAKER_01

But in this case, with the 2026 regulations, the judiciary is arguably stepping out in front. They are setting the pace, establishing the boundaries, and demanding that the technology conform to human constitutional values.

SPEAKER_00

Aaron Powell Rather than reshaping the law to accommodate the technology exactly. Yeah. Which is the fundamental purpose of a constitutional safeguard. It exists to protect the core values and rights of a society against shifting tides, whether those tides are political movements or technological revolutions.

SPEAKER_01

Aaron Powell Beautifully said. So bringing this all together for you listening, whether you are a software developer writing these models, a corporate executive deciding how to integrate them, or just an everyday citizen wondering how algorithms are going to impact your civil rights.

SPEAKER_00

It affects everyone.

SPEAKER_01

It does. This 2026 framework is a massive, incredibly detailed signal. It tells us that the future of AI governance, at least under this distinctly Indian approach, isn't about surrendering our agency to the machines. No, not at all. It is about building complex 10-chapter safety nets. It is about ensuring that no matter how sophisticated, how fast, or how seemingly brilliant the artificial intelligence gets, human accountability remains the absolute unquestioned king of the courtroom.

SPEAKER_00

It is a profoundly human-centric approach to managing a non-human entity.

SPEAKER_01

It really is.

SPEAKER_00

However, as we examine the long-term implications of this framework, it raises one final highly provocative question for us to consider.

SPEAKER_01

Oh, what's that?

SPEAKER_00

Well, the draft strictly designates AI as an assistant to justice, ensuring the human remains the ultimate decision maker.

SPEAKER_01

Right.

SPEAKER_00

But what happens practically over the next decade when that assistant becomes undeniably efficient? What happens when the AI proves to be right 99.9% of the time?

SPEAKER_01

Oh, I see where you're going with this.

SPEAKER_00

As the years go by, how do we ensure that keeping a human in the loop doesn't just devolve into a tired human, thoughtlessly rubber stamping an AI's brilliant work?

SPEAKER_01

Wow, that is a scary thought.

SPEAKER_00

Right. A 10-chapter framework can mandate that a human judge must sign the final order. But how do we legislate active critical thinking in an age of perfect assistance?

SPEAKER_01

A vital question that we will all need to keep our eyes on as these systems roll out. Thank you so much for joining us on this deep dive. Keep questioning the systems being built around you, keep an eye on how these frameworks evolve, and we will catch you next time.