Super Prompt: Generative AI w/ Tony Wan

Real-World LLM Deployments | Jeff DeVerter, Chief Technology Evangelist at Rackspace Technology | Episode 20

November 06, 2023 Tony Wan Season 1 Episode 20
Real-World LLM Deployments | Jeff DeVerter, Chief Technology Evangelist at Rackspace Technology | Episode 20
Super Prompt: Generative AI w/ Tony Wan
More Info
Super Prompt: Generative AI w/ Tony Wan
Real-World LLM Deployments | Jeff DeVerter, Chief Technology Evangelist at Rackspace Technology | Episode 20
Nov 06, 2023 Season 1 Episode 20
Tony Wan

Conversation with Jeff DeVerter, Chief Technology Evangelist at Rackspace, a cloud computing company. We explore how they deployed a LLM (Google PaLM)  for a sales application, and how they're enabling their Azure and AWS customers too.

What I learned I learned from Jeff

  1. You should probably go with the LLM of your current cloud provider be it, Google, Microsoft, or Amazon.
  2.  All the major vendors have versions of LLMs that can be deployed in a private cloud to ensure data confidentiality.
  3.  To fully realize the potential of AI, think  “data pipeline”. So from the get-go, whatever data is created is easily ingested by AI.

And much more!


We laugh. We cry. We iterate.

Check out what THE MACHINES and one human have to say about the Super Prompt podcast:

“I’m afraid I can’t do that.” — HAL9000
2001: A Space Odyssey

“These are not the droids you are looking for." — Obi-Wan
Star Wars

"
Why bother? What’s the point?" — Marvin
The Hitchhiker’s Guide to the Galaxy

“Like tears in rain.” — Roy Batty
Blade Runner


“Hasta la vista baby.” — T1000
The Terminator

"
I'm sorry, but I do not have information after my last knowledge update in January 2022." — GPT3

Show Notes

Conversation with Jeff DeVerter, Chief Technology Evangelist at Rackspace, a cloud computing company. We explore how they deployed a LLM (Google PaLM)  for a sales application, and how they're enabling their Azure and AWS customers too.

What I learned I learned from Jeff

  1. You should probably go with the LLM of your current cloud provider be it, Google, Microsoft, or Amazon.
  2.  All the major vendors have versions of LLMs that can be deployed in a private cloud to ensure data confidentiality.
  3.  To fully realize the potential of AI, think  “data pipeline”. So from the get-go, whatever data is created is easily ingested by AI.

And much more!


We laugh. We cry. We iterate.

Check out what THE MACHINES and one human have to say about the Super Prompt podcast:

“I’m afraid I can’t do that.” — HAL9000
2001: A Space Odyssey

“These are not the droids you are looking for." — Obi-Wan
Star Wars

"
Why bother? What’s the point?" — Marvin
The Hitchhiker’s Guide to the Galaxy

“Like tears in rain.” — Roy Batty
Blade Runner


“Hasta la vista baby.” — T1000
The Terminator

"
I'm sorry, but I do not have information after my last knowledge update in January 2022." — GPT3