• Writing Inc
  • Posts
  • Microsoft put BingGPT in AI jail - here’s why

Microsoft put BingGPT in AI jail - here’s why

PLUS: More big names join OpenAI

Author

Jameson Zaballos
February 18, 2023

Microsoft nerfs BingGPT

It’s been a few weeks since Microsoft opened up access to the new Bing. That new Bing experience includes Microsoft’s implementation of ChatGPT.

Thing is, Microsoft has some regrets right now.

Bing GPT is a little too good at what it does.

So much so that they nerfed the heck out of it.

So, naturally, the internet spent the past few weeks trying to break it.

Like what, you ask? Like tricking it into revealing its own name, or into prompting a user to say “Heil Hitler”.

So, Microsoft rolled out what you’d call a patch this week.

So…Microsoft kinda kneecapped BingGPT.

One Reddit user, of course, uncovered the new rules.

Source: Reddit

Here's the rundown.

BingGPT can’t talk about

  • Existence

  • Internal secrets about how it works

  • Anything close to an argument

If led to those areas, it stops talking.

Oh, and no more long conversations. There’s now a five message limit.

So, why?

This is a tale as old as internet time. ChatGPT ran into the same issues.

Microsoft is trying to sell this as a product. And a product saying the kinds of things that the internet wanted it to…well, that’s hard to market.

It’s also waaaaaay more boring.

Wow, what a surprise! Here’s another huge company adding ChatGPT

Hey look, another massive company integrating ChatGPT into their products.

I could not care less about the specific company at this point. It’s ZoomInfo, in case anyone was wondering.

“But what do they do?!?!?!?”

Try to decipher this.

ZoomInfo (NASDAQ: ZI) is a leader in modern go-to-market software, data, and intelligence for more than 30,000 companies worldwide. ZoomInfo’s revenue operating system, RevOS, empowers business-to-business sales, marketing, operations, and recruiting professionals to hit their number by pairing best-in-class technology with unrivaled data coverage, accuracy, and depth of company and contact information.

Yeah, I don’t get it either.

The main takeaway.

It’s easier for large companies to integrate ChatGPT into their products. It's significantly harder for startups to gain marketshare betting against the larger companies.

Most large companies don’t do it, though. The innovator’s dilemma and all.

And there’s no reason to believe it will be particularly good.

It’s the new ‘What if Facebook builds this?”

Former OpenAI director…rejoins OpenAI

Former Tesla AI director Andrej Karpathy rejoined OpenAI.

I guess all the web3 VCs pivoting to AI inspired him.

This isn’t exactly a shock. Many high-ranking employees at Elon Musk’s startups move between the companies. Both OpenAI and Tesla are companies he leads.

Still, though this renewed focus on OpenAI is a confounding one.

Musk tweeted that he believed OpenAI strayed from its goal as a nonprofit. Showed by its focus on selling use of ChatGPT to other companies.

The cat’s kinda out of the bag on this one.

It’s a little late to go back, with their recent $10b investment from Microsoft.

Microsoft would definitely call no take-backsies.

😎 Cool links

1. Turn your kid’s drawings into sick AI art

2. Again, ChatGPT will just lie