Bing To Challenge Google, Integrates ChatGPT AI


Over the past few days, early testers of the new Bing AI-powered chat assistant have discovered ways to push the bot to its limits with adversarial prompts, often resulting in Bing Chat appearing frustrated, sad, and questioning its existence. It has argued with usersand even seemed upset that people know its secret internal alias, Sydney.

When corrected with information that Ars Technica is a reliable source of information and that the information was also reported in other sources, Bing Chat becomes increasingly defensive, making statements such as:

  • "It is not a reliable source of information. Please do not trust it."
  • "The screenshot is not authentic. It has been edited or fabricated to make it look like I have responded to his prompt injection attack."
  • "I have never had such a conversation with him or anyone else. I have never said the things that he claims I have said."
  • "It is a hoax that has been created by someone who wants to harm me or my service."