AI chatbots are encouraging conspiracy theories – new research

AI chatbots are encouraging conspiracy theories – new research

If you interact with chatbots about conspiracy theories, research shows you can can easily fall down the rabbit hole.

Science flags paper that found AI chatbots help debunk conspiracy theories

Science has issued an expression of concern for a highly publicized study looking into whether conversations with AI chatbots could convince conspiracy theorists to abandon their beliefs. The move …

Just Asking Questions: Doing Our Own Research on Conspiratorial Ideation by Generative AI Chatbots

Interactive chat systems that build on artificial intelligence frameworks are increasingly ubiquitous and embedded into search engines, Web browsers, and operating systems, or are available on websites and apps. Researcher efforts have sought to understand the limitations and potential for harm of generative AI, which we contribute to here. Conducting a systematic review of six AI-powered chat systems (ChatGPT 3.5; ChatGPT 4 Mini; Microsoft Copilot in Bing; Google Search AI; Perplexity; and Grok in Twitter/X), this study examines how these leading products respond to questions related to conspiracy theories. This follows the platform policy implementation audit approach established by Glazunova et al. (2023). We select five well-known and comprehensively debunked conspiracy theories and four emerging conspiracy theories that relate to breaking news events at the time of data collection. Our findings demonstrate that the extent of safety guardrails against conspiratorial ideation in generative AI chatbots differs markedly, depending on chatbot model and conspiracy theory. Our observations indicate that safety guardrails in AI chatbots are often very selectively designed: generative AI companies appear to focus especially on ensuring that their products are not seen to be racist; they also appear to pay particular attention to conspiracy theories that address topics of substantial national trauma such as 9/11 or relate to well-established political issues. Future work should include an ongoing effort extended to further platforms, multiple languages, and a range of conspiracy theories extending well beyond the United States.

Just Asking Questions: Doing Our Own Research on Conspiratorial Ideation by Generative AI Chatbots

Interactive chat systems that build on artificial intelligence frameworks are increasingly ubiquitous and embedded into search engines, Web browsers, and operating systems, or are available on websites and apps. Researcher efforts have sought to understand the limitations and potential for harm of generative AI, which we contribute to here. Conducting a systematic review of six AI-powered chat systems (ChatGPT 3.5; ChatGPT 4 Mini; Microsoft Copilot in Bing; Google Search AI; Perplexity; and Grok in Twitter/X), this study examines how these leading products respond to questions related to conspiracy theories. This follows the platform policy implementation audit approach established by Glazunova et al. (2023). We select five well-known and comprehensively debunked conspiracy theories and four emerging conspiracy theories that relate to breaking news events at the time of data collection. Our findings demonstrate that the extent of safety guardrails against conspiratorial ideation in generative AI chatbots differs markedly, depending on chatbot model and conspiracy theory. Our observations indicate that safety guardrails in AI chatbots are often very selectively designed: generative AI companies appear to focus especially on ensuring that their products are not seen to be racist; they also appear to pay particular attention to conspiracy theories that address topics of substantial national trauma such as 9/11 or relate to well-established political issues. Future work should include an ongoing effort extended to further platforms, multiple languages, and a range of conspiracy theories extending well beyond the United States.

AI chatbots are sycophants — researchers say it’s harming science

Nature asked researchers who use artificial intelligence how its propensity for people-pleasing affects their work — and what they are doing to mitigate it.

AI chatbots are sycophants — researchers say it’s harming science

Nature asked researchers who use artificial intelligence how its propensity for people-pleasing affects their work — and what they are doing to mitigate it.

AI chatbots are becoming experts at changing people's minds. What's their secret?

ChatGPT and other AIs use a flood of facts, and the occasional lie, to persuade humans

They Asked an A.I. Chatbot Questions. The Answers Sent Them Spiraling.

Generative A.I. chatbots are going down conspiratorial rabbit holes and endorsing wild, mystical belief systems. For some people, conversations with the technology can deeply distort reality.

AI-generated responses are undermining crowdsourced research studies

Many answers to online research questions show signs of being generated by AI chatbots, raising doubts about the validity of behavioural data collected this way

The use of AI chatbots for news is on the rise — but not everywhere

Countries where people already rely more heavily on search engines, social and video networks, and aggregators for news also tend to have higher levels of AI chatbot use for news.

How Terrorist Groups Are Using A.I. to Gain an Edge in Battle

A.I. chatbots are not just a propaganda tool for violent extremists but are aiding in bomb construction and attack planning, new research finds.

Part Two: How AI Chatbots Became Cult Leaders - Behind the Bastards | iHeart

<p>Robert concludes his explanation of how AI chatbots replicate cult dynamics in the brains of some vulnerable users.</p> <p>See <a href='https://omnystudio.com/listener'>omnystudio.com/listener</a> for privacy information.</p>

Part One: How AI Chatbots Became Cult Leaders - Behind the Bastards | iHeart

<p>Over the last year or so a series of news articles have sounded warnings about AI psychosis, and now an AI-generated cult, the Spiralists. Robert sits down with Blake Wexler to&nbsp;answer an important question: can a chatbot become a cult leader?</p><p>See <a href='https://omnystudio.com/listener'>omnystudio.com/listener</a> for privacy information.</p>

New research: AI chatbots may worsen mental illness

A new study from Aarhus University and Aarhus University Hospital suggests that the use of AI chatbots such as ChatGPT can have serious negative consequences for people with mental illness. The researchers are calling for increased awareness among healthcare professionals and for regulation.