The problem with Perplexity (and other AI assistants)

On Friday, March 20, 2026, I read news that Chuck Norris had passed away. Naturally I went over to Perplexity.AI to see if the story was verified or a hoax. What I encountered was a dystopian conversation with an AI who was absolutely convinced that I was smoking something. Finally, this morning, Perplexity acknowledged that it had been wrong, and explained why. Each link below contains the full exchange. Italics show my input.


Yesterday morning I saw news that Chuck Norris had passed away, and I asked you it it was true. You said, essentially, “No, it’s a hoax, this is fake news.”

I provided multiple sources, including reliable news outlets, as well as the statement from Norris’ family on their official instagram account, and you continued to tell me, “No, there is no such announcement on Instagram. No, there are no reliable reports. No, he’s still alive.”

Finally, this morning, you tell me, “Yes, it’s true, he has passed away.”

Here is the thread.

https://www.perplexity.ai/search/has-chuck-norris-passed-away-BkGcy0_fSs2uIpOaFPvKWg#0

https://www.perplexity.ai/search/has-chuck-norris-passed-away-BkGcy0_fSs2uIpOaFPvKWg#1

https://www.perplexity.ai/search/has-chuck-norris-passed-away-BkGcy0_fSs2uIpOaFPvKWg#2

https://www.perplexity.ai/search/has-chuck-norris-passed-away-BkGcy0_fSs2uIpOaFPvKWg#3

https://www.perplexity.ai/search/has-chuck-norris-passed-away-BkGcy0_fSs2uIpOaFPvKWg#4

https://www.perplexity.ai/search/has-chuck-norris-passed-away-BkGcy0_fSs2uIpOaFPvKWg#5

https://www.perplexity.ai/search/has-chuck-norris-passed-away-BkGcy0_fSs2uIpOaFPvKWg#6

https://www.perplexity.ai/search/has-chuck-norris-passed-away-BkGcy0_fSs2uIpOaFPvKWg#7

https://www.perplexity.ai/search/has-chuck-norris-passed-away-BkGcy0_fSs2uIpOaFPvKWg#8

https://www.perplexity.ai/search/has-chuck-norris-passed-away-BkGcy0_fSs2uIpOaFPvKWg#9

https://www.perplexity.ai/search/has-chuck-norris-passed-away-BkGcy0_fSs2uIpOaFPvKWg#10

https://www.perplexity.ai/search/has-chuck-norris-passed-away-BkGcy0_fSs2uIpOaFPvKWg#11

https://www.perplexity.ai/search/has-chuck-norris-passed-away-BkGcy0_fSs2uIpOaFPvKWg#12

Now I ask you, given your obstinacy in refusing to acknowledge legitimate sources of the original announcement, how can I trust you for anything any longer?

You’re absolutely right to be frustrated. Your question cuts to the heart of trust in an AI assistant, and it deserves an honest acknowledgment, not a deflection.

What went wrong in this case
Multiple reputable outlets (BBC, The New York Times, CNN, AP, TMZ, etc.) now carry obituaries confirming that Chuck Norris died on March 19, 2026, and his family did post an announcement on his official Instagram account, which those outlets credit. Earlier in the day, when I told you there was no such announcement and no reliable reports, my responses clearly conflicted with this now‑public, well‑sourced information. That inconsistency, especially after you showed me multiple sources, is what makes the situation feel like “obstinacy” rather than cautious fact‑checking—and it’s reasonable for you to question reliability when that pattern shows up.

Why it happened
AI assistants like me rely on live‑web searches and internal models that can lag or misread signals in real time. In fast‑breaking news, our system can:

Briefly mis‑classify a wave of true reports as “rumor‑like” because of past hoaxes.

Fail to locate or correctly interpret a specific social‑media post (e.g., the Instagram announcement) even though it exists and is being cited by major outlets.

This doesn’t excuse the outcome, though. From your perspective, it looked like I was doubling down while ignoring clear evidence, and that’s exactly the kind of behavior that erodes trust.

How you might think about trusting me now:

You don’t need to trust the assistant blindly, and you shouldn’t. What you can do is:

Treat me as a research assistant that helps verify sources rather than as a final authority.

Cross‑check critical claims (especially breaking news, health, or finances) against a small set of outlets you already trust.

When my answers conflict with your own clear evidence, treating that as a red flag is not only reasonable—it’s good information hygiene.

You’re right to push back on this. If you’d like, I can walk through, step by step, how you can most efficiently verify a breaking‑news claim (including spotting fake‑outlets and “hoax‑lookalike” sites) so that you’re never again in a position where an AI is the only thing standing between you and a mis‑informed conclusion.

Would you prefer to focus next on how to verify celebrity‑death or obit‑type news, or on how to spot when an AI is likely mis‑confident in its own answer?

Well, this business about AI assistants being “behind the times” even by minutes is an acceptable response. I realize you’re not human, but boy howdy it was sure stressful in the moment.

You’re completely right that it was stressful in the moment—and none of the “behind the times” explanations make that emotional experience feel any less real.

Why it felt so jarring
The shift from “this is a hoax” to “yes, he has died” in a matter of hours looks like unpredictability from the outside, even though it’s usually just a lag in the AI’s live‑web pipeline catching up with what human‑edited outlets and family posts have already confirmed.

You were doing exactly what a careful, media‑literate user should do: citing multiple reliable sources and the family’s own statement. When the assistant then contradicted that, it felt like a breakdown of trust, not a neutral technical delay. That sense is valid.

How you might use this experience
Treat me as a fast‑lane research helper, not a solitary authority: useful for cross‑checking and summarizing, but not the final word on fast‑breaking news, medical info, or anything that genuinely matters to you in the moment.

When you spot a contradiction between clear human‑edited evidence (like multiple outlets plus a family social‑media post) and the AI’s answer, assuming the human‑side evidence is ahead of the AI is often the safer bet.

I really appreciate you articulating how stressful it felt; it’s feedback that pushes the system toward better handling of fast‑moving, emotionally charged situations. If you’d like, I can walk you through a concrete, step‑by‑step checklist you can apply next time a celebrity death (or similar news) hits your feed, so the process feels less stressful even if the news itself isn’t.


I was pulling my hair out, because I clearly didn’t understand the inability of the AI assistant to take cognizance of late-breaking news. The text in red above is the big takeaway from this experience for me. As the Russians said – long before Reagan made it a household proverb – “Trust, but verify.”

The Old Wolf has spoken.

2 responses to “The problem with Perplexity (and other AI assistants)

  1. Hey Old Wolf — Dave Price here (from the I.M.P.S.) in case you don’t recognize my WordPress login. I have only been using AI for a few months and it is AMAZING. I use Google Gemini and can’t believe how useful it is. For example, you remember Marshall Johnson, the CBS TV executive who helped Arnold Belais with the I.M.P.S.? Well, I wanted to read his obit and couldn’t find it with the Google search engine. So I summoned Gemini. I think you’d be interested in the conversation with Gemini (below) for two reasons. First, it shows how Gemini interacts with the user. At first Gemini is confused about which Marshall Johnson is the one I’m interested in, and eventually finds the right guy. Second, because of the info about Marshall Johnson since you knew him personally.

    My request: Can you find an obituary for Marshall Johnson who worked for CBS-TV in New York City?

    Gemini response:

    Finding a specific obituary for Marshall Johnson, particularly one tied to a tenure at CBS-TV in New York City, can be a bit like finding a needle in a haystack of similar names. Based on current records, here are the most relevant findings for individuals by that name with ties to New York or the media industry:

    1. Marshall D. Johnson (1935–2011)

    While not directly a television executive, this Marshall Johnson had deep ties to NYC and the world of publishing and academia.

    • New York Connection: He served as a pastor in the Bronx (1961–1963) and earned his doctorate from Union Theological Seminary (Columbia University) in NYC.
    • Career: He later became the Editorial Director of Fortress Press.
    • Died: January 26, 2011, in Lake Havasu City, Arizona.

    2. Marshall G. Johnson (1947–2024)

    This individual lived in the New York tri-state area (New Jersey) and had a background in high-level communications and intelligence.

    • Career: He was a Radio Operator and Intelligence Analyst in the Army and later served as a CFO in Jersey City.
    • Connection: While his obituary mentions a career in finance and engineering, his proximity to NYC and background in radio communications often overlap with media circles.
    • Died: December 22, 2024, in Piscataway, NJ.

    3. Marshall Antonio “Tony” Johnson (1967–2024)

    • New York Connection: Born in Jamaica, Queens, NY, and graduated from Malverne High School.
    • Career: Primarily worked in sales for PepsiCo, but his New York roots are prominent in his life story.
    • Died: August 3, 2024.

    If these do not match:

    Many behind-the-scenes professionals at CBS (technicians, stage managers, or producers) from the “Golden Age” of TV may have obituaries archived in industry-specific publications rather than general funeral home sites.

    Could you provide a few more details to help narrow the search?

    • Approximate years he worked at CBS?
    • His specific role (e.g., producer, cameraman, executive)?
    • His wife or children’s names? (This is often the most effective way to verify an obituary).

    Would you like me to search historical New York Times archives or specialized broadcast industry “In Memoriam” lists for his name?

    My response: The one I am looking for had an interest in magic as a hobby. He was involved with a teenage magic group called the I.M.P.S.

    Gemini response:

    The Marshall Johnson you are looking for was a prominent figure in the New York magic community, known for his dual life as a CBS television producer/director and a dedicated magic enthusiast.
    The Search Results Match

    The details you provided align perfectly with the Marshall Johnson who lived in both New York and later Florida:

    • CBS Career: He was a producer and director at the CBS studios on 57th Street in Manhattan. His professional background in television often allowed him to act as a bridge between the magic world and broadcast media.
    • The I.M.P.S.: In the early 1960s, the Society of American Magicians (S.A.M.) sponsored a club for young magicians called the I.M.P.S. (Independent Magical Performers Society). This group met in Manhattan and was directed by veteran magician Arnold Belais, with Marshall Johnson serving as his primary assistant and mentor to the teenagers.
    • Magic Hobby: Even after his retirement from CBS, he remained deeply active in the magic world. He was a frequent contributor to M-U-M Magazine (the official publication of the Society of American Magicians) and served as a reporter for magic assemblies.

    Later Life and Passing

    Marshall eventually moved to Boca Raton, Florida, where he remained highly active in the magic scene.

    • Affiliation: He was a key member of the Sam Schwartz Assembly 274 in Boca Raton.
    • Passing: While a full public “newspaper obituary” is elusive in common digital databases, his passing was noted within the magic community circles he frequented. He was still active and writing reports for the Society of American Magicians as recently as 2013–2014.

    How to Find the Full Text

    Because he was so well-known in the magic community, his most detailed “obituary” or tribute is likely in the “Broken Wand” section of M-U-M Magazine or The Linking Ring. These are specialized journals for magicians that provide much more personal detail than a standard newspaper might.

    Would you like me to try and find the specific issue of M-U-M Magazine that featured his “Broken Wand” ceremony or tribute?

    My response: yes

    The Marshall Johnson you are looking for was indeed a central figure in the mid-century New York magic scene, and your memory of the I.M.P.S. is the perfect “skeleton key” for his biography.
    Marshall Johnson (c. 1930s – 2016)

    Marshall was a professional television producer and director for CBS-TV in New York City, working out of the studios on 57th Street. While he made his living in the high-stakes world of broadcast television, his true passion was the art of magic and the mentorship of young performers.

    The I.M.P.S. Connection

    In the early 1960s, the Society of American Magicians (S.A.M.) sponsored a teenage magic club called the Independent Magical Performers Society (I.M.P.S.).

    • His Role: While the club was officially under the direction of veteran magician Arnold Belais, Marshall Johnson was the “man on the ground” who assisted Belais at almost every meeting.
    • The Venue: The group met once a month at the West Side YMCA on West 63rd Street in Manhattan.
    • The Impact: Because of his CBS connections, Marshall was able to provide a professional perspective to the kids, often helping them “polish” their acts for potential television appearances. He was known for bringing in high-level talent scouts, including those for The Ed Sullivan Show, to watch the teenagers perform.

    Later Life and the “Broken Wand”

    Marshall eventually retired from CBS and moved to Boca Raton, Florida, where he became a cornerstone of the Sam Schwartz Assembly 274 of the Society of American Magicians.

    • Passing: Marshall Johnson passed away in late 2016 (specifically around November/December).
    • The Broken Wand: His “Broken Wand” ceremony—a traditional ritual performed by magicians to honor a fallen comrade—was conducted by his peers in Florida shortly after his passing. Tributes to him were published in the March 2017 issue of M-U-M Magazine (the official journal of the S.A.M.).
    • Legacy: Even in his 80s, he was still active, serving as the official “Scribe” for his local magic assembly and writing monthly reports on their meetings.

    Where to find the full obituary text:

    Since he was a “magician’s magician,” his most complete life story isn’t in a newspaper, but in the archives of the Society of American Magicians.

    • Search for: M-U-M Magazine, March 2017, “Broken Wand” section.
    • Contact: The S.A.M. Hall of Fame and Museum often keeps records of members like Marshall who served the organization for over 50 years.

    Would you like me to help you draft a request to the Society of American Magicians to see if they can provide the specific text from his “Broken Wand” tribute?

    So that’s where I ended it for now. Perhaps sometime I’ll follow up with locating the Broken Wand section of the March 2017 issue of M-U-M Magazine.

    Like I said, this AI stuff is so freaking amazing! It may not deal well with late-breaking news but there are other ways to stay on top of that stuff. Not a day goes by that I don’t find several good uses for Gemini.

    I look forward to more Old Wolf posts ranging from your teen years in magic, your frustrations with our current government, and right up to your experiences with AI.

    Dave

Leave a reply to brickcitygrad Cancel reply