We've covered what the labs ship and what the boom costs. Today: where AI has quietly ended up — inside decisions people used to make with a professional, a family member, or nobody at all.
None of this was announced with a keynote. It just happened.
In today's issue:
🩺 ChatGPT is now a health system with no doctor in it
💸 $16 billion lost to fraud — and why AI makes the old advice useless
🛒 AI agents are starting to buy things for you
👧 72% of US teens have used an AI companion
🧭 A three-question test for using AI on personal stuff
Reading time: 5 minutes.
🩺 The health system nobody built
On September 1, OpenAI connected ChatGPT Health to Epic, the electronic health record system covering over 325 million patients. Clinicians can now pull appointment notes, lab results, medications and specialist documentation into ChatGPT.
But the number buried in that announcement is the real story: people already send ChatGPT 300 million health-related questions every week.
THE BREAKDOWN:
The Epic integration is read-only — the AI can read records, it can't write to them. OpenAI says it tested 27 clinical use cases with 4,300+ physicians and rated 99.1% of responses safe. It also states plainly that the AI is not suitable for diagnosis or treatment.
The announcement follows multiple lawsuits alleging harmful medical advice from ChatGPT.
Meanwhile, a parallel system has assembled itself around consumers: $99 fifty-biomarker blood panels from Oura and Quest, Function Health at a $2.5B valuation offering 160 annual lab tests plus AI analysis of the results, and services like Ro and Hims writing prescriptions from asynchronous intake forms. One company, Doctronic, reports 24 million AI consultations.
Clinicians writing in STAT call this a "shadow medical system" — the work that used to happen inside a clinic, sold as consumer products.
The uncomfortable finding: AI performs at 90%+ accuracy when it has the complete case, but fails to produce a proper list of possible diagnoses 80% of the time when working from the kind of vague information a patient actually starts with.
And the medical disclaimers that used to appear in chatbot answers have largely disappeared.
WHY IT MATTERS: This is the widest gap in AI right now. Not between what models can do and what they claim — between how good AI is with a full picture and how people actually use it: at 2am, with three symptoms and a fear. The technology is genuinely useful for organising information, translating jargon, and preparing questions before an appointment. It is weakest at exactly the step people most want it for — deciding what's wrong.
Practical version: use AI to understand your results and prepare better questions. Don't use it to decide whether to worry.
📎 Sources: TechCrunch · OpenAI · STAT
💸 $16 billion gone — and the old advice stopped working
The FTC reported that Americans lost roughly $16 billion to fraud in 2025, up 25% from 2024.
THE BREAKDOWN:
Imposter scams — someone pretending to be your bank, a government agency, a company, or a person you know — accounted for $3.5 billion, nearly three times the 2020 figure.
Nearly one in three fraud reports were imposter scams. Fifth year running as the top category.
Bank impersonators: close to $1 billion. Government impersonators: $920 million, up from $789 million.
The most common play: a fake security alert convincing you to move money somewhere "safe."
WHY IT MATTERS: Every piece of scam advice most of us grew up with was built on detection — spot the bad grammar, listen for the odd accent, look for the blurry logo. Cheap voice cloning and fluent text deleted all of those signals. A voice that sounds exactly like your daughter is now a commodity product.
What replaces detection is procedure:
Agree a family code word. Boring, free, works against a perfect voice clone.
Hang up and call back on a number you already have. Never one you were just given.
Treat urgency itself as the red flag. No real bank, tax office or police force needs you to move money in the next ten minutes.
📎 Source: FTC
🛒 AI agents are starting to do the buying
Shopping is where "AI agents" stop being a demo and start touching your card.
THE BREAKDOWN:
OpenAI has partnered with retailers including Target, Instacart and DoorDash to let people buy inside ChatGPT. Around 2% of ChatGPT queries are shopping-related — roughly 50 million a day.
Amazon is playing both sides: it launched its own "Buy For Me" feature and expanded its Rufus assistant, while blocking outside AI agents from crawling its site — protecting a $56 billion advertising business that only works if humans see the ads.
Consumers aren't sold yet. In one survey of 700 shoppers, only about a third would complete a payment through an AI assistant, mostly over privacy.
Retailers have a structural problem: product catalogues were built for keyword search, not conversation. Most AI shopping experiences are still bad — wrong prices, generic recommendations.
WHY IT MATTERS: This is the first mass-market case where an AI acts with your money rather than giving you words. The fight isn't really about convenience — it's about who owns the moment of choice. Today that moment happens on Amazon's page, surrounded by paid placement. If it moves into a chat window, an entire advertising economy moves with it. That's why Amazon is blocking the door.
For anyone selling online: the practical question for the next 12 months is whether your product data is structured well enough for an AI to describe it correctly. That's the new SEO.
📎 Source: Modern Retail
👧 And the one most people miss
72% of US teens have used an AI companion, according to Common Sense Media's national survey — and about half use them regularly. Not ChatGPT for homework: chatbots designed for conversation and relationship.
This gets covered as a panic story or ignored entirely, and it deserves neither. The useful frame for a parent isn't "is this bad" but "what is it replacing?" A teenager rehearsing a difficult conversation with a bot is doing something different from one who's stopped having difficult conversations with people.
Worth asking, not lecturing: what do you use it for, and what would you have done before?
📎 Source: Common Sense Media
🧭 A three-question test
Before you let AI into a personal decision — health, money, family, legal — run these:
Does it have the full picture? AI is strong with complete information and weak with partial. If you've told it three sentences about a situation with fifty relevant details, you're getting a confident guess.
Is it reversible? Understanding a lab result is reversible. Skipping the appointment isn't. Moving money isn't. Match your trust to the cost of being wrong.
Who's accountable if it's wrong? A doctor, a lawyer and an accountant all carry liability. A chatbot carries none. That's not a reason never to use it — it's a reason to know which one you're talking to.
💬 One question
What's the most personal thing you've asked an AI — and did it help?
Hit reply. We'll share the best answers, anonymously, in a future issue.
That's it for today. Forward this to someone who'd benefit from the code-word tip.
— The artificialintelligence.ai team
