Skip to content

AI News · Edition 87 ·

Your staff's AI chats may not be as private as you think

Paid personal AI accounts may still feed training data. Also: AI finds 948 Linux security flaws, and why updating your systems matters more now.

9 stories · sourced from Hacker News, OpenAI, Moneycontrol.com, Hugging Face and others

Abstract illustration accompanying Your staff's AI chats may not be as private as you think
Abstract illustration, generated with AI. It represents the idea, not the event.

The one that matters

Paying for a personal Gemini plan may not keep your business chats out of AI training

Hacker News ↗

A post with more than 600 upvotes on Hacker News makes a simple claim. Hacker News is the forum where much of the software industry argues about these things. The post says Google's Gemini uses people's chat history to train its AI, and that paying for a subscription on a personal account doesn't change this. The claim is specifically about personal accounts. It is not about company accounts run through an organisation. Right now this is one user's report, not a statement from Google, so treat the details with care. The main point won't surprise anyone who reads AI terms of service closely. Consumer AI products and business AI products usually come with different privacy promises, and the price you pay doesn't decide which one you get. The type of account does.

What this means for your business

Think about who in your organisation actually types into AI tools. In a 600-student school, it is often the office administrator drafting fee reminders that include parents' names and phone numbers. Or it's a teacher pasting in a student's marks to write report-card comments. In a 30-bed clinic, it might be a receptionist asking an assistant to tidy up a discharge summary. In a 40-person workshop, it is the sales manager pasting a customer's specifications and your quoted price to get a cleaner email.

If those people use their own personal accounts, even paid ones, that information may be leaving your control. It could end up in a training system you have no agreement with. For student and patient records, that's more than awkward. India's Digital Personal Data Protection Act and Canada's privacy laws, including provincial health-information rules, hold the organisation that collected the data responsible. Which app a staff member happened to pick is not an excuse.

What it does NOT mean

It does not mean your chats are being published. The realistic risk is not that a stranger types a question and gets your patient's file back word for word. The real issue is control. Once your data is in someone else's training pipeline, you can't say where it went or how long it will be kept. It also does not mean every AI tool is unsafe, or that you should ban AI at work. Staff who are told no usually keep using it quietly on their phones, which is worse. Be sceptical of the loudest online reactions that call this proof all AI is a privacy trap. Be just as wary of anyone who uses stories like this to sell you a “private AI server” costing several lakh rupees. For most small organisations, the fix is a settings change and the right kind of account, not new hardware.

What to do this month

  • Ask, don't assume. Spend 15 minutes asking staff which AI tools they use for work, and on which account. Many owners are surprised by the answer.
  • Check the settings yourself. The major consumer AI tools have history or “improve the model” settings. Look at them on every tool your staff use. Don't rely on a forum post or a salesperson.
  • Move sensitive work to business accounts. Business plans from the major AI vendors generally come with written commitments about how your data is used. Read the actual terms before you buy. Expect to pay roughly ₹500 to ₹2,500, or about C$10 to C$40, per person per month. You only need seats for the people who handle sensitive records. A school might need four seats, not sixty.
  • Write a one-page rule. No student names, patient details, Aadhaar numbers, SINs or health card numbers in any personal AI account. Pin it where people will see it.

None of this needs a consultant. It takes one afternoon and one clear rule, which is more than most businesses have today.

Also worth knowing

  1. OpenAI's automated system found 948 security holes in Linux, so expect a wave of updates

    OpenAI says an automated system found, checked and wrote fixes for 948 flaws in the Linux kernel, the core of the Linux operating system. Each flaw lets someone who already has access to a machine give themselves full control of it. Linux quietly runs a lot of small-business equipment, such as office servers, network storage boxes and routers, so ask whoever manages yours to install updates as they arrive. An attacker needs a way in first, so this is a reason to update, not to panic.

    OpenAI ↗

  2. India's cyber agency CERT-In gets Anthropic's Claude Mythos to test for security weaknesses

    CERT-In, the Indian government body that handles cyber incidents, has been given access to Anthropic's Claude Mythos model to test for cybersecurity weaknesses. Nothing changes for your business today. Read it alongside the Linux story, though: defenders now have AI that finds security holes at scale, and it's sensible to assume attackers will too. That makes old, never-updated systems a bigger risk than they used to be.

    Moneycontrol.com ↗

  3. Developers' most-read essay this week says AI is exposing decades of messy old software

    The most-upvoted post among developers this week argues that AI is forcing companies to pay off 40 years of “technical debt”, meaning the shortcuts and patches piled up inside old systems. The lesson for owners is a familiar one: AI tools work best on tidy data and modern systems. If your records are spread across five spreadsheets and an accounting package from 2009, cleaning that up is probably a better first AI investment than any chatbot.

    Hacker News ↗

  4. Big Tech's hidden AI debt reportedly jumps 90% to $3.2 trillion in six months

    A widely discussed report says hidden AI-related debt at major US tech companies has grown about 90% in six months, to $3.2 trillion. You don't need a view on whether this is a bubble. It is a reminder that today's low AI prices are being paid for partly with borrowed money, so avoid long prepaid AI contracts and don't build a process that only works at today's prices.

    Hacker News ↗

  5. OpenAI's Images 2.6 adds GIFs and finer editing, handy for shop and agency social posts

    OpenAI's latest image tool is faster, can now make GIFs and allows more precise edits. It is available in ChatGPT, Codex and to developers. For a shop or small agency making festival offers and social posts, that saves real time, but don't let it touch up photos of your actual products: customers notice, and in advertising it can become misleading.

    OpenAI ↗

  6. New tool on Hugging Face says it turns any document into neat, structured data fields

    Dharma Field Extractor, posted on Hugging Face, takes in a document and returns its key fields in a structured format that other software can read. Tools like this are what make it possible to automate admission forms, supplier invoices or lab reports. It's a tool for developers, not something to install yourself, but if your staff spend hours retyping paper forms, ask a developer what this kind of automation would cost for your documents.

    Hugging Face ↗

  7. A post titled 'Everything is an AI scam now' strikes a nerve with developers

    A blunt post titled “Everything is an AI scam now” got a lot of attention this week. The title goes too far, but the frustration is real: “AI-powered” is now stamped on products that do little that's new. Before paying extra for the AI version of anything, ask the vendor to show it doing one of your actual tasks, with your own data, in front of you.

    Hacker News ↗

  8. VMware launches a smaller vSphere Express edition for businesses with modest servers

    VMware, whose software runs virtual servers in many company back rooms, has released vSphere Express for setups of up to 128 processor cores. A VMware executive said the company “started listening to a lot of our lower-end customers.” If your IT vendor runs your servers on VMware and your renewal is coming up, ask whether this edition fits your setup, and get a quote before you commit to anything.

    Ars Technica ↗

How this briefing is put together

Every morning we read the day’s AI announcements and reporting from the companies themselves and from the technology press, then pick the handful that actually change something for a working business. The analysis is ours and it is written for owners and managers, not engineers. Every story links to its original source — read them, and disagree with us where we’ve got it wrong.