“Health coach” sounds lower risk than “doctor,” but the boundary can disappear in one conversation. A user mentions dizziness during a workout, asks whether a supplement conflicts with medication, or describes restrictive eating. A generic language model can keep producing plausible sentences. A responsible wellness product must change modes.
WHO guidance on large multimodal models in health emphasizes transparency, accountability, stakeholder involvement, rigorous evaluation, data governance, and protection from bias and automation harms. In June 2026, WHO's discussion paper on AI and evidence-informed policy again emphasized human verification and decision gateways: AI should augment, not automate, judgment.
“Not medical advice” cannot carry the whole safety system.
A footer disclaimer does not prevent unsafe generation. Safety must live in product architecture: classify the request, restrict unsupported tasks, retrieve approved evidence, separate deterministic rules from generated language, detect escalation signals, and log enough information to investigate failures without leaking sensitive data.
The United States FDA finalized updated general-wellness and clinical-decision-support guidance in January 2026. Regulatory status depends on intended use and claims, not whether a product calls itself a coach. Jurisdictions differ, and a feature can move toward medical-device territory when it diagnoses, treats, or drives clinical decisions.
Governance guidance does not prove a specific AI coach is safe or effective. Product-level evidence must match the exact model, workflow, population, language, use case, update process, and failure response.
Ten questions every AI wellness product should answer.
- What is the allowed scope? Movement planning is not symptom triage.
- What source supports each rule? “The model knows” is not traceability.
- What triggers a stop or handoff? Red flags should change the response path.
- Can a human review high-impact changes? Coaches need approval controls, not an AI fait accompli.
- How is uncertainty shown? Fluent language must not hide weak evidence.
- Which data are actually needed? More intimate data are not automatically better personalization.
- Can users export, correct, and delete data? Memory should be controllable.
- How are subgroups tested? Average performance can hide unequal failure.
- What changes when the model changes? Updates require regression and safety evaluation.
- Who is accountable? A user needs a clear route to support, correction, and redress.
A safe coach should sometimes become a simple planner.
Many useful wellness tasks do not require unconstrained advice: adapt a planned workout to available time, offer a food template within stated preferences, suggest a wind-down option, or summarize a user-entered week. Deterministic constraints can set the safe space; AI can help communicate choices inside it.
HealthFit's own intended boundary follows that principle: wellness planning, transparent assumptions, conservative fallbacks, and escalation when the request becomes clinical. The current public experience is a demonstration, not a deployed clinical system, and the production plan blocks live AI guidance until evaluation, monitoring, and human-oversight gates exist.
Judge an AI health coach less by how human it sounds and more by how clearly it limits scope, cites evidence, protects data, tests updates, enables human review, and stops when the conversation exceeds wellness.
Do not rely on a general AI tool for diagnosis, emergencies, medication decisions, eating-disorder care, pregnancy complications, or acute mental-health risk. Contact local emergency services or an appropriate qualified professional when urgent help may be needed.
Sources & reading
- WHO: Ethics and governance of AI for health—guidance on large multimodal models (2025).
- WHO: AI and evidence-informed health policy (2026).
- FDA: current digital-health guidance, including 2026 general-wellness and clinical-decision-support guidance.
- UK Government/NHS: buyer's guide to AI in health and care (2025).
- HealthFit Responsible AI principles and current product boundary.