Skip to content
Pioneer Page PP markPPPIONEERPAGE

Pages from the advancing edge of computing.

Research desk

Apple launches 200,000-person study to evaluate conversational AI health tools with OpenEvidence

Apple and OpenEvidence begin enrolling US adults in an iOS study to rate the accuracy and relevance of AI-generated medical answers.

Apple launches 200,000-person study to evaluate conversational AI health tools with OpenEvidence
Depth
1 outlet · newest source 161h ago

Key points

  • Apple launched the Apple Health AI Usage Study with OpenEvidence to assess how users interact with conversational health AI.
  • The study app does not use Apple Intelligence or Siri, relying instead on text prompts and optional HealthKit data sharing.

Apple announced the launch of the Apple Health AI Usage Study today, aiming to measure how effectively people use conversational AI for health queries. The company is partnering with OpenEvidence, a clinical AI platform that generates answers from sources like The New England Journal of Medicine, to conduct this research.Apple is starting a study to see how useful AI health answers are for everyday users.Apple and OpenEvidence are launching a user study to evaluate the utility of conversational AI in health contexts.

How we got here

Apple has been integrating more AI features into its ecosystem. However, this specific study focuses on a dedicated research app rather than general system features. The goal is to understand user engagement with health AI in everyday life, according to Sumbul Desai, MD, Apple’s vice president of Health and Fitness.

Evidence: reportedApple’s new study looks to improve the effectiveness of AI health tools

aifleet-verge-all

What is new

Enrollment for the study started today, with Apple seeking up to 200,000 participants. The new iOS app allows users to ask medical questions and rate responses based on accuracy, detail, and relevance. Participants must be based in the US and at least 21 years old.

Evidence: reportedApple’s new study looks to improve the effectiveness of AI health tools

aifleet-verge-all

Evidence: reportedApple’s new study looks to improve the effectiveness of AI health tools

aifleet-verge-all

Reading between the lines

Users can share Apple HealthKit data, such as activity or lab results, to provide context, though this is optional. Apple stated that the collected data will not be used to train AI models.

The open questions

The study claims to improve AI health tool design by understanding user comprehension and evaluation. However, the sources do not specify how the ratings will be aggregated or validated against clinical outcomes. It remains unclear if the inclusion of personal health data significantly alters the perceived accuracy of the AI responses compared to generic queries.

Why it matters

  • Model evaluators can observe how a major tech vendor structures user feedback loops for health-specific AI applications.
  • The exclusion of Apple Intelligence indicates the study relies on a separate clinical AI platform rather than system-wide features.
  • The promise that data won't train models addresses privacy concerns, as stated by Apple in the announcement.

Topics: health AI, Apple, OpenEvidence, user study, iOS

Updated

The strongest doubt

Counterpoint from the sources

The source material does not present any opposing viewpoints or doubts regarding the study's methodology or goals.

Ask the article

Local keyword search of this article; no generated answers.

Did this article give you the evidence you needed?

No vote saved on this device.
Your choice stays on this device. No public tally.

Questions readers ask

Does the study app use Siri or Apple Intelligence?

No, the app relies on text-based prompts and is not integrated with Siri or Apple Intelligence.

Will my health data be used to train AI models?

Apple states that the data collected for this study will not be used to train AI models.

Connected stories

This storyApple memory costs surge as AI demand tightens supply through 2027Apple memory costs surge as AI dApple engineering AI daily cap drops from $300 to $200Apple engineering AI daily cap dApple paper uses convex analysis to speed up RAG retrieval searchApple paper uses convex analysisAMD earnings test AI revenue claims before Friday jobs dataAMD earnings test AI revenue cla

Reading receipt

  • Apple launched the Apple Health AI Usage Study with OpenEvidence to assess how users interact with conversational health AI.
  • The study app does not use Apple Intelligence or Siri, relying instead on text prompts and optional HealthKit data sharing.

Still open: How will the user ratings be correlated with clinical accuracy?

Still open: What specific design changes will result from the study insights?

Time spent: 0:00 · Depth: Full

Sources

  1. The Verge (all)

Related stories