Can AI Be Trusted for Menopause Advice?
Artificial intelligence is now part of everyday life. Women use it to draft emails, plan meals, and increasingly, to ask health questions. Menopause is no exception. Many women turn to AI tools for quick answers about symptoms, hormone therapy, and risks.
But a growing body of evidence suggests we need to slow down before trusting those answers.
New research presented at The Menopause Society 2025 Annual Meeting raises serious concerns about how accurately popular AI systems answer menopause related questions. The findings matter for patients and clinicians alike.
AI tools should not replace clinical judgment or evidence review.
What the Study Looked At
Researchers evaluated how well several widely used AI platforms answered common menopause questions. These included:
Questions a patient might ask, such as symptoms or hormone therapy basics
Questions a clinician might ask, including treatment decisions and guideline level issues
The platforms tested included:
ChatGPT 3.5
ChatGPT 4.0
Google Gemini
OpenEvidence, a tool often marketed to clinicians
A group of menopause experts reviewed each response and compared it to established clinical guidelines. Answers were scored as correct, partially correct, or incorrect.
The Results Were Concerning
Even the best performing system struggled.
For patient level questions:
ChatGPT 3.5 answered just over half correctly
ChatGPT 4.0 performed worse, with fewer than half correct
Google Gemini had the lowest accuracy, with only about one third correct
For clinician level questions, performance dropped further:
No platform answered even half correctly
Some tools produced more incorrect answers than correct ones
In other words, many responses sounded confident but did not align with current medical guidance.
Readable Does Not Mean Reliable
One interesting finding involved readability.
Some platforms produced simpler, easier to read responses. That may feel reassuring to users. But those same responses were often less accurate.
Clear language is important. Accurate information is essential. When the two do not align, women may receive advice that sounds helpful but is incomplete or wrong.
The Risk of Confident Errors
One of the most important concerns raised by experts is something called hallucination. This happens when AI generates information that sounds plausible but is not based on real evidence.
In menopause care, this can be dangerous. Decisions about hormone therapy, cardiovascular risk, bone health, and cancer history require precision. An incorrect answer can lead to unnecessary fear or false reassurance.
What This Means for Women
AI can be a starting point. It should not be the final word.
If you use AI to explore menopause questions:
Treat the answers as informational, not medical advice
Look for references from trusted organizations
Bring questions to a qualified clinician who understands menopause care
Most importantly, do not assume that a polished answer equals a correct one.
What This Means for Clinicians
For healthcare professionals, the message is clear.
AI tools should not replace clinical judgment or evidence review. References must be checked. Guidelines from trusted bodies like The Menopause Society and ACOG remain the gold standard.
Menopause care is already an area where misinformation is common. Adding unchecked AI output only widens the gap.
The Bottom Line
Technology is moving fast. Medical science moves carefully for a reason.
AI has potential to support education, but it is not yet reliable enough to guide menopause care on its own. Women deserve accurate, evidence based information, especially during a life stage that already feels confusing and under addressed.
Until AI tools consistently meet that standard, human expertise still matters most.
Defy Menopause - Own the Change
Many women tell me: "One day I feel amazing. The next, I can barely get out of bed. Is this normal?"
Yes, it is. And no, you don’t have to suffer through it alone.
Hormonal fluctuations during perimenopause can make you feel like you’ve lost control of your body. But knowledge is powerful. And there are clear, science-backed ways to support your hormones, ease symptoms, and reclaim your energy.
That’s exactly why I created Defy Menopause: Own the Change — a 30-day program designed to give you the tools, knowledge, and support you need to move through these changes with clarity and confidence.
Inside, you’ll find:
Weekly access to Dr. Tracy Verrico at live, group sessions
Clear action steps for managing symptoms naturally
Because you deserve more than just "putting up with it."
You deserve to thrive.
Let’s Connect
Schedule an Appointment | LinkedIn | YouTube | Instagram | Bona Dea Gynecology
References
Karam J et al. Evaluation of large language model accuracy for menopause related questions. Presented at The Menopause Society Annual Meeting. Orlando, FL. 2025.
Goldman M. Expert commentary on AI use in menopause care. Medscape Medical News. 2025.
The Menopause Society. Clinical practice guidelines and position statements.
American College of Obstetricians and Gynecologists. Menopause management guidance.
Medical Disclaimer: The information provided in this blog is for general educational and informational purposes only and is not intended as, nor should it be considered, medical advice. This content does not establish a physician-patient relationship and is not a substitute for professional medical advice, diagnosis, or treatment. Always seek the advice of your physician or other qualified healthcare provider with any questions you may have regarding a medical condition. Never disregard professional medical advice or delay seeking it because of something you have read in this newsletter. If you think you may have a medical emergency, call your doctor or emergency services immediately.
