Originally published on Guiding Stars Health & Nutrition News
Long gone are the days when “consulting Dr. Google” was the only online tool for quick information on health issues. These days there are many free, Artificial Intelligence (AI) powered online agents (or “chatbots”) available to anyone with internet access or a smartphone. Looking for a heart-healthy meal plan? Want to estimate the calories in your lunch just using a photo of your plate? Need a list of the best food sources of magnesium? If you’ve got a question, AI will supply an answer in mere seconds. But is it quality information? It can be hard to tell. Here are our top suggestions for vetting nutrition information gleaned from an AI source.
Consider AI a Tool, Not an Authority
Just like in “real life,” it’s always best to get a second opinion when it comes to important health-related questions. Compare the information you get from an AI summary to what you find from a trusted and reputable source. Some examples of places you can cross-reference with include:
- National Institutes of Health
- Academy of Nutrition and Dietetics
- American Heart Association
- American Cancer Society
- Mayo Clinic or Cleveland Clinic
- Various government agencies (look for .gov in the URL)
- Various university health systems and centers
In general, AI health information isn’t known for a high degree of accuracy. For example, a recent systematic review of multiple studies found that AI is pretty good at answering simple questions. But more involved tasks, like constructing meal plans for people with multiple health conditions (like type 2 diabetes and a food allergy), increase inaccuracies. Let’s say you stick to simple queries, such as “How can I add more beans to my diet?” In that case, you’re fine to get a quick AI answer and see if any ideas appeal to you. But then there are more complicated or important questions, like “Will my hair and nails supplement interfere with my medications?” For those kinds of searches, you probably don’t want to rely on an AI answer as the final word.
Convenience isn’t a replacement for critical thinking, and higher-stakes health issues deserve professional guidance. Do more research and ask your doctor or dietitian—they actually know you.
Ask for Evidence
AI responses to health and nutrition questions often don’t provide source information. And without the evidence, you can’t check to see what the truth really is. It’s not that AI sets out to lie about things, it’s more that the process of reviewing and distilling large quantities of information doesn’t guarantee high-quality results. Not all sources of nutrition information deserve the same amount of consideration. And scientific nuance is not AI’s strong suit.
In addition, AI agents don’t review all published research before answering—they simply don’t have access to everything published. So you need to specifically ask AI for answers based on published, scientific evidence, and for links to the references. Then click those links and check those reference articles.
You should also be aware that AI sometimes “hallucinates” references. Despite looking like real scientific references, they are made up! It’s easy to check and see if the studies cited actually exist—and confirm if what AI told you is correct. Yes, it takes more time than just reading an AI overview and going with whatever it says. But we’re talking about your health. And if you can’t trust that you’re getting quality information, what’s the point of asking?
Determine if It Applies to You
Nutrition is a very context-dependent science. General or “cookie-cutter” nutrition guidance isn’t necessarily appropriate for every individual. You are unique. Consider your age, gender, family history of health issues, specific medical diagnoses, and medication list. And don’t forget your possible allergies, food preferences, budgetary considerations, and more. All of these factors play into whether certain nutrition advice will apply to you, so the research AI used to create that nutrition advice may not be relevant to you.
So once you look at what AI delivered, take a moment and ask yourself, “Does this information actually apply to my situation?” If not, perhaps change the question you asked and give more information about your situation or your unique conditions. Then the AI agent should be able to give you more targeted and appropriate advice. And as always, double check with your doctor before changing anything with your diet, supplements, or medications.
Guiding Stars is an objective, evidence-based, nutrition guidance program that evaluates foods and beverages to make nutritious choices simple. Products that meet transparent nutrition criteria earn a 1, 2, or 3 star rating for good, better, and best nutrition. Guiding Stars can be found in more than 2,000 grocery stores, in Circana’ Attribute Marketplace, and through the Guiding Stars Food Finder app.