How to fact-check health medical information from Chatbot AI, & internet sources

The growth of Chatbot artificial intelligence (AI) improves access and efficiency of obtaining information about health and medical issues that individuals are facing. Internet websites, blog postings, social media platforms, and Chatbot AI searches are convenient starting points for quick health and medical information.

However, how do we know what you read and hear online is credible?

Epistemology is the study of knowledge, or how we come to know things.

How Chatbot AI comes to know things is the epistemology of internet information.

How do we know whether what we find online is really known?

When using information, we must be aware of the limitations of technology and use critical thinking when evaluating the information.

We need to reach beyond, to do more than read, listen, and accept that:

• It makes sense.
• It fits with the way I see the world.
• I am going with my gut.
• I heard it from a Guru.
• Mom told me.

This unquestioning way of knowing is naive and dangerous.

Sometimes, the information available online is not perfect or reliable. These tools can provide misleading information, misrepresent sources, or leave out important context.

Trusting information from a chatbot AI without verification is like drinking water from a stream. It might look clear and refreshing, but you won't know if it's safe until you test it.

What are the considerations in how to fact-check health information from Chatbot AI, & internet sources?

Who wrote/said it?

Some AI platforms provide citations, others require more searching.

Go to the primary source and verify information without interpretation of the AI or the blog poster.

Is there more than one source? Is the information corroborated by multiple reliable sources? Has the information undergone peer review?

Whether the information is from AI or social media influencers the points should be evidence-based and patient-centered.

Who published/posted it?

Use reliable sources, government agencies, medical organizations, and academic institutions.

The internet domain extension can provide a clue regarding trustworthiness.

• .edu websites are educational resources and are considered trustworthy. However, the school does not usually monitor students’ personal Web sites even though they are on the school's server and use the .edu domain.
• .gov websites are government-affiliated are often considered credible and tend to provide citations listed with information.
• .org websites are advocacy or non-profit organizations. You may need to determine if the information from these sources has a bias.
• .com websites contain some commercial aspects. There is a monetary incentive behind every commercial site in providing you with information. They can be credible but be sure to check citations for any potential bias.

Peer-reviewed writing means it is more trustworthy. Dot com blog postings are not peer-reviewed but can cite information from peer-reviewed information.

A majority of the citations in the PubMed database are peer-reviewed. Other databases may have a filter to list only publications that are peer-reviewed. In addition to searching PubMed using keywords for diagnosis or interventions, searches can be done using the author’s name. Checking to see if a social media influencer is indexed in PubMed is a way to assess their authenticity and credibility. Search for the last name followed by first name, no comma Howell Damien.

Does the information provided have an agenda & bias?

Be wary of bias and conflicts of interest.

Recognize internet search engine algorithms can contribute to confirmation bias.

When faced with uncertainty recognition of bias is important.

If all you have is a hammer the whole world looks like nails.

What is your bias?

Pause, actively self-examine your own personal prejudice or preconceived notions, and actively seek out alternative viewpoints of perspective to ensure you are making informed decisions.

Being presented with facts suggesting our current beliefs are wrong is threatening. It is difficult to unlearn what our experiences may have told us.

Is there any other information that would be useful?

The following are previous blog posts that explore consideration of the alternative.

• Pain – What does it feel like? How this information can guide intervention.
• Understanding the nuances of disease, syndrome, & uncertainty in musculoskeletal pain.
• Path of least resistance is not always the best option – sometimes it is better to have some stiffness.
• Intellectual humility & tolerance for ambiguity.

Seek a consultation from a licensed healthcare professional to analyze/review the information obtained.

Reach out for a professional analysis. Telemedicine and electronic medical records platforms, along with patient portals and email, provide opportunities to ask health professionals questions.

Publications of peer-reviewed journal articles now provide the email addresses of the authors allowing discussion.

“You know”

“You know” is the ubiquitous gap-filler or filler-word that a speaker uses as a moment to pause and think before continuing a sentence.

If you say or when you hear “yada, yada, yada, you know yada, yada, yada,” why not actually take a longer pause than the word-filler of “you know.” Take a moment and reflect do you or they really know?

Ask how do you/they know?

The more you know the more you know you don’t know – Aristotle

 

The information on this website is not intended or implied to be a substitute for professional medical advice, diagnosis, or treatment. You are encouraged to perform additional research regarding any information contained available through this website with other sources and consult with your physician.