Artificial intelligence technologies, which surprise us more every day, are gaining more and more capabilities that can replace humans in various fields. Medicine is one of them. We have seen several times that artificial intelligence outperforms doctors. Now a new one has been added.

Googlingpublished a study about a chatbot based on a self-developed language model (LLM). The study found that the chatbot outperformed doctors in medical interviews.

He diagnosed diseases better than doctors and had better empathy

Articulate Medical Intelligence Explorer (AMIE) The model, called the model, is based on talking to patients and their medical histories. from doctors about listing diagnoses More successful happened. The study, which has not yet been peer-reviewed, was published as a preprint on arXiv on January 11.

Google researchers say the model can better diagnose respiratory and cardiovascular diseases. He also adds that during interviews he was able to obtain similar amounts of information as real doctors and even empathize better.

However, it should be emphasized that the model has not yet been tested on real patients. Only patients in the study actors portray had been used. The researchers describe the model as ‘experimental’ and say it is still too early to say anything about it.

20 players simulated 149 different clinical scenarios within the scope of the study. The interviews were also conducted text-based rather than face-to-face. During the conversations, players did not know whether they were talking to real doctors or a chatbot. A group of experts also evaluated the performance of AMIE and physicians. As a result of research into issues such as politeness, explaining the condition and treatment, appearing honest and diagnosis, it was determined that the chatbot on 24 of the 26 criteria He was seen passing the doctors.

AMIE delivers better results than doctors, but will not replace them

Of course, these results do not mean that artificial intelligence will replace doctors. Google researcher Alan Karthikesalingam also commented on the topic:“This in no way means that a language model is better at medical interviews than doctors.” he said. On the other hand, Adam Rodman, a doctor at Harvard, said the tool may be useful but cannot replace doctors: “Medicine is more than collecting information. It’s all about human relationships.”

It is necessary to add this to the research. The participating doctors were never used to conducting such textual interviews. This may have affected their performance and led to artificial intelligence taking the lead.

Still, the research shows that artificial intelligence has the potential to perform similarly to a doctor who can empathize and make a diagnosis based on the patient’s history. The next step in this research is to conduct more detailed studies to evaluate potential biases and ensure that the system produces comparable results in different populations.

We have seen similar developments in the field of artificial intelligence before in the medical world. You can check out some of these in our content below: