COLOSS B-RAP expert evaluation of beekeeping advice from ChatGPT, part 2

The artificial intelligence (AI) chatbot or advanced language model (LLM) ChatGPT is capable of understanding and generating human-like text. This article is a sequel to our first article on this topic, in which we imagined an AI tool that would serve as a beekeeping advisory tool in the future after having been trained with information stemming from high quality public domain resources on beekeeping and bee diseases (Morawetz et al., Citation2024). In that article, we presented the first part of the COLOSS B-RAP AI challenge, in which we asked ChatGPT-3.5 for advice regarding the serious honey bee disease American Foulbrood, which is a notifiable disease in many countries. We concluded that the tested AI chatbot version is a good teacher for basic or general beekeeping knowledge. It summarizes common knowledge about bee diseases at a level of detail that can be found in general beekeeping textbooks or in a beginners’ course in beekeeping. As a summarization tool, it was, for example, used to write the recently published book on bee diseases by Walker (Citation2024) to provide a comprehensive and structured overview of the topic. Nonetheless, it was concluded by the expert panel that advice from ChatGPT should be avoided for critical situations needing immediate action by the beekeeper, such as notifiable or severe diseases (Morawetz et al., Citation2024). Worryingly, part of the advice given was identified as misleading, wrong, or of limited usefulness in the given context and may easily lead to the spread of notifiable diseases and to severe consequences for the beekeeper and the beekeeping neighbors.