In this lightning talk I share (a few) key observations from a literature review focused on understanding the design/use of conversational agents in museums (from 1996-2023). Based on these observations, I provoke a reflection on how certain ideals shape these initiatives and speculation on future design alternatives for engaging with heritage. The talk was given as part of the workshop help by the University of Glasgow: AI in Cultural Heritage: lessons learned and ways forward.