With many Americans increasingly turning to Large Language Models for health advice, hospitals across the United States are introducing their own branded chatbots. This trend aims to harness the popularity of AI tools and direct patients to their services. Executives, like Allon Bloch, CEO of K Health, describe these chatbots as a means of providing convenience and digital equity in healthcare. K Health is collaborating with Hartford HealthCare in Connecticut to implement its PatientGPT chatbot for tens of thousands of patients. However, experts caution that the readiness of these chatbots remains questionable. Concerns about monitoring, liability, and the actual effectiveness in addressing patient care issues are prevalent. Adam Rodman, a clinical reasoning researcher, points out that there is currently no substantial evidence indicating that chatbots can enhance patient outcomes. As hospitals navigate this emerging technology, the potential benefits for patients remain largely theoretical.