Development of a Hands-free, Voice Activated Communication Device for Doctor-Nurse-Allied Health (DNA) P3

Year Submitted: 2024
Published Date: 31 December 2024

Tags: Organisational Leadership, Change Management, System Change

About this Content

Aims

The aim of the project is to introduce a hands-free communication device activated by voice commands, facilitating seamless communication among healthcare professionals. The objectives include enhancing efficiency in initiating secured voice and video calls, empowering staff to make informed and timely decisions on patient care and promoting patient-centered care by extending communication beyond hospital confines. Additionally, the project aims to streamline documentation processes through features like photo-taking and speech-to-text technology. Ultimately, the goal is to improve communication, collaboration, and decision-making in healthcare settings, thereby enhancing patient outcomes and overall care quality.

Background

The project introduces a groundbreaking hands-free communication device activated via voice commands, heralding a new era in healthcare communication. Designed to address the challenges of the current care paradigm, it empowers staff to initiate secured voice and video calls effortlessly, fostering seamless communication within healthcare settings. Whether facilitating 1-to-1 consultations or enabling dynamic 1-to-many discussions, this innovative device represents a significant stride towards TTSH's vision of a hospital without walls. Aligned with TTSH's overarching goals, this initiative not only enhances communication efficiency but also promotes patient empowerment and caregiver engagement. By extending care beyond traditional hospital boundaries, it supports the principle of "Care is a Transition," guiding patients through their healthcare journey with continuity and collaboration. The integration of cutting-edge digital technologies not only streamlines communication processes but also enhances clinical decision-making. Real-time access to patient information and multidisciplinary consultations ensures timely interventions and optimized care delivery. By incorporating features such as photo-taking and speech-to-text capabilities, the device simplifies documentation tasks, allowing healthcare professionals to focus more on patient care. Initial implementation at TTSH Ward 5C serves as a testbed for potential campus-wide deployment and expansion into other care settings, promising a transformative impact on healthcare communication and delivery.

Methods

The project endeavours to conduct a Proof-Of-Concept (POC) to evaluate the capabilities of a proposed hands-free communication device, encompassing voice activation, automated contact search, hands-free voice/video calling, photo-taking, and speech-to-text functions. The POC, simulated at ST Engineering and later in ward environments, prioritizes operational readiness and user experience. Through trials involving three device models, the most suitable option will advance to subsequent phases. POC's utilization of mock scenarios and absence of TTSH system interface, initial security assessments are deemed unnecessary, though ongoing collaboration with ST Engineering on IT security persists. 20 staff members participated in the POC, the trial was conducted with voice/video call content unrecorded to safeguard privacy. The inclusion of photo-taking and speech-to-text documentation, securely stored within the software application, underscores meticulous attention to functionality, security, and healthcare compatibility, setting the stage for future implementation.

Results

Separate Proof of Concepts (POCs) were conducted with two collaborators, ST Engineering and Moon Technologies, to validate the feasibility of hands-free communication devices in an inpatient ward setting. These tests aimed to improve staff communications at TTSH Ward 5C, designated as TTSH’s Smart Ward. The POCs confirmed the technical functionality and operational readiness of both devices for staff communications in an inpatient ward. User feedback was collected to determine which solution was best suited for the use cases. Twenty participants trialled the devices and provided feedback.

Conclusion

The Proof of Concept (POC) project with ST Engineering successfully demonstrated the operational viability and core functionalities of their voice-activated communication device in an inpatient ward setting. Despite not being selected to proceed to the next phase, ST Engineering's participation provided valuable insights and highlighted key areas for improvement. The project confirmed the device's potential to enhance seamless care delivery, improve staff communication, and support informed decision-making, aligning with WoW’s principles and strategic thrusts. The feedback from the twenty participants offered crucial data for refining the device, while the comparison with Moon Technologies provided a benchmark for performance and cost-effectiveness. The POC also underscored challenges related to scalability and third-party integration, guiding ST Engineering’s future development strategies to create more modular and independent solutions. Additionally, the experience emphasized the importance of user-centric design, proactive project management, and effective stakeholder engagement. Overall, the POC project with ST Engineering contributed significantly to SIP’s goals by advancing smart technology and fostering a collaborative ecosystem for continuous improvement. These contributions enhance the potential for successful integration and adoption of advanced healthcare technologies, ultimately aiming to improve patient outcomes and operational efficiencies in healthcare settings.

Lessons Learnt

During the POC evaluation, several challenges were encountered, highlighting areas for improvement in the device's functionality. Firstly, it was noted that the device exhibited intermittent sensitivity to voice commands, leading to inconsistency in its responsiveness. Additionally, the process of searching for multiple users using the keypad was found to be time-consuming, suggesting a need for optimization in user interface design. Furthermore, the accuracy of transcribing speech to text was identified as a significant issue, with a majority of the transcribed scripts being inaccurate. The recognition accuracy rate for speech to text was observed to be less than 50%, indicating a substantial gap in performance expectations. Moreover, the device struggled to accurately pick up certain names and medical terms, posing challenges in effective communication within healthcare settings. Addressing these challenges will be crucial in enhancing the overall usability and effectiveness of the device. Improvements in voice command sensitivity, search functionalities, and speech to text accuracy are essential to ensure seamless communication and documentation processes for healthcare professionals. Additionally, refining the device's ability to recognize specialized terminology will contribute to its utility in clinical contexts, ultimately advancing the project's objectives of improving communication and patient care outcomes.

Additional Information

Moon Technologies' device outperformed ST Engineering's in terms of technical capabilities, offering better accuracy and stability, along with a well-received combination of gaze and voice commands. Moreover, Moon Technologies exhibited greater flexibility and responsiveness to change requests during the POCs, thanks to its modular design and independence from third-party licenses. Considering these factors, the project team recommends Moon Technologies as the preferred collaborator to proceed with the Proof of Value (POV) phase, highlighting its superior performance and adaptability for further development and implementation.

Keywords

Communication, Voice Activation, Healthcare, Technology

Innovators' Details

Connect with this contributor!

Lim Mei Ling - Mei_ling_lim@ttsh.com.sg

Project Attachment