The omission of critical checks by nurses contributes a certain proportion of medical errors, necessitating the implementation of effective countermeasures. One proposed solution is integrating the "finger pointing and calling" method, widely used in Japanese industrial environment, into workflows of nurses. This method involves visually confirming a target, verbally stating its name or condition, and physically pointing to it, thereby enhancing attentional control and preventing oversights through the combination of verbal and physical actions. Integrating the finger pointing and calling method into workflows of nurses requires appropriate training. Moreover, providing feedback on its execution is essential for effective training.

We developed a system to detect, evaluate, and provide feedback on the execution of finger pointing and calling in workflows of nurses. The system utilizes acceleration and gyroscope sensors on the upper arm for motion recognition, and a microphone for speech recognition. The system provides three levels of evaluation results as immediate feedback, using verbal audio output. We conducted an experiment in a hospital ward to evaluate the system, where nurses voluntarily used the system over a designated period, followed by a post-experiment questionnaire. The experimental results suggest that the system serves as an effective tool for training nurses in finger pointing and calling. Additionally, they indicate the importance of users being mindful of the system during use and incorporating guidance from others.
However, the effect of the system’s feedback on user behavior and perception of the system remains unclear.

Therefore, we conducted an experiment where small groups of participants, who were allowed to freely converse during the sessions, trained finger pointing and calling using the system with variations in the feedback content provided. Through the analysis of video recordings taken during the sessions and questionnaire responses collected afterward, we examined how the system’s feedback and its content influenced user perception and behavior, and interaction.

Keywords: Training system, finger pointing and calling, nurses, feedback.