In this research, we detail the development of a novel, easy-to-use system to facilitate electronic patient falls reporting within a long-term residential care facility (LTRCF) using off-the-shelf technology that can be inexpensively implemented in a wide variety of settings. We report the results of four complimentary system evaluation measures that take into consideration varied organizational stakeholders’ perspectives: 1) System-level benefits and costs, 2) System usability, via scenario-based use cases, 3) A holistic assessment of users’ physical, cognitive, and marcoergonomic (work system) challenges in using the system, and 4) User technology acceptance. We report the viability of collecting and analyzing data specific to each evaluation measure and detail the relative merits of each measure in judging whether the system is acceptable to each stakeholder.
The electronic falls reporting system was successfully implemented, with 100% electronic submission rate at 3-months post-implementation period. The system-level benefits and costs approach showed that the electronic system required no initial investment costs aside from personnel costs and significant benefits accrued from user time savings. The usability analysis revealed several fixable design flaws and demonstrated the importance of scenario-based user training. The technology acceptance model showed that users perceived the reporting system to be useful and easy to use, even more so after implementation. Finally, the holistic human factors evaluation identified challenges encountered when nurses used the system as a part of their daily work, guiding further system redesign. The four-pronged evaluation framework accounted for varied stakeholder perspectives and goals and is a highly scalable framework that can be easily applied to Health IT (Information Technology) implementations in other LTRCFs