Development and Psychometric Validation of a Usability Instrument Based on ISO 25010 for Electronic Health Record Systems in Peruvian Health Care Settings: Methodological Study

Background: The usability of electronic health records influences patient safety, clinical efficiency, and the sustainable digital transformation of health care. While tools such as the System Usability Scale exist, few are based on structured software quality models or align with local regulatory f...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: David Mamani-Pari, Alex Froilan Peñaloza-Hualpa, Milton Edward Humpiri Flores, Eder Gutierrez-Quispe, Jorge Eddy Otazu Luque
Formato: Artículo
Lenguaje:inglés
Publicado: 2026
Materias:
Acceso en línea:Enlace permanente (DOI o Handle)
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1881700502299738112
author David Mamani-Pari
Alex Froilan Peñaloza-Hualpa
Milton Edward Humpiri Flores
Eder Gutierrez-Quispe
Jorge Eddy Otazu Luque
author_browse Alex Froilan Peñaloza-Hualpa
David Mamani-Pari
Eder Gutierrez-Quispe
Jorge Eddy Otazu Luque
Milton Edward Humpiri Flores
author_facet David Mamani-Pari
Alex Froilan Peñaloza-Hualpa
Milton Edward Humpiri Flores
Eder Gutierrez-Quispe
Jorge Eddy Otazu Luque
author_sort David Mamani-Pari
collection Producción científica
description Background: The usability of electronic health records influences patient safety, clinical efficiency, and the sustainable digital transformation of health care. While tools such as the System Usability Scale exist, few are based on structured software quality models or align with local regulatory frameworks, particularly in low- and middle-income countries. Objective: This study aims to develop and psychometrically validate an instrument to assess electronic health record usability, based on the ISO 25010 (International Organization for Standardization) quality model, and in accordance with the Peruvian Technical Health Standard (Norma Técnica de Salud [NTS]). Methods: A 3-stage methodological study was conducted following COSMIN (Consensus-based Standards for the Selection of Health Measurement Instruments) guidelines. First, a 23-item instrument was developed, grouped into 7 usability dimensions based on ISO 25010. Second, content validity was assessed using a modified Delphi method with 10 experts, using Aiken's V coefficient. Third, structural validity and reliability were evaluated in 115 participants (physicians, nurses, and administrative staff) using confirmatory factor analysis and Cronbach α. Additionally, the module's functional compliance with the NTS was verified. Results: The instrument demonstrated excellent psychometric properties among 115 participants (53 physicians, 48 nurses, and 14 administrative staff); high content validity (Aiken's V=0.95; 95% CI 0.84-0.98), excellent internal consistency (α=.968), and optimal factor fit (Comparative Fit Index=1.000; Tucker-Lewis Index=1.001). Overall usability was perceived as very high by 94 of 115 users (81.7%), and high by 21 of 115 users (18.3%), with no perceptions at lower levels. The module met 28 of 35 requirements (80%) of the Peruvian Technical Health Standard. Administrative staff reported higher satisfaction (13/14, 93% rated it as very high) compared with clinical professionals (81/101, 80% rated it as very high), particularly in the dimensions of error protection and operability. Conclusions: This study provides the first fully psychometrically validated instrument in Spanish based on ISO 25010, System Usability Scale, and other theoretical foundations for evaluating the usability of information systems. The results highlight the importance of considering both international standards and local regulatory requirements (NTS) in the design of digital health systems. The instrument is applicable in Spanish-speaking contexts and can serve as a reference for future usability evaluations in the region as well as in low- and middle-income countries.
format Article
id openalex:W7153994523
institution UPeU
language English
publishDate 2026
publishDateRange 2026
publishDateSort 2026
record_format dspace
spelling openalex:W7153994523Development and Psychometric Validation of a Usability Instrument Based on ISO 25010 for Electronic Health Record Systems in Peruvian Health Care Settings: Methodological StudyDavid Mamani-PariAlex Froilan Peñaloza-HualpaMilton Edward Humpiri FloresEder Gutierrez-QuispeJorge Eddy Otazu Luqueelectronic health recordsusability evaluationISO/IEC 25010psychometric validationhealth information systemslow- and middle-income countriesSystem Usability ScaleCOSMINcontent validitystructural validityreliability statisticsprovider satisfactionerror protectionoperabilityPeruSpanish-language instrumentregulatory complianceElectronic Health Records SystemsUsability and User Interface DesignHealth Education and ValidationBackground: The usability of electronic health records influences patient safety, clinical efficiency, and the sustainable digital transformation of health care. While tools such as the System Usability Scale exist, few are based on structured software quality models or align with local regulatory frameworks, particularly in low- and middle-income countries. Objective: This study aims to develop and psychometrically validate an instrument to assess electronic health record usability, based on the ISO 25010 (International Organization for Standardization) quality model, and in accordance with the Peruvian Technical Health Standard (Norma Técnica de Salud [NTS]). Methods: A 3-stage methodological study was conducted following COSMIN (Consensus-based Standards for the Selection of Health Measurement Instruments) guidelines. First, a 23-item instrument was developed, grouped into 7 usability dimensions based on ISO 25010. Second, content validity was assessed using a modified Delphi method with 10 experts, using Aiken's V coefficient. Third, structural validity and reliability were evaluated in 115 participants (physicians, nurses, and administrative staff) using confirmatory factor analysis and Cronbach α. Additionally, the module's functional compliance with the NTS was verified. Results: The instrument demonstrated excellent psychometric properties among 115 participants (53 physicians, 48 nurses, and 14 administrative staff); high content validity (Aiken's V=0.95; 95% CI 0.84-0.98), excellent internal consistency (α=.968), and optimal factor fit (Comparative Fit Index=1.000; Tucker-Lewis Index=1.001). Overall usability was perceived as very high by 94 of 115 users (81.7%), and high by 21 of 115 users (18.3%), with no perceptions at lower levels. The module met 28 of 35 requirements (80%) of the Peruvian Technical Health Standard. Administrative staff reported higher satisfaction (13/14, 93% rated it as very high) compared with clinical professionals (81/101, 80% rated it as very high), particularly in the dimensions of error protection and operability. Conclusions: This study provides the first fully psychometrically validated instrument in Spanish based on ISO 25010, System Usability Scale, and other theoretical foundations for evaluating the usability of information systems. The results highlight the importance of considering both international standards and local regulatory requirements (NTS) in the design of digital health systems. The instrument is applicable in Spanish-speaking contexts and can serve as a reference for future usability evaluations in the region as well as in low- and middle-income countries.Articlehttps://doi.org/10.2196/81377W7153994523enJMIR Human Factors2292-94952026-04-13
spellingShingle electronic health records
usability evaluation
ISO/IEC 25010
psychometric validation
health information systems
low- and middle-income countries
System Usability Scale
COSMIN
content validity
structural validity
reliability statistics
provider satisfaction
error protection
operability
Peru
Spanish-language instrument
regulatory compliance
Electronic Health Records Systems
Usability and User Interface Design
Health Education and Validation
David Mamani-Pari
Alex Froilan Peñaloza-Hualpa
Milton Edward Humpiri Flores
Eder Gutierrez-Quispe
Jorge Eddy Otazu Luque
Development and Psychometric Validation of a Usability Instrument Based on ISO 25010 for Electronic Health Record Systems in Peruvian Health Care Settings: Methodological Study
title Development and Psychometric Validation of a Usability Instrument Based on ISO 25010 for Electronic Health Record Systems in Peruvian Health Care Settings: Methodological Study
title_full Development and Psychometric Validation of a Usability Instrument Based on ISO 25010 for Electronic Health Record Systems in Peruvian Health Care Settings: Methodological Study
title_fullStr Development and Psychometric Validation of a Usability Instrument Based on ISO 25010 for Electronic Health Record Systems in Peruvian Health Care Settings: Methodological Study
title_full_unstemmed Development and Psychometric Validation of a Usability Instrument Based on ISO 25010 for Electronic Health Record Systems in Peruvian Health Care Settings: Methodological Study
title_short Development and Psychometric Validation of a Usability Instrument Based on ISO 25010 for Electronic Health Record Systems in Peruvian Health Care Settings: Methodological Study
title_sort development and psychometric validation of a usability instrument based on iso 25010 for electronic health record systems in peruvian health care settings methodological study
topic electronic health records
usability evaluation
ISO/IEC 25010
psychometric validation
health information systems
low- and middle-income countries
System Usability Scale
COSMIN
content validity
structural validity
reliability statistics
provider satisfaction
error protection
operability
Peru
Spanish-language instrument
regulatory compliance
Electronic Health Records Systems
Usability and User Interface Design
Health Education and Validation
topic_facet electronic health records
usability evaluation
ISO/IEC 25010
psychometric validation
health information systems
low- and middle-income countries
System Usability Scale
COSMIN
content validity
structural validity
reliability statistics
provider satisfaction
error protection
operability
Peru
Spanish-language instrument
regulatory compliance
Electronic Health Records Systems
Usability and User Interface Design
Health Education and Validation
url https://doi.org/10.2196/81377
work_keys_str_mv AT davidmamanipari developmentandpsychometricvalidationofausabilityinstrumentbasedoniso25010forelectronichealthrecordsystemsinperuvianhealthcaresettingsmethodologicalstudy
AT alexfroilanpenalozahualpa developmentandpsychometricvalidationofausabilityinstrumentbasedoniso25010forelectronichealthrecordsystemsinperuvianhealthcaresettingsmethodologicalstudy
AT miltonedwardhumpiriflores developmentandpsychometricvalidationofausabilityinstrumentbasedoniso25010forelectronichealthrecordsystemsinperuvianhealthcaresettingsmethodologicalstudy
AT edergutierrezquispe developmentandpsychometricvalidationofausabilityinstrumentbasedoniso25010forelectronichealthrecordsystemsinperuvianhealthcaresettingsmethodologicalstudy
AT jorgeeddyotazuluque developmentandpsychometricvalidationofausabilityinstrumentbasedoniso25010forelectronichealthrecordsystemsinperuvianhealthcaresettingsmethodologicalstudy