Proposal of a rubric to evaluate the quality of doctoral theses: A formative evaluation approach
The objective of this research was to determine the psychometric properties of a rubric designed, with formatives purposes, to evaluate the quality of doctoral theses in PhD programs in Education. The rubric is made up of six dimensions, and its scores range is from 1 to 4. To determine its degree o...
Guardado en:
| Publicado en: | Revista Muro de la Investigación |
|---|---|
| Autor principal: | |
| Formato: | Artículo de revista |
| Lenguaje: | español |
| Publicado: |
Universidad Peruana Unión
2022
|
| Materias: | |
| Acceso en línea: | Ver en el sistema de origen |
| Etiquetas: |
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1881503222466609152 |
|---|---|
| author | Gonzales Lopez, Jaime Natanael |
| author_browse | Gonzales Lopez, Jaime Natanael |
| author_facet | Gonzales Lopez, Jaime Natanael |
| author_sort | Gonzales Lopez, Jaime Natanael |
| collection | Revistas |
| container_title | Revista Muro de la Investigación |
| description | The objective of this research was to determine the psychometric properties of a rubric designed, with formatives purposes, to evaluate the quality of doctoral theses in PhD programs in Education. The rubric is made up of six dimensions, and its scores range is from 1 to 4. To determine its degree of validity, the Aiken V coefficient was used, and to determine its level of reliability, Cohen's Kappa concordance coefficient and the coefficient of Kappa de Fleiss were used. In both procedures, 6 researchers with a PhD in Education participated as judges and evaluators. In addition, a thesis was selected from each of the 31 best universities in the world in the area of education to perform inter-observer reliability analysis. After of the respective analyzes, it was concluded that each dimension of the rubric has a high level of validity when obtaining scores higher than 0.83; and that the rubric is highly reliable since the strength of agreement between one and another observer, as well as a whole, turned out to be considerable or almost perfect. |
| format | Online |
| id | oai:ojs.pkp.sfu.ca:article/1760 |
| institution | UPeU |
| issn | 2523-2886 2521-2079 |
| language | Spanish |
| publishDate | 2022 |
| publishDateRange | 2022 |
| publishDateSort | 2022 |
| publisher | Universidad Peruana Unión |
| publisherStr | Universidad Peruana Unión |
| record_format | ojs |
| revista_str_mv | Revista Muro de la Investigación |
| spelling | oai:ojs.pkp.sfu.ca:article/17602022-08-14T15:53:15Z Proposal of a rubric to evaluate the quality of doctoral theses: A formative evaluation approach Propuesta de una rúbrica para evaluar la calidad de las tesis doctorales: Un enfoque de evaluación formativa Gonzales Lopez, Jaime Natanael Investigación, tesis doctorales, rigurosidad científica, calidad, rubrica, educación Research, doctoral theses, scientific rigour, quality, rubric, education The objective of this research was to determine the psychometric properties of a rubric designed, with formatives purposes, to evaluate the quality of doctoral theses in PhD programs in Education. The rubric is made up of six dimensions, and its scores range is from 1 to 4. To determine its degree of validity, the Aiken V coefficient was used, and to determine its level of reliability, Cohen's Kappa concordance coefficient and the coefficient of Kappa de Fleiss were used. In both procedures, 6 researchers with a PhD in Education participated as judges and evaluators. In addition, a thesis was selected from each of the 31 best universities in the world in the area of education to perform inter-observer reliability analysis. After of the respective analyzes, it was concluded that each dimension of the rubric has a high level of validity when obtaining scores higher than 0.83; and that the rubric is highly reliable since the strength of agreement between one and another observer, as well as a whole, turned out to be considerable or almost perfect. La presente investigación tuvo como objetivo determinar las propiedades psicométricas de una rúbrica diseñada, con fines formativos, para evaluar la calidad de las tesis doctorales en programas de PhD en Educación. La rúbrica está constituida por seis dimensiones, y sus puntuaciones van de 1 a 4. Para determinar su grado de validez se usó el coeficiente V de Aiken, y para determinar su nivel de fiabilidad se usaron el coeficiente de concordancia Kappa de Cohen y el coeficiente de concordancia Kappa de Fleiss. En ambos procedimientos participaron 6 investigadores con grado de PhD en Educación como jueces y evaluadores. Además, se seleccionó una tesis de cada una de las 31 mejores universidades de mundo en el área de educación para realizar el análisis de fiabilidad inter-observador. Luego de realizar los análisis respectivos, se concluyó que cada dimensión de la rúbrica tiene un alto nivel de validez al obtener puntuaciones superiores a 0.83; y que la rúbrica es altamente fiable puesto que la fuerza de concordancia entre uno y otro observador, así como en su conjunto, resultaron ser considerables o casi perfectas. Universidad Peruana Unión 2022-08-14 info:eu-repo/semantics/article info:eu-repo/semantics/publishedVersion Artículo revisado por pares application/pdf https://revistas.upeu.edu.pe/r-Muro-investigaion/article/view/1760 10.17162/rmi.v8i2.1760 Revista Muro de la Investigación; Vol. 8 Núm. 2 (2022): Revista Muro de la Investigación 2523-2886 2521-2079 10.17162/rmi.v8i2 spa https://revistas.upeu.edu.pe/r-Muro-investigaion/article/view/1760/1974 Derechos de autor 2022 Jaime Natanael Gonzales Lopez |
| spellingShingle | Investigación, tesis doctorales, rigurosidad científica, calidad, rubrica, educación Research, doctoral theses, scientific rigour, quality, rubric, education Gonzales Lopez, Jaime Natanael Proposal of a rubric to evaluate the quality of doctoral theses: A formative evaluation approach |
| title | Proposal of a rubric to evaluate the quality of doctoral theses: A formative evaluation approach |
| title_alt | Propuesta de una rúbrica para evaluar la calidad de las tesis doctorales: Un enfoque de evaluación formativa |
| title_full | Proposal of a rubric to evaluate the quality of doctoral theses: A formative evaluation approach |
| title_fullStr | Proposal of a rubric to evaluate the quality of doctoral theses: A formative evaluation approach |
| title_full_unstemmed | Proposal of a rubric to evaluate the quality of doctoral theses: A formative evaluation approach |
| title_short | Proposal of a rubric to evaluate the quality of doctoral theses: A formative evaluation approach |
| title_sort | proposal of a rubric to evaluate the quality of doctoral theses a formative evaluation approach |
| topic | Investigación, tesis doctorales, rigurosidad científica, calidad, rubrica, educación Research, doctoral theses, scientific rigour, quality, rubric, education |
| topic_facet | Investigación, tesis doctorales, rigurosidad científica, calidad, rubrica, educación Research, doctoral theses, scientific rigour, quality, rubric, education |
| url | https://revistas.upeu.edu.pe/r-Muro-investigaion/article/view/1760 |
| work_keys_str_mv | AT gonzaleslopezjaimenatanael proposalofarubrictoevaluatethequalityofdoctoralthesesaformativeevaluationapproach AT gonzaleslopezjaimenatanael propuestadeunarubricaparaevaluarlacalidaddelastesisdoctoralesunenfoquedeevaluacionformativa |