Improving Methodological Coherence in Thesis Proposal Design: Development and Preliminary Validation of Research Coherence Alignment Framework
Keywords:
research design; methodological coherence; thesis writing; research alignment; preliminary validationAbstract
Methodological coherence is a central requirement in thesis proposal design because valid inquiry depends on the logical alignment of the research questions, constructs, evidence sources, instruments, and analytical procedures. Although the research methodology literature consistently emphasizes alignment, student researchers often lack the operational tools for translating research questions into coherent empirical structures. This study developed and preliminarily validated the Research Coherence Alignment Framework (RCAF), a methodological support system designed to guide, evaluate, and diagnose coherence in thesis proposal design. The framework consists of four integrated components: the SOP–Instrument Alignment Matrix, the Methodological Coherence Evaluation Rubric, the Taxonomy of Research Alignment Errors, and the Methodological Coherence Index. A DBR-informed developmental design was employed, involving expert validation and classroom-based implementation with 60 thesis-writing students assigned to control and experimental intact groups. Expert evaluation yielded a Content Validity Index of .90, indicating strong agreement for the framework’s clarity, relevance, and usefulness. The results also show that students who used the RCAF obtained significantly higher methodological coherence scores than those who followed the usual thesis-writing condition, t (58) = 10.31, p < .001, Cohen’s d = 2.65. Given the quasi-experimental design, the findings should be interpreted as preliminary evidence of the framework’s pedagogical usefulness rather than definitive proof of causal effectiveness. Overall, the study suggests that RCAF can support thesis instruction, proposal evaluation, and research supervision by making methodological alignment more explicit, teachable, and assessable.
https://doi.org/10.26803/ijlter.25.6.25
References
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. American Educational Research Association.
Bakhou, B., & Bouhania, B. (2020). A qualitative inquiry into the difficulties experienced by Algerian EFL master students in thesis writing: “Language is not the only problem.” Arab World English Journal, 11(2), 243–257. https://doi.org/10.24093/awej/vol11no2.17
Biggs, J. (1996). Enhancing teaching through constructive alignment. Higher Education, 32, 347–364. https://doi.org/10.1007/BF00138871
Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018). Best practices for developing and validating scales for health, social, and behavioral research: A primer. Frontiers in Public Health, 6, Article 149. https://doi.org/10.3389/fpubh.2018.00149
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Routledge.
Creswell, J. W., & Creswell, J. D. (2018). Research design: Qualitative, quantitative, and mixed methods approaches (5th ed.). SAGE Publications.
DeVellis, R. F., & Thorpe, C. T. (2021). Scale development: Theory and applications (5th ed.). SAGE Publications.
Grohnert, T., Gromotka, L., Gast, I., Delnoij, L., & Beausaert, S. (2024). Effective master’s thesis supervision: A summative framework for research and practice. Educational Research Review, 42, Article 100589. https://doi.org/10.1016/j.edurev.2023.100589
Ipanaqué-Zapata, M., Figueroa-Quiñones, J., Bazalar-Palacios, J., Arhuis-Inca, W., Quiñones-Negrete, M., & Villarreal-Zegarra, D. (2023). Research skills for university students’ thesis in e-learning: Scale development and validation in Peru. Heliyon, 9(3), Article e13770. https://doi.org/10.1016/j.heliyon.2023.e13770
Jordal, M., Eriksson, H., Salzmann-Erikson, M., & Mazaheri, M. (2021). Escorting students into responsibility and autonomy: A model for supervising degree projects. Advances in Medical Education and Practice, 12, 1165–1173. https://doi.org/10.2147/AMEP.S307169
Jusslin, S., & Hilli, C. (2024). Supporting bachelor’s and master’s students’ thesis writing: A rhizoanalysis of academic writing workshops in hybrid learning spaces. Studies in Higher Education, 49(4), 712–729. https://doi.org/10.1080/03075079.2023.2250809
Kickert, R., Meeuwisse, M., Stegers-Jager, K. M., Prinzie, P., & Arends, L. R. (2022). Curricular fit perspective on motivation in higher education. Higher Education, 83(4), 729–745. https://doi.org/10.1007/s10734-021-00699-3
Koo, T. K., & Li, M. Y. (2016). A guideline for selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012
Maxwell, J. A. (2013). Qualitative research design: An interactive approach (3rd ed.). SAGE Publications.
Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50(9), 741–749. https://doi.org/10.1037/0003-066X.50.9.741
Polit, D. F., & Beck, C. T. (2006). The content validity index: Are you sure you know what is being reported? Critique and recommendations. Research in Nursing & Health, 29(5), 489–497. https://doi.org/10.1002/nur.20147
Polit, D. F., Beck, C. T., & Owen, S. V. (2007). Is the content validity index an acceptable indicator of content validity? Appraisal and recommendations. Research in Nursing & Health, 30(4), 459–467. https://doi.org/10.1002/nur.20199
Praestegaard Larsen, B. (2025). Research process model for bachelor’s thesis. Journal of Learning Development in Higher Education, (34). https://doi.org/10.47408/jldhe.vi34.1379
Quinto, J. B. (2022). Seize the day or seize theses? The challenges in undergraduate thesis writing. Issues in Educational Research, 32(4), 1567–1583. https://www.iier.org.au/iier32/quinto.pdf
Reeves, T. C. (2006). Design research from a technology perspective. In J. van den Akker, K. Gravemeijer, S. McKenney, & N. Nieveen (Eds.), Educational design research (pp. 52–66). Routledge.
Roberts, L. D., & Seaman, K. (2018). Good undergraduate dissertation supervision: Perspectives of supervisors and dissertation coordinators. International Journal for Academic Development, 23(1), 28–40. https://doi.org/10.1080/1360144X.2017.1412971
Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Houghton Mifflin.
Sireci, S. G., & Faulkner-Bond, M. (2014). Validity evidence based on test content. Psicothema, 26(1), 100–107. https://doi.org/10.7334/psicothema2013.256
Strebel, F., Gürtler, S., Hulliger, B., & Lindeque, J. (2021). Laissez-faire or guidance? Effective supervision of bachelor theses. Studies in Higher Education, 46(4), 866–884. https://doi.org/10.1080/03075079.2019.1659762
Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach’s alpha. International Journal of Medical Education, 2, 53–55. https://doi.org/10.5116/ijme.4dfb.8dfd
The Design-Based Research Collective. (2003). Design-based research: An emerging paradigm for educational inquiry. Educational Researcher, 32(1), 5–8. https://doi.org/10.3102/0013189X032001005
Vígh, T. (2024). Development of research skills through research-focused microteaching lesson study in preservice teacher education. Teaching and Teacher Education, 145, Article 104618. https://doi.org/10.1016/j.tate.2024.104618
Wang, F., & Hannafin, M. J. (2005). Design-based research and technology-enhanced learning environments. Educational Technology Research and Development, 53(4), 5–23. https://doi.org/10.1007/BF02504682
Wisker, G. (2018). Frameworks and freedoms: Supervising research learning and the undergraduate dissertation. Journal of University Teaching and Learning Practice, 15(4), Article 2. https://doi.org/10.53761/1.15.4.2
Zhao, L., Zhao, B., & Li, C. (2023). Alignment analysis of teaching–learning-assessment within the classroom: How teachers implement project-based learning under the curriculum standards. Disciplinary and Interdisciplinary Science Education Research, 5, Article 13. https://doi.org/10.1186/s43031-023-00078-1
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Luijim Santos Jose

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
All articles published by IJLTER are licensed under a Creative Commons Attribution Non-Commercial No-Derivatives 4.0 International License (CCBY-NC-ND4.0).