This study examines expert perspectives on the validity of task alignment in higher education assessment within the University of Cambridge’s Faculty of Education. It is motivated by concerns arising from Terence Crooks et al.’s framework on threats to validity, including unclear task design, misalignment with Intended Learning Outcomes (ILOs), vague marking criteria, and limited use of rubrics. Using qualitative interviews with academics across different levels of seniority, the study explores how constructive alignment is understood and implemented in practice, and what factors influence assessment validity. A thematic analysis approach is employed to identify patterns in expert perspectives. Findings are interpreted in relation to existing scholarship and Crooks et al.’s framework, leading to the development of an alignment-enhancement model to support more coherent and valid assessment design. The study addresses key research questions concerning challenges and strategies for improving task alignment in higher education.
References
[1]
American Educational Research Association, American Psychological Association, & National Council for Measurement in Education (AERA, APA, & NCME) (1999). Standards for Educational and Psychological Testing. AERA.
[2]
Ananda, S. (2003). Achieving Alignment. Leadership, 33, 18-21, 37.
[3]
Anderson, L. W. (2002). Curricular Alignment: A Re-Examination. TheoryIntoPractice,41, 255-260. https://doi.org/10.1207/s15430421tip4104_9
[4]
Bhola, D. S., Impara, J. C., & Buckendahl, C. W. (2003). Aligning Tests with States’ Content Standards: Methods and Issues. EducationalMeasurement:IssuesandPractice,22, 21-29. https://doi.org/10.1111/j.1745-3992.2003.tb00134.x
[5]
Biggs, J. (2003). Aligning Teaching for Constructing Learning. Higher Education Academy.
[6]
Boyatzis, R. E. (1998). Transforming Qualitative Information: Thematic Analysis and Code Development. Sage.
[7]
Braun, V. (2005). In Search of (Better) Sexual Pleasure: Female Genital “Cosmetic” Surgery. Sexualities,8, 407-424. https://doi.org/10.1177/1363460705056625
[8]
Braun, V., & Clarke, V. (2006). Using Thematic Analysis in Psychology. QualitativeResearchinPsychology,3, 77-101. https://doi.org/10.1191/1478088706qp063oa
[9]
Braun, V., & Clarke, V. (2013). Successful Qualitative Research: A Practical Guide for Beginners. Sage.
[10]
Brink, H. (1996). Fundamentals of Research Methodology for Health Care Professionals. Juta.
[11]
Chang, C. H., & Seow, T. (2018). Geographical Education That Matters—A Critical Discussion of Consequential Validity in Assessment of School Geography. Geographical Education (Online), 31, 31-40.
[12]
Crooks, T. J., Kane, M. T., & Cohen, A. S. (1996). Threats to the Valid Use of Assessments. AssessmentinEducation:Principles,Policy&Practice,3, 265-286. https://doi.org/10.1080/0969594960030302
[13]
Denzin, N. K., & Lincoln, Y. S. (1998). Strategies of Qualitative Inquiry. Sage Publications.
[14]
Downing, S. M. (2003). Validity: On the Meaningful Interpretation of Assessment Data. MedicalEducation,37, 830-837. https://doi.org/10.1046/j.1365-2923.2003.01594.x
[15]
Easterby-Smith, M., Thorpe, R., & Lowe, A. (1991). Management Research. Sage.
[16]
Farenga, S. J., Joyce, B. A., & Ness, D. (2002). Reaching the Zone of Optimal Learning: The Alignment of Curriculum, Instruction, and Assessment, In R. W. Bybees (Ed.), Learning Science and the Science of Learning (pp. 51-62). NSTA Press.
[17]
Fuhrman, S. H. (2001). From the Capitol to the Classroom: Standards Based Reform in the States. Yearbook of the National Society for the Study of Education. Part II. The University of Chicago Press.
[18]
Gearhart, M., Herman, J. L., Novak, J. R., & Wolf, S. A. (1995). Toward the Instructional Utility of Large-Scale Writing Assessment: Validation of a New Narrative Rubric. AssessingWriting,2, 207-242. https://doi.org/10.1016/1075-2935(95)90013-6
[19]
Guba, E., & Lincoln, Y. (1985). Effective Evaluation: Improving the Usefulness of Evaluation Results through Responses and Naturalist Approaches. Jossey-Bass.
[20]
Hussey, J., & Hussey, R. (1997). Business Research. Macmillan Press Ltd.
[21]
Kandlbinder, P., & Peseta, T. (2009). Key Concepts in Postgraduate Certificates in Higher Education Teaching and Learning in Australasia and the United Kingdom. InternationalJournalforAcademicDevelopment,14, 19-31. https://doi.org/10.1080/13601440802659247
[22]
Kane, M. T. (2001). Current Concerns in Validity Theory. JournalofEducationalMeasurement,38, 319-342. https://doi.org/10.1111/j.1745-3984.2001.tb01130.x
[23]
Koretz, D. M., & Hamilton, L. S. (2006). Testing for Accountability in K-12. In R. L. Brennan (Ed.), Educational Measurement (pp. 531-578). American Council on Education & Praeger Publishers.
[24]
La Marca, P. M. (2001). Alignment of Standards and Assessments as an Accountability Criterion. Practical Assessment, Research & Evaluation, 7, 21.
[25]
La Marca, P. M., Redfield, D., Winter, P. C., Bailey, A., & Hansche, D. (2000). State Standards and State Assessment Systems: A Guide to Alignment. Council of Chief State School Officers.
[26]
Mansell, W., James, M., & The Assessment Reform Group (2009). Assessment in Schools, Fit for Purpose? A Commentary by the Teaching and Learning Research Program. ESRC, TLRP.
[27]
Mcnamara, J. F. (1994). Surveys and Experiments in Education Research. Technomic Publishing Company Inc.
[28]
Messick, S. (1989). Meaning and Values in Test Validation: The Science and Ethics of Assessment. EducationalResearcher,18, 5-11. https://doi.org/10.3102/0013189x018002005
[29]
Moss, P. A. (1995). Themes and Variations in Validity Theory. EducationalMeasurement:IssuesandPractice,14, 5-13. https://doi.org/10.1111/j.1745-3992.1995.tb00854.x
[30]
Munhall, P. L., & Boyd, C. O. (1993). Nursing Research: A Qualitative Perspective (2nd ed.). National League for Nursing Press.
[31]
Myers, M. D. (1997). Critical Ethnography in Information Systems. In A. S. Lee et al. (Eds.), InformationSystemsandQualitativeResearch (pp. 276-300). Springer US. https://doi.org/10.1007/978-0-387-35309-8_15
[32]
Neuman, W. L. (2003). Social Research Methods: Qualitative and Quantitative Approaches. Alyn and Bacon.
[33]
Newby, L., & Cornelissen, L. (2025). A Neutral Toolkit? For a Fundamental Critique of Constructive Alignment. TeachinginHigherEducation,30, 1687-1702. https://doi.org/10.1080/13562517.2025.2465987
[34]
Newton, P. E. (2010). The Multiple Purposes of Assessment. In E. Baker, B. McGaw, & P. Peterson (Eds.), InternationalEncyclopediaofEducation (pp. 392-396). Elsevier. https://doi.org/10.1016/b978-0-08-044894-7.00355-9
[35]
Olds, B. M., Moskal, B. M., & Miller, R. L. (2005). Assessment in Engineering Education: Evolution, Approaches and Future Collaborations. JournalofEngineeringEducation,94, 13-25. https://doi.org/10.1002/j.2168-9830.2005.tb00826.x
[36]
Oxford English Dictionary (2008). Oxford English Dictionary. Oxford University Press.
[37]
Patton, M. Q. (1990). Qualitative Evaluation and Research Methods (2nd ed.). Sage Publications, Inc.
[38]
Price, M., Rust, C., O’donovan, B., Handley, K., & Bryant, R. (2012). Assessment Literacy: The Foundation for Improving Student Learning. ASKe, Oxford Centre for Staff and Learning Development.
[39]
Resnick, L. B., Rothman, R., Slattery, J. B., & Vranek, J. L. (2004). Benchmarking and Alignment of Standards and Testing. EducationalAssessment,9, 1-27. https://doi.org/10.1080/10627197.2004.9652957
[40]
Rothman, R. (2003). Imperfect Matches: The Alignment of Standards and Tests. Paper Commissioned by the Committee on Test Design for K-12 Science Achievement, March 2003.
[41]
Ryan, G. W., & Bernard, H. R. (2000). Data Management and Analysis Methods. In N. K. Denzin, & Y. S. Lincoln (Eds.), Handbook of Qualitative Research (2nd ed., pp. 769-802). Sage.
[42]
Shepard, L. A. (1993). Chapter 9: Evaluating Test Validity. ReviewofResearchinEducation,19, 405-450. https://doi.org/10.3102/0091732x019001405
[43]
Silverman, D. (2014). Interpreting Qualitative Data (5th ed.). Sage Publications, Inc.
[44]
Sireci, S. G. (2009). Packing and Unpacking Sources of Validity Evidence: History Repeats Itself Again. In R. W. Lissitz (Ed.), TheConceptofValidity: Revisions,NewDirections,andApplications (pp. 19-37). Emerald Publishing Limited. https://doi.org/10.1108/978-1-61735-269-020251004
[45]
Smith, C. D., Worsfold, K., Davies, L., Fisher, R., & McPhail, R. (2013). Assessment Literacy and Student Learning: The Case for Explicitly Developing Students “Assessment Literacy”. Assessment&EvaluationinHigherEducation,38, 44-60. https://doi.org/10.1080/02602938.2011.598636
[46]
Smith, M. S., & O’Day, J. (1990). Systematic School Reform. In S. H. Furhman, & B. Malen (Eds.), The Politics of Curriculum and Testing (pp. 233-267). The 1990 Yearbook of the Politics of Education Association, The Falmer Press.
[47]
Voltz, D., Sims, M., & Nelson, B. (2010). Connecting Teachers, Students and Standards: Strategies for Success in Diverse and Inclusive Classrooms. Association for Supervision and Curriculum Development.
[48]
Webb, N. L. (1997). Criteria for Alignment of Expectations and Assessments in Mathematics and Science Education (Research Monograph, No. 6). National Institute for Science Education.
[49]
Wiliam, D. (2008). Chapter 8. Quality in Assessment. In S. Swaffield (Ed.), Unlocking Assessment (pp. 123-137). Routledge.
