Assessment conceptions of Finnish university hourly paid teachers: the contribution of pedagogical training
DOI:
https://doi.org/10.32674/jrms5h56Keywords:
assessment conceptions, hourly paid teachers, part-time teachers, assessment skills, university teachingAbstract
Universities are increasingly employing part-time teachers who are experts in their field but may lack the pedagogical training crucial for teaching and assessment. Assessment, in turn, is a key factor in promoting students’ learning. Research on part-time university teachers is limited, and the assessment conceptions informing their teaching have received little attention. This study examined hourly paid teachers’ (N = 50) assessment conceptions at an open university in Finland, the relationships between these conceptions, and the differences between them by teachers’ education and teaching experience. Assessment conceptions were categorized into assessment for teaching and learning, assessment of learning, and assessment as harmful. On average, teachers' assessment conceptions were mostly based on assessment for teaching and learning and least based on assessment as harmful. The assessment conceptions of teachers who had completed pedagogical training (60 credits) were based more on assessment for teaching and learning than the conceptions of those who had not completed pedagogical training. These results have value for the development of high-quality and sustainable university education.
References
Brand, T. (2013). Foreword: the lost tribe. In F. Beaton & A. Gilbert, (Eds.), Developing effective part-time teachers in higher education: new approaches to professional development (pp. xv–xviii). Routledge.
Beaton, F., & Gilbert, A. (2012). Developing effective part-time teachers in higher education: New approaches to professional development. Routledge.
Brown, G. T. L. (2004). Teachers’ Conceptions of assessment: Implications for policy and professional development. Assessment in Education 11, 302–318. https://doi.org/10.1080/0969594042000304609
Brown, G. T. L. (2008). Conceptions of Assessment: Understanding What Assessment Means to Teachers and Students. New York.
Brown, G. T. L., Gebril, A. & Michaelides, MP. (2019). Teachers’ conceptions of assessment: A global phenomenon or a global localism. Frontiers in Education 4(16). https://doi.org/10.3389/feduc.2019.00016.
Boud, D. (2000). Sustainable assessment: rethinking assessment for the learning society. Studies in Continuing Education 22(2), 151–167. https://doi.org/10.1080/713695728
Boud, D. (2014). Shifting views of assessment: From secret teachers’ business to sustaining learning. In C. Kreber, N. Anderson, N. Entwistle & J. McArthur, (Eds.), Advances and innovations in university assessment (pp. 13–31). Edinburgh: Edinburgh University Press.
Boud, D. & Soler, R. (2016). Sustainable assessment revisited. Assessment & Evaluation in Higher Education 41(3), 400–413. https://doi.org/10.1080/02602938.2015.1018133
Carless, D & Boud, D. (2018) The development of student feedback literacy: enabling uptake of feedback, Assessment & Evaluation in Higher Education, 43(8), 1315–1325. https://doi.org/10.1080/02602938.2018.1463354
Chen, J., & Lopes, A. (2015). Hourly paid teachers in UK universities: Findings from an exploratory survey. CESR Review. https://eprints.ncl.ac.uk/file_store/production/223438/3919AE4F-394E-40E7-A0B7-85A4225CF5E4.pdf
Crisp, G. T. (2012). Integrative assessment: reframing assessment practice for current and future learning. Assessment and evaluation 37(1), 33–43. https://doi.org/10.1080/02602938.2010.494234
Coughlan, A. (2015). The growth in part-time teaching in higher education: The imperative for research in the Irish context. All Ireland Journal of Higher Education, 7(1), 2201–22027. https://ojs.aishe.org/index.php/aishe-j/article/view/220/304
DeLuca, C & Klinger, D.A. (2010). Assessment literacy development: identifying gaps in teacher candidates’ learning. Assessment in Education: Principles, Policy & Practice 17(4), 419-438. https://doi.org/10.1080/0969594X.2010.516643
Deneen, C. & Boud, D. (2014). Patterns of resistance in managing assessment change. Assessment & Evaluation in Higher Education 39(5), 577–591. https://doi.org/10.1080/02602938.2013.859654
Deneen, D., Brown, G & Parker, D. (2016). The impact of conceptions of assessment-on-assessment literacy in a teacher education program. Cogent Education 3(1). https://doi.org/10.1080/2331186X.2016.1225380
Finnish University Act 2009/558. https://www.finlex.fi/en/laki/kaannokset/2009/en20090558_20160644.pdf
Fuller, M. B. & Skidmore, S. T. (2014). On exploration of factors influencing institutional cultures of assessment. International journal of educational research 65, 9–21. https://doi.org/10.1016/j.ijer.2014.01.001
Gillespie, K.J. & Robertson, D.L. (2010). A guide to faculty development. Jossey-Bass.
Hailikari, T., Postareff, L., Tuononen, T., Räisänen, M. & Lindblom-Ylänne, S. (2014). Students' and Teachers' Perceptions of Fairness in Assessment. In C. Kreber, C. Anderson, J. McArthur & N. Entwistle (eds.), Advances and Innovations in University Assessment and Feedback (pp. 99–113). Edinburgh University Press.
Haltia N., Isopahkala-Bouret U, Jauhiainen A. (2021). The vocational route to higher education in Finland: Students’ backgrounds, choices, and study experiences. European Educational Research Journal. https://doi.org/10.1177/1474904121996265
Hays, J., Reinders, H. (2020). Sustainable learning and education: A curriculum for the future. Int Rev Educ 66, 29–52. https://doi.org/10.1007/s11159-020-09820-7
Heil, J. & Ifenthaler, D. (2023). Online Assessment in Higher Education: A Systematic Review. Online assessment 27(1). https://doi.org/10.24059/olj.v27i1.3398
Hidri, S. (2016). Conceptions of assessment: Investigating what assessment means to secondary and university teachers. Arab Journal of Applied Linguistics 1(1), 19–43.
Hill, P., & Barber, M. (2014). Preparing for a renaissance in assessment. London: Pearson.
Hyytinen , H , Toom , A & Shavelson , R J. (2019). Enhancing Scientific Thinking Through the Development of Critical Thinking in Higher Education. In M. Murtonen & K. Balloo (Eds), Redefining Scientific Thinking for Higher Education: Higher-Order Thinking, Evidence-Based Reasoning and Research Skills. Palgrave Macmillan, Cham, pp. 59–78. https://doi.org/10.1007/978-3-030-24215-2_3
Joutsen H, Kuivalainen T, Haltia N, Lahtomaa M, Patja P, Krapu J, Ellfolk E.-K, Kekäläinen, U, Savela P, Vuori, S. (2021). From a limited option to an established admissions method. Ideas for Developing the Open University Path. Jyväskylä Open University web-publications 12. Available: http://urn.fi/URN:ISBN:978-951-39-8717-6
Fuller, R., Brown, M. K., Kendall Brown, M., Smith, K., & Kezar, A. (2017). Adjunct Faculty Voices: Cultivating Professional Development and Community at the Front Lines of Higher Education. Stylus Publishing, LLC.
Knight, P. (2002). Being a Teacher in Higher Education. Buckingham: The Society for Research into Higher Education and Open University Press.
Kyttälä, M., & Björn, P. M. (2023). Opettajaksi opiskelevien erilaisia käsityksiä arviointitavoista. Kasvatus, 54(1), 34–50. https://doi.org/10.33348/kvt.127185
Kyttälä, M., Björn, P. M., Rantamäki, M., Lehesvuori, S., Närhi, V., Aro, M., & Lerkkanen, M.-K. (2022). Assessment conceptions of Finnish pre-service teachers. European Journal of Teacher Education. https://doi.org/10.1080/02619768.2022.2058927
Laato, S., Salmento, H., & Murtonen, M. (2018). Development of an online learning platform for university pedagogical studies—Case study. In Proceedings of the 10th international conference on computer supported education. Volume 2: CSEDU (pp. 481–488). Funchal: SCITEPRESS.
Looney, A., Cumming, J., van Der Kleij, F. & Harris,K. (2018). Reconceptualising the role of teachers as assessors: teacher assessment identity. Assessment in Education. Principles, Policy & Practice 25(5), 442–467. https://doi.org/10.1080/0969594X.2016.1268090
Lueddeke, G. R. (2003). Professionalising teaching practise in higher education: A study of disciplinary variation and teaching-scholarship. Studies in higher education 28(2), 3–228. https://doi.org/10.1080/0307507032000058082
Maunumäki, M., Maunula, M., & Harju-Luukkainen, H. (2023). “It gave me so much faith in myself”: University Students' Experiences of Agency in Summative Teacher-centered Assessment Feedback Practices in Higher education. International Journal of Multidisciplinary Perspectives in Higher Education, 3(2), 1-15. https://doi.org/10.32674/jimphe.v8i2.5447
McComb, V & Eather, N. (2021). Academic developers’ perceptions of support for sessional staff in Australia, International Journal for Academic Development. https://doi.org/10.1080/1360144X.2021.2007932
McGee J. & Colby, S. (2014). Impact of an Assessment Course on Teacher Candidates’ Assessment Literacy. Action in Teacher Education 36(5-6), 522-532. https://doi.org/10.1080/01626620.2014.977753
Ma, T., Li, Y., Yuan, H., Li, F., Yang, S., Zhan, Y., Yao, J. & Mu, D. (2023). Reflection on the teaching of student-centred formative assessment in medical curricula: an investigation from the perspective of medical students. BMC Medical Education, 23(1),1–10. https://doi.org/10.1186/s12909-023-04110-w
Macfarlane, B & Erikson, E.G. (2021) The right to teach at university: a Humboldtian perspective. Educational Philosophy and Theory 53(11), 1136-1147. https://doi-org.ezproxy.jyu.fi/10.1080/00131857.2020.1783245
Ministry of Education and Culture. Higher education. Available: https://minedu.fi/en/higher-education-and-degrees
Ministry of education and culture (2019). Visio2030. Roadmap for implementing Vision2030. Available: https://okm.fi/en/vision-2030
Moitus S, Weimer L, Välimaa J. (2020). Flexible learning pathways in higher education. Finland’s country case study for the UNESCO International Institute for Educational Planning (IIEP-UNESCO) SDG4 project in 2018–2021. Available: https://karvi.fi/app/uploads/2020/09/KARVI_1220.pdf
Morris, R., Perry, T., & Wardle, L. (2021). Formative assessment and feedback for leamrning in higher education: A systematic review. Review of Education, 9, e3292.
Myyry, L., Karaharju-Suvanto, Virtala, A-M., Raekallio, M., Salminen, O. (2020). “How self-efficacy beliefs are related to assessment practices: a study of experienced university teachers.” Assessment and Evaluation in Higher Education 47(1),155–168. DOI:10.1080/02602938.2021.1887812
Nelson, G., Monson, M-J. & Adibifar, K. & Tinoca, L. (2020). The gig economy comes to academia: Job satisfaction among adjunct faculty. Cogent Education 7(1). https://doi.org/10.1080/2331186X.2020.1786338
Nica, E. (2018). Has the shift to overworked and underpaid adjunct faculty helped education outcomes? Educational Philosophy and Theory 50(3), 213–216. https://doi-org.ezproxy.jyu.fi/10.1080/00131857.2017.1300026
Noether, G. E. (1987). Sample size determination for some common nonparametric tests. Journal of the American Statistical Association, 82(398), 645–647. https://doi.org/10.1080/01621459.1987.10478478
Nunnally, J.C. (1978). Psychometric theory. McGraw-Hill.
Ott, M. C., & Dippold, L. K. (2018). Adjunct employment preference: Who wants to be full-time faculty? Community College Journal of Research and Practice 42(3), 190–203. https://doi.org/10.1080/10668926.2017.1283259
Ogan-Bekiroglu, F & Suzuk, E. (2014). Pre-service teachers’ assessment literacy and its implementation into practice. The Curriculum Journal 25(3), 344–371. https://doi.org/10.1080/09585176.2014.899916
Parpala, A., & Lindblom-Ylänne, S. (2007). University teacher’s conceptions of good teaching in the units of high-quality education. Studies in Educational Evaluation, 33(3–4), 355–370. https://doi.org/10.1016/j.stueduc.2007.07.009 https://doi.org/10.1016/j.stueduc.2007.07.009
Pekkarinen, V & Hirsto, L. (2017). University Lecturers’ Experiences of and Reflections on the Development of Their Pedagogical Competency, Scandinavian Journal of Educational Research, 61(6), 735–753. https://doi.org/10.1080/00313831.2016.1188148
Postareff, L. (2007). Teaching in higher education: From content-focused to learning-focused approaches to teaching. Helsinki: University of Helsinki.
Postareff, L., & Lindblom-Ylänne, S. (2008). Variation in teachers’ descriptions of teaching: Broadening the understanding of teaching in higher education. Learning and Instruction 18, 109–120. https://doi.org/10.1016/j.learninstruc.2007.01.008
Postareff,L., Virtanen, V., Katajavuori, N. & Lindblom-Ylänne, S. (2012). Academics’ conceptions of assessment and their assessment practices. Studies in Educational Evaluation 38(3-4), 84-92. https://doi.org/10.1016/j.stueduc.2012.06.003
Postareff, L., & Nevgi, A. (2015). Development paths of university teachers during a pedagogical development course. Educar 51(1), 37–52. https://doi.org/10.5565/rev/educar.647
Postareff, L., Lindblom-Ylänne, S., & Nevgi, A. (2007). The effect of pedagogical training on teaching in higher education. Teaching and Teacher Education 23, 557–571. https://doi.org/10.1016/j.tate.2006.11.013
Postareff, L., Lindblom-Ylänne, S. & Nevgi, A. (2009). Yliopisto-opettajien opetukselliset lähestymistavat ja yliopistopedagogisen koulutuksen vaikuttavuus. In S. Lindblom-Ylänne ja A. Nevgi (Eds.), Yliopisto-opettajan käsikirja (pp. 46–67). Helsinki: WSOY.
Reimann, N & Sadler, N. (2017). Personal understanding of assessment and the link to assessment practice: the perspectives of higher education staff. Assessment & Evaluation in Higher Education 42(5), 724–736. https://doi.org/10.1080/02602938.2016.1184225
Richards, K., Bell, T., & Dwyer, A. (2017). Training sessional academic staff to provide quality feedback on university students' assessment: Lessons from a faculty of law learning and teaching project. The Journal of Continuing Higher Education, 65(1), 25–34.
Samuelowicz, K., Bain, J.D. (2002). Identifying academics' orientations to assessment practice. Higher Education 43, 173–201. https://doi.org/10.1023/A:1013796916022
Scriven, M. (1967). The methodology of Evaluation. In: R. Tyler, R. Gagné & M. Scriven (Eds.), Perspectives of Curriculum Evaluation 39-83. Chicago: Rand McNally.
Segers, M. & Dochy, F. (2006). Enhancing student learning through assessment: Alignment between levels of assessment and different effects on learning. Studies in Educational Evaluation 32(3), 171–179. https://doi.org/10.1016/j.stueduc.2006.08.003
Segers, M. & Tillema, H. (2011). How do Dutch secondary teachers and students conceive the purpose of assessment? Studies in Educational Evaluation 37, 49–54. https://doi.org/10.1016/j.stueduc.2011.03.008
Simper, N., Mårtensson, K., Berry, A & Maynard, N. (2022). Assessment cultures in higher education: reducing barriers and enabling change. Assessment & Evaluation in Higher Education 47(7), 1016–1029. https://doi.org/10.1080/02602938.2021.1983770
Struyven, K., Dochy, F., & Janssens, S. (2005). Students’ perceptions about evaluation and assessment in higher education: A review. Assessment & evaluation in higher education, 30, 325–341.
Södervik, I., Vilppu, H., Boshuizen, H. P. A., & Murtonen, M. (2022). Development of university teachers’ professional vision of students’ prior knowledge during a short pedagogical training. International Journal of Teaching and Learning in Higher Education 34(1), 7-24. Available: http://hdl.handle.net/10138/345469
Tamoliune, G., Greenspon, R., Tereseviciene, M., Volungeviciene,A., Trepule, E., & Dauksiene, E. (2023). Exploring the potential of micro-credentials: A systematic literature review. Frontiers in Education 7. https://doi.org/10.3389/feduc.2022.1006811
Thompson, A. (1992). Teachers’ beliefs and conceptions: a synthesis of research. In D. Grouws (Eds.), Handbook of research on mathematics teaching and learning (pp. 127–146). New York, NY: Macmillan.
Tierney, K. (2014). Fairness as a multifaceted quality in classroom assessment. Studies in Educational Evaluation 43 (55–69). https://doi.org/10.1016/j.stueduc.2013.12.003
Toom, A. & Pyhältö, K. (2020). Kestävää korkeakoulutusta ja opiskelijoiden oppimista rakentamassa. Tutkimukseen perustuva selvitys ajankohtaisesta korkeakoulupedagogiikan ja ohjauksen osaamisesta. Opetus- ja kulttuuriministeriön julkaisuja. 2020:1.
Liyan, E., Toom, A., Sullanmaa, J., Pietarinen, J., Soini, T., & Pyhältö, K. (2022). How does teachers’ professional agency in the classroom change in the professional transition from early career teachers to more experienced ones? Learning: Research and Practice 8(2), 169–190. https://doi.org/10.1080/23735082.2022.2076148
Vilppu, H., Södervik, I., Postareff, L., & Murtonen, M. (2019). The effect of short online pedagogical training on university teachers' interpretations of teaching-learning situations. Instructional Science 47(6), 679–709. https://doi.org/10.1007/s11251-019-09496-z
Virtanen, A. & Tynjälä, P. (2019). Factors explaining the learning of generic skills: a study of university students’ experiences. Teaching in Higher Education 24 (7), 880–894. https://doi.org/10.1080/13562517.2018.1515195
Xu, Y. & Brown, G. (2016). Teacher assessment literacy in practice: A reconceptualization. Teaching and Teacher Education 58, 149–162. https://doi.org/10.1016/j.tate.2016.05.010
Xu, Y. & He, L. (2019). How pre-service teachers’ conceptions of assessment change Over Practicum: Implications for Teacher Assessment Literacy. Front. Educ. 4(145). https://doi.org/10.3389/feduc.2019.00145
Watkins, D., Dahlin, B. & Ekholm, M. (2005). Awareness of the backwash effect of assessment: A phenomenographic study of the views of Hong Kong and Swedish lecturers. Instr Sci 33, 283–309. https://doi.org/10.1007/s11251-005-3002-8
Winstone, N. E. (2020). Characterising feedback cultures in higher education: an analysis of strategy documents from 134 UK universities. High Educ 84, 1107–1125. https://doi.org/10.1007/s10734-022-00818-8
Winstone, N. & Carless, D. (2020). Designing Effective Feedback Processes in Higher Education: A Learning-Focused Approach. Routlede: Abingon.
Yan, Z., & Yang, L. (2022). Assessment as learning: Maximising opportunities for student learning and achievement. Routledge. https://doi.org/10.4324/978100305208
Ödalen, J., Brommesson, D., Erlingsson, G. Ó., Schaffer, J. K., & Fogelgren, M. (2019). Teaching university teachers to become better teachers: the effects of pedagogical training courses at six Swedish universities. Higher Education Research & Development, 38(2), 339353. https://doi.org/10.1080/07294360.2018.1512955
