Presentations
2023
Kremmel, B. (2023). Measuring vocabulary knowledge: Issues in developing, using and researching vocabulary tests. Guest lecture presented at University of Exeter, UK.
Kremmel, B. (2023). Understanding language assessment: what knowledge and skills do teachers need? Keynote presented at IATEFL TEASIG PreConference Event, Harrogate, UK.
Kremmel, B., Chen, Y., Gao, J., Hui, B., Ma, S., Maie, R., Puimège, E., Rogers, J. (2023). L1 effects on incidental vocabulary learning through bimodal input: A multisite replication of Malone (2018). Paper presented at AAAL 2023 Conference, Portland, USA.
Meißner, C., & Kremmel, B. (2023). Domänenspezifischer Sprachgebrauch: Schnittstellen zwischen Korpuslinguistik und Sprachtestung. Guest lecture in Ringvorlesung Doing Fach.Didaktik, Universität Innsbruck.
Schmitt, N., Dunn, K., Anthony, L., O'Sullivan, B., Kremmel, B. (2023). Knowledge-based Vocabulary Lists: Analyses and Suggestions for Future Development. Paper presented at AAAL 2023 Conference, Portland, USA.
2022
Eberharter, K. (2022). Global Principles – Local Practices: Developing Language Assessment Literacy in Second Language Teacher Education. Paper presented at invited symposium at SLTED 2022 Conference, Vienna.
Eberharter, K., Kormos, J., Guggenbichler, E., Suzuki, S., & Kremmel, B. (2022). Is self-pacing a viable accommodation in listening tests for learners with specific learning difficulties? Paper presented at European Association of Language Testing and Asssessment 2022 Conference, Budapest, Hungary.
Eberharter, K., & Kremmel, B. (2022). Investigating writing behaviour and performance across two computer-mediated writing tasks. Paper presented at 9th International Conference on Task-Based Language Teaching, Innsbruck, Austria.
Ebner, V. (2022). Sprache oder Inhalt? - Die Beurteilung von Schreibperformanzen im Biologieunterricht. Poster presented at 5. Tagung der Fachdidaktik, Innsbruck.
Guggenbichler, E. (2022). Exploring task interaction during pre-writing: A mixed-methods study. Paper presented at 9th International Conference on Task-Based Language Teaching, Innsbruck, Austria.
Haug, T., Batty, A., Holzknecht, F., & Kremmel, B. (2022). Aligning lexical concepts across languages and language-modalities to the CEFR. Paper presented at the Language Testing Research Colloquium 2022.
Holzknecht, F., Guggenbichler, E., Zehentner, M., Yoder, M., Konrad, E., & Kremmel, B. (2022). Comparing EMI university reading materials with students’ reading proficiency: Implications for testing in EMI contexts. Paper presented at the Language Testing Research Colloquium 2022.
Konrad, E., Kulmhofer-Bommer, A., Gläserer, A., Kremmel, B., Moser-Froetscher, D., & Guggenbichler, E. (2022). iKMPLUS English Assessment – from system monitoring to individual feedback. Poster presented at EALTA 2022 Conference, Budapest, Hungary.
Kremmel, B. (2022). Global principles – Local practices: Developing Language Assessment Literacy in Second Language Teacher Education. Paper presented at invited symposium at SLTED 2022 Conference, Vienna.
Kremmel, B. (2022). Vocabulary assessment, linguistic analysis and why it might be interesting for CALL researchers and language testers to engage more. Guest lecture at Eberhard-Karls University Tübingen, Germany.
Kremmel, B. (2022). Impossible constructs? – Issues in operationalizing constructs and validating measurement instruments in multilingualism research. Guest lecture at University of Fribourg, Switzerland.
Kremmel, B. (2022). Measuring vocabulary learning: method- ological issues, options, and implications. Guest lecture at University of Fribourg, Switzerland.
Kremmel, B., Eberharter, K., Konrad, E., Guggenbichler, E. (2022). Zum Potential von kompetenzorientiertem Testen und Bewerten als Kernthema einer Allgemeinen Fachdidaktik. Paper presented at 5. Tagung der Fachdidaktik, Innsbruck.
Kremmel, B., Hirzinger-Unterrainer, E. M., Lenzing, A. (2022). Language teacher educators’ identities in a cross-linguistic institutional context. Paper presented at the SLTED 2022 Conference, Vienna.
Kremmel, B., Isbell, D.R., Kim, J. (2022). Remote proctoring in language assessment: implications for validity, fairness and justice. Language Assessment Research Conference (LARC), Chicago.
Kremmel, B., Lenzing, A., Hirzinger-Unterrainer, E.M. (2022). Monolingual vs. multilingual: Identitäten von Lehrer:innenbildner:innen im Kontext von IMoF. Paper presented at Festakt "20 Jahre Innsbrucker Modell der Fremdsprachendidaktik", Innsbruck.
Kremmel, B., & O'Sullivan, B. (2022). Writing abstracts. Lunchtime session presented at EALTA 2022 Conference, Budapest, Hungary.
Malone, M., Deygers, B., Dimova, S., Pill, J., Kremmel, B., Vogt, K. (2022). LAL across the divide: what have we learnt from our stakeholders? Keynote symposium at EALTA 2022, Budapest, Hungary.
Moser-Frötscher, D., Konrad, E., Guggenbichler, E., Ebner, V., Eberharter, K. (2022). Emerging assessment literacy in pre-service language teachers: Evaluating a university course on testing and assessment. Paper presented at the SLTED 2022 Conference, Vienna.
Moser-Froetscher, D., Konrad, E., Stampfer, F., & Kremmel, B. (2022). Tracing item writers’ evolving assessment literacy and item writing skills over time: an evaluation project. Paper presented at EALTA 2022 Conference, Budapest, Hungary.
Schmiderer, K., Guggenbichler, E., Brocca, N., & Konzett-Firth, C. (2022). Exploring pre-service teachers' criteria for evaluating collaboratively designed online tasks. Paper presented at 9th International Conference on Task-Based Language Teaching, Innsbruck, Austria.
2021
Eberharter, K., Guggenbichler, E., Kremmel, B., Holzknecht, F., Zehentner, M., & Schwarz, V. (2021). Investigating the Cognitive Validity of a Multilevel L2 Writing Assessment: A Mixed-Methods Approach. Paper presented at the EALTA 2021 Conference.
Eberharter, K., Guggenbichler, E., & Kremmel, B. (2021). Exploring the cognitive validity of a computerized writing test using eye-tracking, keystroke logging and stimulated recalls. Paper presented at the L2 Writing Research Seminar, University of Murcia.
Eberharter, K., & Kremmel, B. (2021). Digital tools for classroom assessment. Webinar for Pädagogische Hochschule Tirol.
Eberharter, K., Kremmel, B., Holzknecht, F., Guggenbichler, E. (2021). Exploring learners’ cognitive processes during a writing test using eye-tracking, keystroke logging and stimulated recalls. Poster presented at the virtual American Association of Applied Linguistics (AAAL) Conference.
Guggenbichler, E., & Kremmel, B. (2021). Investigating Writing Processes Across Languages – Same Standardized Task, Varying Processes? Paper presented at the EALTA 2021 Conference.
Guggenbichler, E., & Kremmel, B. (2021). Investigating writing processes across languages – same writing task, different processes? Paper presented at the Language Testing Research Colloquium 2021.
Guggenbichler, E., & Kremmel, B. (2021). Writing across foreign languages: same task, different processes? Paper presented at the L2 Writing Research Seminar, University of Murcia.
Guggenbichler, E., Eberharter, K., & Kremmel, B. (2021). Using eye-tracking to investigate cognitive processes during language tests: Intersection of language assessment and psycholinguistics. Guest lecture at Michigan State University, USA.
Guggenbichler, E., Eberharter, K., & Kremmel, B. (2021). Exploring learners’ cognitive processes during writing using eye-tracking, keystroke logging and stimulated recalls. Paper presented at the AILA World Congress 2021. University of Groningen.
Konrad, E., & Spöttl, C. (2021). Language testing basics. Workshop for Free University Bolzano.
Kremmel, B. (2021). Good practice in language testing and assessment. Invited Workshop for Assessment Literacy Workshop series by Arqus University Alliance.
Kremmel, B. (2021). Social media for academics. Workshop for Department of Subject-specific education, University of Innsbruck.
Kremmel, B. (2021). Publikationsstrategien. Invited Workshop at 'Nachwuchstagung der deutschen Gesellschaft für Fremdsprachenforschung'.
Kremmel, B. (2021). Publikationsstrategien. Workshop for Department of Subject-specific education, University of Innsbruck.
Kremmel, B., Holzknecht, F., Guggenbichler, E., & Spöttl, C. (2021). Using Common Standards to Explore the Match Between Reading Materials and Students’ Reading Ability in EMI Programmes. Paper presented at EALTA 2021 Conference.
Kremmel, B., & Schreiner, C. (2021). Grenzen im Bewerten und Grenzen des Bewertens. Wechselwirkungen zwischen dem Erwerb und Messen von Kompetenzen. Guest lecture in Ringvorlesung Grenzgänge und Grenzziehungen: Transdisziplinäre Ansätze in der Lehrer*innenbildung. Universität Innsbruck.
Kremmel, B., Indrarathne, B., Kormos, J., & Suzuki, S. (2021). Unknown vocabulary density, reading comprehension, and the 98% coverage figure: Replicating Hu & Nation 2000. Paper presented at the AILA World Congress 2021. University of Groningen.
Olsson, E., & Kremmel, B. (2021). A baseline study of the vocabulary knowledge of CLIL and non-CLIL students in Swedish middle school. Paper presented at the AILA World Congress 2021. University of Groningen.
Schmitt, N., O’Sullivan, B., Dunn, K., Anthony, L., Kremmel, B. (2021). Knowledge-based Vocabulary List: A list based on demonstrated knowledge of vocabulary rather than frequency. Paper presented at Language Testing Research Colloquium 2021.
Schmitt, N., O’Sullivan, B., Dunn, K., Anthony, L., Kremmel, B. (2021). Knowledge-based Vocabulary List: A list based on demonstrated knowledge of vocabulary rather than frequency. Paper presented at the virtual American Association of Applied Linguistics (AAAL) Conference.
2020
Eberharter, K., & Kremmel, B. (2020). Using eye tracking to investigate cognitive processes during language assessment – important insights concerning data triangulation and interpretation. Paper presented at the IRG 2020, University of Fribourg, Switzerland.
Eberharter, K., Guggenbichler, E., Kremmel, B., Holzknecht, F., Zehentner, M., & Schwarz, V. (2020, conference postponed to 2021). Investigating the Cognitive Validity of a Multilevel L2 Writing Assessment: A Mixed-Methods Approach. Paper presented at the EALTA 2020 Conference, Budapest, Hungary.
Eberharter, K., Kremmel, B., Holzknecht, F., Guggenbichler, E. (2020, conference cancelled). Exploring learners’ cognitive processes during a writing test using eye-tracking, keystroke logging and stimulated recalls. Paper presented at the American Association of Applied Linguistics (AAAL) Conference, Denver, USA.
Guggenbichler, E., & Kremmel, B. (2020, conference postponed to 2021). Investigating writing processes across languages – same writing task, different processes? Paper presented at the Language Testing Research Colloquium 2020, Hammamet, Tunisia.
Guggenbichler, E., & Kremmel, B. (2020, conference postponed to 2021). Investigating Writing Processes Across Languages – Same Standardized Task, Varying Processes? Paper presented at the EALTA 2020 Conference, Budapest, Hungary.
Holzknecht, F. (2020, conference postponed to 2021). Double play in listening assessment. Paper presented at Language Testing Research Colloquium 2020, Hammamet, Tunisia.
Holzknecht, F. (2020, presentation cancelled). How do response order and double play affect construct validity in listening assessment? Paper presented at the LTRC Melbourne, Australia.
Holzknecht, F. (2020). Double play in listening assessment. Paper presented at the Language Testing Forum 2020, Lancaster, UK.
Holzknecht, F. (2020). Using eye-tracking in research on audio-only listening tests. Paper presented at the New Directions 2020 Preconference Symposium on Eye-Tracking in Language Assessment, Singapore.
Kremmel, B., & Taylor, C. (2020, conference postponed to 2021). Writing Abstracts. Workshop presented at the EALTA Conference 2020, Budapest, Hungary.
Kremmel, B. (2020). Language Assessment Literacy 2.0: Challenges and opportunities. Keynote paper presented at the BAAL TEASIG Conference 2020, Open University, Milton Keynes.
Kremmel, B. (2020). Wortschatz und Grammatik testen und bewerten. Workshop presented at the Sprachzentrum FAU Erlangen, Germany.
Kremmel, B. (2020). Test specifications in the Unicert® context - why and how. Keynote talk at UniCert Workshop 2020, University of Rostock, Germany.
Kremmel, B. (2020). Opportunities and challenges for testing associations in the face of the COVID-19 global pandemic. Panel discussion at Language Testing Forum 2020, Lancaster, UK.
Kremmel, B., & Vanhove, J. (2020, workshop cancelled) Impossible constructs? – Discussing operationalization and validation of constructs and measurement instruments in multilingualism research. Workshop presented at the University of Fribourg, Institute of Multilingualism, Switzerland.
Kremmel, B. & Isbell, D. R. (2020). Current options in at-home language proficiency tests for making high-stakes decisions. Paper presented at the ECOLT 2020 Conference, Washington, D.C., USA.
Kremmel, B. & Isbell, D.R. (2020). Survey of remote invigilation options for large-scale standardized language tests. Recent research into and application of technology in language assessment: validity in a dynamically changing assessment context
Kremmel, B. & Isbell, D.R. (2020). Testing times for high-stakes tests during COVID-19: challenges and opportunities of at-home
administration. Paper presented at the New Directions 2020 Conference, Singapore.
Schmitt, N., O’Sullivan, B., Dunn, K., Anthony, L., Kremmel, B. (2020, conference postponed to 2021). Knowledge-based Vocabulary List: A list based on demonstrated knowledge of vocabulary rather than frequency. Paper presented at Language Testing Research Colloquium 2020, Hammamet, Tunisia.
Schmitt, N., O’Sullivan, B., Dunn, K., Anthony, L., Kremmel, B. (2020, conference cancelled). Knowledge-based Vocabulary List: A list based on demonstrated knowledge of vocabulary rather than frequency. Paper presented at American Association of Applied Linguistics (AAAL) Conference, Denver, USA.
Zehentner, M., Holzknecht, F., Kremmel, B., & Spöttl, C. (2020, conference postponed to 2021). Using Common Standards to Explore the Match Between Reading Materials and Students’ Reading Ability in EMI Programmes. Paper presented at EALTA 2020 Conference, Budapest, Hungary.
2019
Eberharter, K. (2019). Rater cognition and the role of individual attributes in rating speaking performances. Paper presented at the 41st Language Testing Research Colloquium, Atlanta, USA.
Eberharter, K. (2019). Auswirkungen der neuen Standardisierten Reifeprüfung auf Bewertungskompetenz und Prüfungsgestaltung im Fremdsprachenunterricht. Paper presented at ÖFEB Kongress 2019, Linz, Austria.
Eberharter, K., de Jong, N., Banerjee, J., & Spöttl, C. (2019). Assessing speaking: developing and applying rating scales. Preconference workshop presented at the 16th Annual EALTA Conference "Transitions in Language Assessment", Dublin, Ireland.
Eberharter, K., Kremmel, B., Zehentner, M., & Spöttl, C. (2019). Exploring foreign language learning in persons with multiple sclerosis: Results from a pilot study. Poster presented at American Association of Applied Linguistics (AAAL) Conference, Atlanta, USA.
Holzknecht, F. (2019). Mock viva: Double play in listening assessment. Paper presented at the Language Testing Research Group Meeting, Lancaster, UK.
Holzknecht, F. (2019). Double play in Matura listening tasks: How valid is it? Paper presented at the Austrian Ministry of Education, Science, and Research, Vienna, Austria.
Holzknecht, F. (2019). Double play in listening assessment: Towards increased authenticity. Paper presented at the 16th Annual EALTA Conference "Transitions in Language Assessment", Dublin, Ireland.
Patel, M., Coombe, C., Kremmel, B., O'Sullivan, B., & Villa Larenas, S. (2019). Language Assessment Literacy Development: Current Status and Future Directions. Colloquium presented at International TESOL Convention 2019, Atlanta, USA.
Kremmel, B. (2019). Avoiding bias in language test development. Invited workshop at 54th ALTE Meeting and Conference. Ljubljana, Slovenia.
Kremmel, B. (2019). Grundlagen des Prüfens und Bewertens. Guest lecture for Seminar "Testen und Prüfen für zukünftige Fremdsprachenlehrerinnen und -lehrer", Ruhr University Bochum, Germany.
Kremmel, B. (2019). Produktive Fertigkeiten Testen und Bewerten. Invited Workshop presented at FAU Erlangen-Nürnberg, Erlangen, Germany.
Kremmel, B. (2019). Mehr MESSEN im ErMESSENsspielraum: Schulische Leistungsmessung in den Fremdsprachen
und warum es nötig ist, sie objektiver und transparenter zu machen. Symposium organized at ÖFEB Kongress 2019, Linz, Austria.
Kremmel, B. (2019). Rezeptive Fertigkeiten Testen und Bewerten. Invited Workshop presented at FAU Erlangen-Nürnberg, Erlangen, Germany.
Kremmel, B., Eberharter, K., Zehentner, M, & Spöttl, C. (2019). Vocabulary learning with multiple sclerosis: A pilot study using magnetic resonance imaging. Paper presented at Vocab@Leuven 2019, KU Leuven, Belgium.
Kremmel, B., Eberharter, K., Holzknecht, F., & Konrad, E. (2019). Language Assessment Literacy als Voraussetzung für die Nachhaltigkeit einer Prüfungsreform. Paper presented at the 4. Tagung der Fachdidaktik, Innsbruck.
Kremmel, B., & Harding, L. (2019). Bewertungskompetenz modellieren: Wieviel „language assessment literacy“ brauchen Fremdsprachenlehrpersonen? Paper presented at ÖFEB Kongress 2019, Linz, Austria.
Kremmel, B., & Harding, L. (2019). Exploring the Language Assessment Literacy of SLA researchers. Paper presented at American Association of Applied Linguistics (AAAL) Conference, Atlanta, USA.
Kremmel, B., Harsch, C., & Brandt, S. (2019). C-tests as language placement tools for displaced people. Paper presented at the 16th Annual EALTA Conference "Transitions in Language Assessment", Dublin, Ireland.
Kremmel, B., Schwarz, V., Spöttl, C. (2019). Intended and unintended consequences of reforming a national school-leaving exam and their role for validation. Paper presented at the 41st Language Testing Research Colloquium, Atlanta, USA.
Kremmel, B., & Zehentner, M. (2019). Competence-based assessment in lower secondary education. Invited workshop for KulturKontakt Austria, Tirana, Albania.
Schmitt, N., Dunn, K., O'Sullivan, B., Anthony, L., & Kremmel, B. (2019). A Knowledge-based Vocabulary List (KVL): German, Spanish, and Chinese Results. Paper presented at the 41st Language Testing Research Colloquium, Atlanta, USA.
Schmitt, N., O'Sullivan, B. Anthony, L., Dunn, K., Kremmel, B. (2019). A Knowledge-based Vocabulary List (KVL): A List for Testing and Pedagogy. Paper presented at the 39th Language Testing Forum, Swansea, UK.
Schmitt, N., O'Sullivan, B. Anthony, L., Dunn, K., Kremmel, B. (2019). A knowledge-based vocabulary list (KVL): Implications for research, teaching, and assessment. Paper presented at EUROSLA 29, Lund, Sweden.
Schmitt, D., Schmitt, N., & Kremmel, B. (2019). What’s the Word? Assessing Vocabulary Size and Depth. Invited workshop presented at International TESOL Convention 2019, Atlanta, USA
Schwarz, V. (2019). Testen der Schreibkompetenz auf den A-Levels: Ergebnisse und Herausforderungen für das Testen der Fremd- und Zweitsprache Englisch auf den unteren Kompetenzstufen. Poster presented at "11. ÖGSD Nachwuchstagung", Innsbruck, Austria.
Schwarz, V., Holzknecht, F., Konrad, E., & Spöttl, C. (2019). Assessing low-level writing: identifying the need for change. Poster presented at the 16th Annual EALTA Conference "Transitions in Language Assessment", Dublin, Ireland.
Zehentner, M. (2019). No cue what to do: Examining the effects of situational cues in writing task prompts. Poster presented at "11. ÖGSD Nachwuchstagung", Innsbruck, Austria.
2018
Eberharter, K. (2018). Judgment and decision making in rating speaking: Exploring the role of cognitive attributes. Work-in-progress paper presented at the 15th Annual EALTA Conference "Technology-Based Language Assessment: Benefits and Challenges", Bochum, Germany.
Eberharter, K. (2018). A qualitative approach to validating multiple-choice items assessing language in context. Paper presented at Symposium "Language testing in Austria: taking stock", Klagenfurt.
Eberharter, K. (2018). Was macht einen Sprachtest “gut”? – Gütekriterien des Testens. Guest lecture for Seminar "Testen und Prüfen für zukünftige Fremdsprachenlehrerinnen und -lehrer", Ruhr University Bochum, Germany.
Eberharter, K., Holzknecht, F., & Kremmel, B. (2018). Evaluating the effectiveness of a training program for double-raters. Paper presented at Symposium "Language testing in Austria: taking stock", Klagenfurt.
Eberharter, K., Holzknecht, F., Kremmel, B., McCray, G., Zehentner, M., Konrad, E., & Spöttl, C. (2018). Looking into Listening: Establishing the cognitive validity of the Aptis Listening Test. Paper presented at the 40th Language Testing Research Colloquium, Auckland, New Zealand.
Eberharter, K., Kremmel, B., Spöttl, C., Zehentner, M., Brenneis, C., Ehling, R., Amprosi, M., Scherfler, C., Berger, T., Steiger, R., Bsteh, G., Dunlea, J., & Spiby, R. Foreign language learning in people with Multiple Sclerosis: A pilot study. Paper presented at EUROSLA 28, University of Münster, Germany.
Eberharter, K., & Spöttl, C. (2018). Developing illustrative performances for speaking examinations. Workshop presented at 52nd Annual International IATEFL Conference and Exhibition, Brighton, UK.
Harding, L., Brunfaut, T., Huhta, A., Alderson, J.C, Fish, A., Kremmel, B. (2018). DIALANG 2.0: Charting a course for revision and expansion of an online diagnostic testing system. Work-in-progress paper presented at the 15th Annual EALTA Conference "Technology-Based Language Assessment: Benefits and Challenges", Bochum, Germany.
Harsch, C., Kremmel, B., Brandt, S., Patel, M. (2018). Introducing LaPlace - language placement for displace people. Paper presented at EALTA Language Testing and Migration SIG Meeting, Bochum, Germany.
Holzknecht, F., McCray, G., Kremmel, B., Eberharter, K., Spiby, R., & Dunlea, J. (2018). Response order effects on candidate viewing behaviour and item difficulty in multiple-choice listening tests. Paper presented at the 15th Annual EALTA Conference "Technology-Based Language Assessment: Benefits and Challenges", Bochum, Germany.
Kremmel, B. (2018). What do vocabulary test scores mean? Presentation for DiMa Didaktik am Montagabend, University of Innsbruck.
Kremmel, B. (2018). Developing a validity argument for a diagnostic computer-adaptive vocabulary knowledge profiler. Paper presented at the 40th Language Testing Research Colloquium, Auckland, New Zealand.
Kremmel, B. (2018). Unpacking Language Assessment Literacy, or: What different groups should know about language testing. Paper presented at LALS Seminar, University of Victoria Wellington, New Zealand.
Kremmel, B. (2018). Development and validation of vocabulary tests: The case of the Vocabulary Knowledge Profiler. Paper presented at LALS Vocabulary Research Group Meeting, University of Victoria Wellington, New Zealand.
Kremmel, B. (2018). Developing and validating a diagnostic computer-adaptive vocabulary knowledge profiler. Paper presented at the 15th Annual EALTA Conference "Technology-Based Language Assessment: Benefits and Challenges", Bochum, Germany.
Kremmel, B. (2018). Was macht einen Sprachtest 'gut'? Guest lecture for Seminar "Testen und Prüfen für zukünftige Fremdsprachenlehrerinnen und -lehrer", Ruhr University Bochum, Germany.
Kremmel, B. (2018). Desirable Features in the Next Generation of Vocabulary Tests. Paper presented at American Association of Applied Linguistics (AAAL) Conference, Chicago, USA.
Kremmel, B. (2018). Development and initial validation of a diagnostic computer-adaptive vocabulary knowledge profiler. Paper presented at Language Assessment Research Conference (LARC), Iowa State University, Ames, USA.
Kremmel, B., Eberharter, K., Holzknecht, F., Konrad, E., Schwarz, V., & Zehentner, M. (2018). From 0 to 10 years and beyond: Accountability, consequences, and potential future validation agendas for the SRDP. Paper presented at the Symposium "Reforming the Austrian Matura - 10 years on", Innsbruck, Austria.
Seeber, I., & Kremmel, B. (2018). Exploring how cognitive computing can support rater decision-making. Work-in-progress paper presented at the 15th Annual EALTA Conference "Technology-Based Language Assessment: Benefits and Challenges", Bochum, Germany.
Spöttl, C. (2018). Reforming national language exams: challenges, consequences and potential repercussions for validation. Insights from an Austrian project. Invited Keynote at 6th British Council New Directions in English Language Assessment Conference, Kuala Lumpur, Malaysia.
Spöttl, C. (2018). Policy Makers and Implementers. Panel discussion at 6th British Council New Directions in English Language Assessment Conference, Kuala Lumpur, Malaysia.
Spöttl, C. (2018). Developing benchmarked speaking performances for local and national use. Workshop at 6th British Council New Directions in English Language Assessment Conference, Kuala Lumpur, Malaysia.
Spöttl, C., Eberharter, K., Holzknecht, F., Kremmel, B., & Zehentner, M. (2018). Delivering reform in a high stakes context: from content-based assessment to communicative and competence-based assessment. Paper presented at Symposium "Language testing in Austria: taking stock", Klagenfurt.
Spöttl, C, & Kremmel, B. (2018). Reforming a national school-leaving exam: Challenges and consequences of Austria implementing a European reference instrument. Paper presented at American Association of Applied Linguistics (AAAL) Conference, Chicago, USA.
Zehentner, M. (2018). No cue what to do: Examining the effects of situational cues in writing task prompts. Poster presented at the 15th Annual EALTA Conference "Technology-Based Language Assessment: Benefits and Challenges", Bochum, Germany.
Zehentner, M. (2018). Examining the effect of partner choice in peer-to-peer assessment. Paper presented at Symposium "Language testing in Austria: taking stock", Klagenfurt.
2017
Eberharter, K. (2017). Judgment and decision making in rating speaking: Exploring the role of cognitive attributes. Paper presented at 39th Language Testing Research Colloquium "Language Assessment Literacy Across Stakeholder Boundaries", Universidad de los Andes, Bogotá, Colombia.
Eberharter, K. (2017). Einblicke in die Bewertungsprozesse in fremdsprachlichen mündlichen Prüfungen. Paper presented at the 3. Tagung der Fachdidaktik, Innsbruck.
Eberharter, K., Spöttl, C., & Zehentner, M. (2017). Die Entwicklung illustrativer mündlicher und schriftlicher Performanzen für die neue Standardisierte Reifeprüfung in Englisch. Poster presented at 10-year Symposium of the Austrian Society for Language Teaching (ÖGSD), University of Vienna.
Holzknecht, F. (2017). Listening once or twice: A pilot study. Paper presented at the Language Testing Research Group Meeting, Lancaster, UK.
Holzknecht, F., Eberharter, K., Kremmel, B., McCray, G., Zehentner, M., Konrad, E., & Spöttl, C. (2017). Kognitive Prozesse von FremdsprachenlernerInnen während Hörverstehensaufgaben: Eine Eye-Tracking und Stimulated-Recall Untersuchung. Poster presented at 10-year Symposium of the Austrian Society for Language Teaching (ÖGSD), University of Vienna.
Kremmel, B. (2017). Grundlagen des Prüfens und Testens im Kontext des modernen, kompetenzorientierten FSU. Guest lecture for Seminar "Testen und Prüfen für zukünftige Fremdsprachenlehrerinnen und -lehrer", Ruhr University Bochum, Germany.
Kremmel, B. (2017). Comparing two approaches to computer-adaptive vocabulary testing. Paper presented at EuroSLA 27, University of Reading, UK.
Kremmel, B. (2017). Entwicklung und Validierung eines computer-adaptiven Wortschatztests. Poster presented at 10-year Symposium of the Austrian Society for Language Teaching (ÖGSD), University of Vienna.
Kremmel, B. (2017). Computer-Adaptive Vocabulary Tests: Is There an Ideal Design Approach? Paper presented at American Association of Applied Linguistics (AAAL) Conference, Portland, USA.
Kremmel, B. (2017). Kommunikatives Sprachtesten: Grundlagen und Prinzipien. Guest lecture for Seminar "Testen und Prüfen für zukünftige Fremdsprachenlehrerinnen und -lehrer", Ruhr University Bochum, Germany.
Kremmel, B. (2017). What do vocabulary test scores mean? Guest lecture for Seminar "The Psychology of Language", University of Salzburg.
Kremmel, B., Eberharter, K., & Harding, L. (2017). Putting the ‘language’ into language assessment literacy. Paper presented at 39th Language Testing Research Colloquium "Language Assessment Literacy Across Stakeholder Boundaries", Universidad de los Andes, Bogotá, Colombia.
Kremmel, B., Eberharter, K., Holzknecht, F., & Konrad, E. (2017). LehrerInnen als AufgabenerstellerInnen für nationale High-Stakes Tests: Auswirkungen auf Assessment literacy. Paper presented at 27th DGFF Congress (Deutsche Gesellschaft für Fremdsprachenforschung) "Sprachen lernen integriert: global, lokal, regional", Friedrich-Schiller-Universität Jena, Germany.
Kremmel, B., Eberharter, K., Holzknecht, F., & Konrad, E. (2017). Enhancing language assessment literacy through teacher involvement in high-stakes test development. Paper presented at 39th Language Testing Research Colloquium "Language Assessment Literacy Across Stakeholder Boundaries", Universidad de los Andes, Bogotá, Colombia.
Kremmel, B., & Harding, L. (2017). Towards a comprehensive, empirical model of language assessment literacy across different contexts. Paper presented at 39th Language Testing Research Colloquium "Language Assessment Literacy Across Stakeholder Boundaries", Universidad de los Andes, Bogotá, Colombia.
Kremmel, B., Ratheiser, U., & Spöttl, C. (2017). Crossing the borders between literature and language assessment. Paper presented at Language Education across Borders Conference, University of Graz, Austria.
Ratheiser, U., & Spöttl, C. (2017). Incorporating the new extended descriptors for literature in teaching and assessment programmes in secondary school education. Paper presented at EALTA CEFR SIG Meeting 2017, London, UK.
Spiby, R., & Holzknecht, F. (2017). A framework for innovation: Revising the Aptis Listening Test. Paper presented at the 3rd International Conference on Language Testing and Assessment and the 5th British Council New Directions in Language Assessment Conference, Shanghai, China.
2016
Eberharter, K., de Jong, N.H., Kremmel, B., & Spöttl, C. (2016). Speaking assessment practices across Europe and beyond - preliminary results. Paper presented at EALTA Speaking SIG Meeting 2016, Valencia, Spain.
Eberharter, K., Kremmel, B., Holzknecht, F., & Konrad, E. (2016). Fostering language assessment literacy through teacher involvement in high-stakes test development. Paper presented at Language Assessment Literacy Symposium 2016 "Enhancing Language Assessment Literacy: Sharing, Broadening, Innovating", Lancaster University, UK.
Harding, L., & Kremmel, B. (2016). Developing a language assessment literacy survey for use across different contexts. Paper presented at the CRELLA Summer Research Seminar 2016 "Teachers’ Assessment Literacy Enhancement", University of Bedfordshire, UK.
Holzknecht, F., Huhta, A., & Lamprianou, I. (2016). The CEFR as construct across national contexts – Is your B2 my B2? Paper presented at the 13th Annual EALTA Conference, Valencia, Spain.
Kremmel, B. (2016). Starting from scratch: Issues in developing a new diagnostic vocabulary test. Paper presented at Vocab@Tokyo 2016, Meiji Gakuin University, Tokyo, Japan.
Kremmel, B. (2016). Starting with a clean slate: Innovations in testing vocabulary size. Paper presented at EuroSLA 26, University of Jyväskylä, Finland.
Kremmel, B. (2016). Assessment literacy needs analyses - the case of EAP. Paper presented at "EAP in the East Midlands" Conference, Nottingham Trent University, UK.
Kremmel, B. (2016). Re-defining the construct of vocabulary size tests: Challenging Conventions. Paper presented at the 13th Annual EALTA Conference, Valencia, Spain.
Kremmel, B. (2016). Interpreting the Scores from Vocabulary Size Tests: Handle with Caution!. Paper presented at American Association of Applied Linguistics (AAAL) Conference, Orlando, USA.
Kremmel, B. (2016). Was macht Sprachtests gut? Guest lecture for Seminar "Testen und Prüfen für zukünftige Fremdsprachenlehrerinnen und -lehrer", Ruhr University Bochum, Germany.
Kremmel, B., Brunfaut, T., & Alderson, J.C. (2016) How important is knowledge of multi-word expressions for reading comprehension? Paper presented at the Formulaic Language Research Network (FLaRN) Conference 2016, Vilnius, Lithuania.
Kremmel, B., & Harding, L. (2016). Towards a comprehensive, empirical model of language assessment literacy – Pilot results from a validation study. Poster presented at Language Assessment Literacy Symposium 2016 "Enhancing Language Assessment Literacy: Sharing, Broadening, Innovating", Lancaster, UK.
Kremmel, B., & Schmitt, N. (2016). What's Vocabulary? Challenging Conventions to Re-define the Construct of Vocabulary Size Tests. Paper presented at 38th Language Testing Research Colloquium, Palermo, Italy.
Maurer, M. (2016). Lexical combinations in blogs – a corpus-based study of English B2 written performances. Paper presented at "Lexical combinations and typified speech in a multilingual context" Conference, Innsbruck, Austria.
Maurer, M., & Moreno, D. (2016). Investigating the construct of a writing test across languages: a corpus based approach. Poster presented at the 13th Annual EALTA Conference, Valencia, Spain.
Schmitt, N., & Kremmel, B. (2016). Issues in Vocabulary Test Development: Challenging Conventions. Paper presented at American Association of Applied Linguistics (AAAL) Conference, Orlando, USA.
Spöttl, C., & Eberharter, K. (2016). Assessing English and Italian lexical combinations in high-stakes examinations. Paper presented at "Lexical combinations and typified speech in a multilingual context" Conference, Innsbruck, Austria.
Spöttl, C., Zimmermann, S., & Banerjee, J. (2016). The construct of writing across contexts. Work-in-Progress Paper presented at the 13th Annual EALTA Conference, Valencia, Spain.
Zehentner, M. (2016). You must choose, but choose wisely: an investigation of the impact of partner choice on paired speaking ratings. Paper presented at "8. ÖGSD Nachwuchstagung", Vienna, Austria.
Zehentner, M. (2016). Students’ assessment literacy as shown in paired speaking exams. Paper presented at IATEFL TEA SIG Conference, Aigle, Switzerland.
2015
Eberharter, K. (2015). Judgement and decision-making in rating speaking: Exploring the role of cognitive attributes. Poster presented at the Language Testing Forum 2015, Oxford, UK.
González Fernández, B., & Kremmel, B. (2015). New approaches to vocabulary testing: Challenging assumptions. Poster presented at the BAAL Vocabulary Special Interest Group Conference 2015, Swansea, UK.
Holzknecht, F. (2015). The cognitive validity of repeating the input in listening assessment. Paper presented at the 12th Annual EALTA Conference, Copenhagen, Denmark.
Kremmel, B. (2015). The more, the merrier? Issues in measuring vocabulary size. Paper presented at the 37th Language Testing Research Colloquium, Toronto, Canada.
Kremmel, B. (2015). The Legend of Zelda - A Link between Words. Paper presented at the Postgraduate Research Symposium of the School of English, Nottingham, UK.
Kremmel, B. (2015). Diagnostisches Sprachtesten – Eine Einführung. Guest lecture at Workshop "Sprachdiagnostik in der Sekundarstufe I/II", Bochum, Germany.
Kremmel, B. (2015). Grundlagen des Sprachtestens. Guest lecture for Seminar "Testen und Prüfen für zukünftige Fremdsprachenlehrerinnen und -lehrer", Bochum, Germany.
Kremmel, B., Frick, A., Lutz, S., & Parhammer, S. (2015). Erforschen testen - Tests erforschen. Paper presented at the 2. Tagung der Fachdidaktik, Innsbruck.
Kremmel, B., & Harding, L. (2015). Developing language assessment literacy profiles for different stakeholders - needs, lacks and wants. Paper presented at the 12th Annual EALTA Conference, Copenhagen, Denmark.
Kremmel, B., & Vilkaité, L. (2015). How useful are diagnostic vocabulary tests? Paper presented at the BAAL TEASIG Conference 2015, Cambridge, UK.
Maurer, M. (2015). A corpus-based study of linguistic features in blog-writing test performances. Paper presented at the Language Testing Research Group Meeting, Lancaster, UK.
Zehentner, M. (2015). Paired speaking – Are students able to choose effectively? Poster presented at the Language Testing Forum 2015, Oxford, UK.
2014
Banerjee, J., De Jong, N., Spöttl, C. (2014). Good practice in assessing speaking. Pre-conference workshop at the 11th Annual EALTA Conference, Coventry.
Eberharter, K. (2014). The process of assessing spoken language performance: An investigation into rater decision-making. Paper presented at the Language Testing Research Group Meeting, Lancaster, UK.
Holzknecht, F. (2014). Exploring corpus analyses to inform writing assessment: A pilot study. Paper presented at the Language Testing Forum 2014, Southampton, UK.
Holzknecht, F. (2014). The cognitive validity of repeating the input in listening assessment. Paper presented at the Language Testing Research Group Meeting, Lancaster, UK.
Holzknecht, F., & Kremmel, B. (2014). Good practice in language assessment – Session II. Workshop presented at the Study Group Teachers Conference 2014, Brighton, UK.
Holzknecht, F., Maurer, M., & Bechtold, A. (2014). Assessing functional competence in writing: A corpus based approach. Poster presented at the 11th Annual EALTA Conference, Coventry, UK.
Kremmel, B. (2014). Exploring different item formats for vocabulary size tests. Paper presented at the IATEFL TEA SIG Conference, Granada, Spain.
Kremmel, B. (2014). Investigating the usefulness of different item formats for vocabulary size tests. Paper presented at the 47th British Association of Applied Linguistics Annual Conference, Warwick, UK.
Kremmel, B. (2014). Language testing and vocabulary research – a symbiotic relationship? Poster presented at the Language Testing Forum 2014, Southampton, UK.
Kremmel, B. (2014). When tests don’t pass the test: Illustrating the need for improved vocabulary knowledge measures. Paper presented at the Postgraduate Research Symposium of the School of English, Nottingham, UK.
Kremmel, B., Brunfaut, T., & Alderson, J.C. (2014). Exploring the role of phraseological knowledge in second language reading performance. Poster presented at the 36th Language Testing Research Colloquium, Amsterdam, Netherlands.
Kremmel, B., Brunfaut, T., & Alderson, J.C. (2014). Exploring the role of phraseological knowledge in foreign language reading. Paper presented at the Language Testing Research Group Meeting, Lancaster, UK.
Kremmel, B., Eberharter, K., Konrad, E. & Maurer, M. (2014). Investigating an exam reform’s impact on classroom assessment practices of writing. Paper presented at the 48th Annual International IATEFL Conference and Exhibition, Harrogate, UK.
Kremmel, B., & Holzknecht, F. (2014). Good practice in language assessment – Session I. Paper presented at the Study Group Teachers Conference 2014, Brighton, UK.
2013
Kremmel, B. (2013). Explaining variance in reading test performance. Paper presented at the Language Testing Research Group Meeting, Lancaster, UK.
Kremmel, B. (2013). Explaining Variance in Reading Test Performance. Paper presented at the Language Testing Forum 2013, Nottingham, UK.
Kremmel, B., Eberharter, K., Konrad, E., & Maurer, M. (2013). Righting writing practices: The impact of exam reform. Poster presented at the 10th Annual EALTA Conference, Istanbul, Turkey.
Kremmel, B., & Holzknecht, F. (2013). Strengths and weaknesses of the CEFR in guiding test task design: What the can dos can do and what they can’t (yet). Paper presented at conference "Language Testing in Europe: Time for a New Framework?", Antwerp, Belgium.
Spöttl, C., & Eberharter, K. (2013). CEFR performance descriptors and the missing formulae. Paper presented at the conference on Language testing in Europe: Time for a new framework? Antwerp, Belgium.
Spöttl, C., & Eberharter, K. (2013). Using the CEFR in test task design across four languages. Paper presented at IATEFL Testing, Evaluation and Assessment SIG Conference, Siena, Italy.
2012
Spöttl, C. (2012). From principle to practice of writing assessment: What can we learn from large-scale competence-based tests for classroom assessment? “Assessing writing: The art of the possible…” Paper presented at the Pre-conference event organized by IATEFL TEASIG, Glasgow, UK.
2011
Eberharter, K., & Frötscher, D. (2011). Marking open-ended listening and reading test items: Issues and practice. Paper presented at the 1st International Conference on Language Testing and Assessment, Nicosia, Cyprus.
Green, R. Spöttl, C. (2011). Building up a pool of standard setting judges: Problems, solutions and insights. Paper presented at the 8th Annual EALTA Conference, Siena, Italy.
Holzknecht, F., & Kremmel, B. (2011). Is rater training worth it? Paper presented at the IATEFL TEASIG 2011 Conference, Innsbruck.
Marinell, A., & Konrad, E. (2011). What do the kids think? An analysis of feedback questionnaires. Paper presented at IATEFL TEASIG 2011, Innsbruck.
2010
Holzknecht, F. (2010). A needs-analysis for Austrian English teachers in developing and assessing writing tests for the Matura. Paper presented at ÖGSD conference "Sprachendidaktik: Der wissenschaftliche Nachwuchs im Dialog“, Graz.
Spöttl, C., & Green, R. (2010). Quality assurance. Taking on the responsibility. Paper presented at "Sprachen lernen: Kompetenzen entwickeln – Performanzen (über)prüfen", 5. Tagung der Österreichischen Gesellschaft für Sprachendidaktik, Innsbruck.
Ziermann, B., & Kremmel, B. (2010). Von der Bank aus betrachtet – SchülerInnenstrategien angesichts von CLIL-Einheiten im Psychologie/Philosophieunterricht. Paper presented at 5. Tagung der Österreichischen Gesellschaft für Sprachendidaktik „Sprachen lernen: Kompetenzen entwickeln – Performanzen (über)prüfen“, Innsbruck.
2009
Spöttl, C., & Green, R. (2009). Going national, standardised and live in Austria: Challenges and tensions. Paper presented at the 6th Annual Conference of EALTA, Turku, Finnland.