1:00 - 1:15 | Opening Remarks
Marc Oswald, Patrick Plichart, Open Assessment Technologies
1:15 - 2:15| Keynote Presentation
Prof. Samuel Greiff, Head of Research Group, Principal Investigator, and Full Professor of Educational Psychology & Artificial Intelligence
| Goethe-University Frankfurt, Germany
An authority in the fields of educational psychology, assessment, EdTech, AI, and big data, Dr. Greiff brings unparalleled expertise and insight through his extensive research. Prof. Greiff has secured significant research funding, published over 250 peer-reviewed articles, and contributed to numerous international conferences. He plays a crucial role in large-scale assessments like PISA and PIAAC, focusing on transversal skills, problem solving, and the application of AI in education.
Dr. Greiff's work has shaped our understanding of transversal skills and the application of AI in education, promising an insightful and inspiring keynote address.
2:15 - 2:45 | Bias Testing of Large Language Models
Dr. Renzo Degiovanni | Senior Research & Technology Associate| Luxembourg Institute of Science and Technology (LIST)
2:45 - 3:15 | The TAO platform and Multilingualism: From Roller Coaster to Smooth Sailing?
Presented by cApStAn Linguistic Quality Control
Laura Casanellas Luri | CTO
Steve Dept | Founding Partner
Manuel Souto Pico | Lead Translation Technologist
Dive into the innovative collaboration that enabled interoperability between the open-source TAO test delivery platform and the open-source OmegaT computer-assisted translation tool (CAT tool) in order to support the 2025 PISA international assessment program. Hear from cApStAn's leadership team as they discuss the challenges encountered and the evolution of the translation middleware.
The second part of the presentation will examine the integration of machine translation (MT) engines within the platform, detailing the development of automated workflows. Additionally, we will discuss the computation and application of Artificial Intelligence Quality Estimates (AIQE) for assessing raw machine output. This session is ideal for those interested in the intersection of educational technology, translation, and artificial intelligence.
3:15 - 4:00 | Fireside Chat: Assessment Innovation with the New York City Department of Education
Dr. Anthony Benners | Senior Psychometrician and Innovation Advisor | NYC Department of Education
Facilitated by: André Nunes | Product Marketing Manager | Open Assessment Technologies
Join us for an insightful interview with Dr. G. Anthony Benners where we'll discuss the application of assessment software by the New York City Department of Education for World Language Exams, focusing on the program's goals, student cohort, challenges, and future steps. During this live podcast-style session, we'll talk through the NYCDOE's experience transitioning from paper to digital assessments and share first-hand recommendations.
This presentation also delves into the use of AI in generating assessment questions from a psychometrician's perspective, addressing both summative and formative contexts. The session will conclude with a brief demo of the AI tool in TAO, inviting attendees to explore TAO's innovative features.
Open Assessment Technologies
1:00: 1:50 | Keynote: Navigating the Future - Innovations on the Horizon with TAO
Dragos Ivan | Product Manager | Open Assessment Technologies
Join us as we spotlight the evolution of the TAO platform over the past year and unveil the upcoming innovations we have planned for our product roadmap. In this session, we'll dive into new experience TAO has to offer, beta features including AI assisted test development, offline test delivery, customizable reporting and more.
1:50: 2:20 | Improving Literacy and Numeracy Outcomes for Learners in South Africa
Dr. Maxine Schaefer| Senior Researcher | Click Learning
2:20 - 2:50 | Hands-on Tech Tips for Becoming a TAO Power User
Christophe Noel | Lead Business Analyst | Open Assessment Technologies
Want to learn to how to become a TAO power user? This 30-minute power-user session packs in best practices and pro-tips for using the latest edition of the TAO platform. Get hands-on with TAO and follow along with our product experts as they walk through scenarios using various features and tools.
Sergei Mikhailov | Engineering Manager | Open Assessment Technologies
In the era of digital assessments, ensuring consistent and reliable access to testing environments is crucial, especially for global programs like the Programme for International Student Assessment (PISA). This presentation explores the development of an offline assessment delivery solution tailored to the unique needs of PISA, addressing the technical challenges associated with delivering assessments in diverse and sometimes connectivity-limited environments.
Through this presentation, attendees will gain insights into the challenges faced during the development process, the solutions implemented to overcome these hurdles, and the broader implications for future assessment delivery in varying technological landscapes.
3:30 - 4:00 | Campaign Dress Rehearsal: A Practical Approach to Preparing a High-Stakes Assessment Launch
Gheorghe Dobrogeanu | Program Manager | Open Assessment Technologies
Launching a high-stakes, large-scale assessment campaign requires meticulous planning, thorough preparation, and the ability to handle unexpected challenges. This session addresses some common challenges faced during the preparation phase, including logistical issues, technological hurdles, and coordination among various stakeholders. Attendees will learn what to be aware of to ensure a smooth assessment launch, from potential pitfalls to critical checkpoints that must not be overlooked.
4:00 - 4:20 | Navigating Success: Insights from International Large-Scale High-Stakes Testing Campaigns Hans-Otto Sterling | Director of Global Assessment Solutions | Open Assessment Technologies
This session will provide an overview of selected international assessment campaigns, delving into the key insights gleaned from these large-scale testing initiatives. We will explore the technological advancements and the role of Artificial Intelligence, particularly Generative AI (GAI), in enhancing the effectiveness and efficiency of these campaigns. Attendees will gain a deeper understanding of how cutting-edge technology and data-driven strategies can drive success in high-stakes testing environments.