Conference Programme 

The 2022 International e-Assessment Conference opening remarks by eAA Chief Executive, Matt Wingfield

This keynote will review how the assessment world has changed since we have weathered a pandemic and seen seismic shocks to the delivery of exams. How can e-assessment really help deliver resilience for the education sector and what are the key challenges we need to address to ensure fair delivery and access for all?

• Planning learning experiences around authentic contexts
• Assessing the process and product of learning
• Providing opportunities for children with different interests and assessing different abilities

Speakers:
Adarsh M S, Vice President, Growth & Strategy, Excelsoft Technologies
Ajay Kulkarni, Head, Business Development, Excelsoft Technologies
Mathew K G, Principal, Excel Public School
Chitra M Uthaya, Head of Assessments and Learning Events, Excelsoft Technologies

This session is a panel with Year 8 and 9 students from Ark Academies Trust discussing their experiences with their teachers. Key takeaways for delegates co-created with the students will be:
• Assessments must reflect the curriculum taught
• Well designed formative assessments support students in understanding what the important learning points are and give them the opportunity to reflect on the learning they have done do far
• Outcomes of assessments must be used to close gaps in learning
• When students understand their strengths and weaknesses they can work together to improve their own learning
• Students’ outcomes on assessments can impact on motivation and engagement with learning
• Students find online assessment engaging and it can better reflect the ways of working todays society
• We need system change to enable schools to really embed online assessment as a viable option

Speakers:
Amie Barr, Head of Assessment, Ark
Connor McElwaine, Vice Principal, Ark Pioneer Academy

This session will outline the work that Qualifications Wales has done to achieve innovative digital assessments within new national qualifications. It will then move on to describe its approach to ensuring that qualification assessments in the future will make the best use of digital technologies and enhance learner engagement.

Speaker: Dean Seabrook, Senior Qualifications Manager, Qualifications Wales

Virtual Reality has now reached consumer acceptance levels whereby it can be deemed here to stay. As it makes the transition from a games-based market into business and education, Virtual Reality is already being deployed in learning and training settings. The next logical step is exploring how Virtual Reality simulations can be used to provide assessment and feedback for learners, both formatively and summatively. This interactive session is designed with audience participation and engagement in mind. Attendees will be actively encouraged to add their voices to the debate around how we, as assessment professionals, ensure that the use of this new technology remains grounded in the core principles of test validity, reliability, authenticity and accessibility. Participants will also get the opportunity to enter a Virtual Reality simulated environment to experience the learner perspective and help inform the conversation.

Speakers:
Jeremy Carter, CEO, Sentira
Dr Tony Payton, Senior Lecturer in Healthcare Sciences, University of Manchester

In this session, we will discuss the practical implementation of AI in e-assessment platforms. AI offers a lot of possibilities, but a well-functioning algorithm is not automatically usable for end users in day-to-day tasks. The key takeaways of this session include:
• The amount and quality of available data defines the accuracy of your algorithm
• Fewer data can still result in very specific and narrow implementations of AI
• Human post-editing of the results of AI-powered content creation significantly increases the quality of the results.
• Technology companies can make a difference not only with algorithms, but even more so with a strong focus on usability, keeping the technicality away from the user.

Speakers:
Professor Thomas Demeester, Assistant Professor, IDLab, Ghent University
Filip Vanlerberghe, Product Manager, Televic Education

Virtual reality training is proving to be an effective means of delivering this kind of education, but it raises some new and interesting challenges from the perspective of assessment. In this presentation we will be looking at how rapidly VR education is being taken up across industries, the numerous different ways in which it can be delivered, and some of the current ways in which e-assessment is being undertaken in these virtual environments. It looks to not only show what is being done currently, but to open up questions and answers from the audience as to how this could be done better in future.

Speaker: David Sime, Chief Technology Officer and Co Director, Riiot Digital

The use of remote proctoring has been around for the last 10 years or so and had been making an impact on the traditional test-centre model. With the onset of the pandemic, some organisations were able to respond quickly, or accelerate their plans, and implement remote proctoring, although many organisations were not able to implement a solution. The e-Assessment Association decided to try undertake a simple piece of research that would provide some insight into the UK market and how remote proctoring is being used; the decision-making process for organisations that have, or are thinking about implementing; plus, the typical costs. This presentation will illustrate the results of the survey giving a picture of the adoption of remote proctoring as it now stands.

Speaker:
Patrick Coates, Director, International Skills UK, Chief Revenue Officer, Certiverse, Board Member, e-Assessment Association

There is now a move to a post-pandemic view on training and education and to examine what changes should persist after the pandemic? Remote invigilation has had its challenges and this panel session will examine:
• What expectations were for remote invigilation and they matched up to reality
• How we adapted to remote invigilation
• What the future is for remote invigilation now we know what we know?
• Maintaining integrity in e-assessment
• The problem of finding a single solution for multiple remote proctoring scenarios

Moderator:
Romana Moss, Director of Education, Royal College of Emergency Medicine, Board Member, e-Assessment Association

Panellists:
Patrick Craven, Director of Policy & Strategic Partnerships, City and Guilds
Jarret Dyer, Test Center Administrator, College of DuPage
Eunice McAllister, Account Director, PSI Services
Paul Muir, Head of Technology Enabled Assessment, British Council, Board Member, e-Assessment Association

As online learning and assessments have quickly emerged with new technologies, re-shaping the assessment industry as a whole, it’s no surprise this catalyst has also brought immense opportunity for growth. Previously, much of a candidate’s exam experience was fueled by a one-size-fits-all approach, leading to greater stress among test-takers who were forced to adapt. Today’s accelerated digital transformation presents a prime opportunity for certification and testing sponsors to evaluate the entire test-taker journey, starting at the foundation: the design of the candidate experience.
In this session, learn how we can work together to change the narrative from a one-size-fits-all approach to a candidate-centric and personalised experience, defined through the UX/UI lens. Join us as we discuss:
• An overview of the candidate experience: then, now, and what’s to come in the future
• How to design for a modern, personalized approach, across the entire test-taker journey
• Examples of innovative UX/UI enhancements driving future growth

Speakers:
Richard London, Senior User Experience, Prometric
Manuel Salgado, Head of Training, OutSystems

The presenter will discuss the innovative methods (that use existing technology) implemented over the last two years that allowed for the continuous development of assessments during a time in which experts could not gather in person. Both synchronous and asynchronous processes can be implemented to allow the definition of constructs to be measured, content and material development, and the standard setting phases of validity. Over time, the methods were tailored to maximise efficiency, ease, and to maintain psychometric best practices. Further, these remote development methods indicate a more streamlined, efficient, and user-friendly development journey even as the world is opening up again. A testing platform with item-writing and standard-setting tools will be utilised during the session. Examples from real-world assessments will be presented, as well as several practice exercises during which the audience can experience the virtual test development environment. Discussion following the exercise(s) will demonstrate these new, remote work flows in and of itself.

Speaker: Dr Amanda Dainis, CEO and Lead Psychometrician, Dainis and Company

This presentation will share lessons learned from the implementation of a dedicated digital exam platform and use of Bring Your Own Device, including the support and provision required, and solutions to challenges faced in the context of the pandemic.

Speaker: Dr Rebecca Gill, Learning Enhancement and Technology Adviser, Learning and Teaching Development Service, Academic Services, Newcastle University

For many, the pandemic answered the question should we move toward a digital assessment programme?, but not are we ready for change? The Fry team is delighted to share their experience of implementing a change management framework that lays the foundations for continuous success. Using their eAA award-nominated project with the Royal College of Physicians and Surgeons of Canada (RCPSC) as an example, they'll provide an overview of the methodology used to transform and future-proof the RCPSC assessment programme.

Speakers:
Jon Dupre, Operations Director, North America, Fry-IT
Tim Jones, Head of Service Delivery, Fry-IT
Andre St-Pierre, Associate Director of Assessment Operations, Office of Specialty Education, Royal College of Physicians and Surgeons of Canada (RCPSC)

The audience will get a better understanding of what it takes to successfully implement a centralised digital exam platform, delivering more than 1 million tests a year. There will be opportunities to ask questions of our implementation experts.

Speakers:
Dr Wimpie Beeken, Senior Project Manager, University of Pretoria
Vegard Sivertsen, CEO, Cirrus Assessment
Detken Scheepers, Head of e-Learning, University of Pretoria

Steve will be talking about how the system works and sharing examples of the value and benefits to schools and education providers with reference to primary, secondary and HE establishments. There will also be an opportunity to use the technology in the live interactive session. Key takeaways for delegate will be:
• How the system works
• The value and benefits to schools/establishments
• How using ACJ can reduce teacher workload while improving teaching practice

Speaker: Steve Dew, Headteacher, Church Cowley St James Primary School, Oxford

What is Automated Essay Marking?
• History of research into AI in essay marking in Australia
• How Western Australia is using Automated Essay Marking to improve human marking (not eliminate human markers
• Benefits derived from this approach – both expected an unexpected
• Challenges encountered and how we are working through these

Speakers:
Melanie Atkin, CEO, New Data Solutions
Tracey Gralton, Principal Literacy Consultant, Western Australian School Curriculum and Standards Authority

In this presentation, discover how a project team worked with awarding organisations City & Guilds and NCFE to understand their requirements and deliver reformed functional skills assessments and question types, in line with the 2019 Ofqual reforms. Through an innovative approach, awarding bodies, usability experts and developers at BTL Surpass worked collaboratively, to reform the tests and also produce new item-level developments, new question types and options to use multiple tools while being tested.

Speakers:
Glenn Hall, Lead Assessment Production Officer, NCFE
Gareth Hopkins, Assessment Solutions Specialist, BTL, Board Member, e-Assessment Association

E-assessment presents challenges and possibility for advancement in e-assessment – the use of technology raises comparability and ethics issues. Assessment at home raises authenticity, security and access to technology, privacy – this presentation will look in-depth at how to tackle these issues and take advantage of e-assessment opportunities.

Speaker: Isabel Nisbet, Author, Is Assessment Fair? University of Cambridge

This presentation will illustrate how an award-winning platform for wider maths learning was adapted to assess complex maths. It will show how maths support can be set up, how questions of various types are created, and present a current Calculus exam. The talk will illustrate how the system engages the students and how transparency, practice, feedback and moderation can be delivered. Mis-typed or partial solutions can be addressed after the exam and grades adjusted as required. Examples of how the students are engaged as partners in learning or co-designers in developing novel resources will be provided.

Speaker: Dr Ovidiu Bagdasar, Associate Professor of Mathematics, University of Derby

Australia has embarked on an ambitious project to provide teachers with easy access to innovative assessment solutions, and to tools to help them analyse their data and resources to support effective teaching. It’s an exciting initiative. It has the potential to provide teachers with the tools, flexibility and professional learning they need to plan teaching that works best for the students in their classrooms, and to help students better understand their own learning and what they need to learn next. But an initiative like this could have far reaching repercussions (both positive and negative) for companies already selling assessment products in the Australian. In this presentation, Dr Sandy Heldsinger will explain the drivers for this initiative, describe the Australian Education Ministers’ vision for supporting schools and share how the Brightpath formative assessment of writing aligns with this work.

Speaker: Dr Sandy Heldsinger, Managing Director, Brightpath

Despite maturation in the field of eportfolio practice, there is still a perception that portfolio items are generally either for unassessed purposes or comprise a final capstone or summative assessment. However, thoughtful and embedded portfolio practice can open up a wide range of opportunities for ongoing and formative assessment for and as learning, in addition to summative and assessment of learning. In this session we’ll look at how eportfolios can support:
• Structuring and scaffolding feedback and assessment processes
• Developing student feedback-and-assessment literacy
• Enabling students to act as co-creators and active agents in their own assessment
• Formative and dialogic feedback from different stakeholders – including peers and workplace / industry partners
• Feedback and assessment that is iterative, ipsative and dialogic
The session will include an example of practice and the opportunity to see the application of some of these principles in action.

Speaker: Paul Duvall, Learning Consultant, Manager of Customer Services for UK&I, Pebblepad

Lexplore provides schools and organisations with the latest in both AI and eye-tracking technology, to get a clear view of a student’s reading ability and help them improve. The key take away points for delegates from this session will be:
• Learn how to assess a student’s reading ability in just 3-5 minutes, using eye tracking technology. As no marking is required by Examiners, more time can be spent on analysis and interventions
• Learn how to access and analyse reading assessment results
• Learn the basics of how to work systematically with reading development

Speakers:
Lucy Armitage, Head of Customer Engagement UK, Lexplore
Aimee Cave, Assistant Headteacher, Pocklington Community Junior School, part of the Wolds Learning Partnership
Rune Vindenes, Sales Director, Lexplore

Designing valid assessments is no trivial task. Designing valid assessments that are inclusive and accessible to the widest range of users is even more challenging, but the process of designing for inclusion can be a stimulus for improved practices that benefit all examinees. This session will:
• Provide an overview of accessibility considerations at platform level, identifying some of the commonest accessibility barriers in online platforms
• Provide a hands on experience to the range of ways disabled candidates might interact with digital exam content
• Explore potential barriers in relation to question design and how small changes can make a big difference
• Map the potential accessibility issues – and opportunities - along the spectrum from digitised exam papers to ``born digital`` exams to emerging assessment technologies like virtual reality
• Consider the issues for awarding bodies in relation to:
- Providing accessibility statements for their products
- Ensuring accessibility awareness is embedded across a range of roles from external verifiers to markers, interface design to question setting.

Speaker: Alistair McNaught, Director, McNaught Consultancy

To produce fully accessible exam content, it’s vital that we learn to recognise more diverse disabilities to ensure we have the proper procedures in place for developing content accordingly. However, this often presents many challenges when determining how to properly develop new content.

This session will utilise examples and trends to analyse critical steps the industry can leverage to establish a comprehensive content review and approval process, as well as steps organisations can leverage to accommodate candidates, ensuring equal access to assessment services across all modalities. Speakers will discuss:
• This anticipated growth of disabilities and the impact on the assessment industry.
• Challenges many organisations face when developing exams fully accessible to assistive technologies.
• How Prometric works in partnership with testing organisations to ensure that test-takers with unique needs have full access to the programmes and services available

Speakers:
Richard London, Senior User Experience, Prometric
Marc Van Hasselt, Vice President, Customer Experience, Prometric