Best International Implementation Award
ACER Maple's involvement in the Programme for International Student Assessment (PISA) 2025 represents a significant endeavour in global education evaluation. PISA is a large-scale international survey that is highly influential in shaping national and global educational policies and practices. PISA now covers over 90 countries, assessing a substantial cohort of more than 600,000 students every three years. At the core of this operation is ACER Maple, a progressive web application designed to streamline participant sampling, assessment allocation, and participant tracking. ACER Maple enhances the transparency and efficiency of sampling activities, which is crucial to ensuring the validity of PISA data and the comparability of its outcomes.
The redevelopment of ACER Maple was necessary due to the ever-increasing scope and size of PISA. This redevelopment included incorporating a configurable sampling algorithm to cater to the diverse educational systems and specific requirements of various clients. A key aspect of this development phase was integrating automation into critical processes, alongside an emphasis on user experience and efficient data processing. The project employed continuous integration and deployment methods, actively involving clients in the development process, and swiftly incorporating their feedback. This collaborative approach contributed to the refinement of the software and fostered strong client relationships, as indicated by positive feedback and the efficiency of training and data submission processes.
Managing the deployment of ACER Maple across different countries presented challenges, primarily due to the need for custom software configurations for each client's national options. To address this, the team implemented an intuitive survey configuration interface with multiple sub-menus for data handling and sophisticated sampling processes. The effectiveness of these solutions was reflected in the quicker data submission timelines and the positive feedback from clients.
The implementation of ACER Maple was characterised by clear success metrics, including the effectiveness of user training and the quality of data submissions. The automation of critical sampling processes significantly improved the validity and reliability of the data. Support services were robust, featuring webinars, manuals, and a 24/7 helpdesk, ensuring smooth adoption and high satisfaction levels among clients.
Recognising the diverse cultural and regional needs in the PISA programme, ACER Maple included extensive customisation features such as multilingual support and right-to-left text functionality. These features, along with streamlined operational processes, minimised non-technical barriers, and enhanced accessibility across different regions.
ACER Maple faced several technical challenges, including bandwidth limitations and data protection laws, necessitating flexible deployment options. The team addressed these challenges through a variety of installer options, ranging from fully offline solutions to cloud-based, encrypted systems. The global helpdesk played a crucial role in providing swift and effective issue resolution.
The scale and complexity of PISA 2025 are effectively managed by ACER Maple, which demonstrates its capability in handling large-scale, international educational assessments. This project stands out for its client-centred development approach, technical flexibility, and efficient management strategies, successfully navigating the challenges inherent in global educational evaluations. ACER Maple's processing of millions of student records, while adeptly handling intricate data requirements, sets a new benchmark in the field.
