Best Formative Assessment Project Award

The Future of Jobs Report 2023 indicates that by 2027, 43% of work tasks will be automated as a result of innovation, and it is therefore predicted that skills such as critical thinking and evaluation, ethical decision-making, and basic AI literacy are going to be highly needed across most job roles.


Generative AI has advanced rapidly in recent years, raising ethical concerns about risks ranging from security breaches to discrimination. By learning to make ethical decisions, organisations can protect their reputation, their customers and the public from the dangers, and they need expert support to do this. To help companies and tech professionals get their approach right, we recently created our own Foundation Certificate in the Ethical Build of AI.


In collaboration with our supplier, Tintisha Technologies, as well specialist subject matter groups and internal and external stakeholders, we have devised an AI-powered assessment solution that is safe, effective, and easily adaptable to other projects.


As part of the new Lord Mayor of London’s (Michael Mainelli) Ethical AI Initiative, the course teaches professionals how to manage the risks of designing and building AI-powered systems by applying a clear set of ethical principles.


By completing the course learners are able to:


1. Gain a practical understanding of how to apply ethical thinking, principles and frameworks when developing AI applications in their own contexts.
2. Study the course in their own time online and attain a BCS professional certification.
3. Sit a final online exam, similar to many of our professional certification exams, supported by shorter formative assessment tasks within the learning.


The course is designed to encourage learners to apply their ethical thinking to given situations as they are learning, in their own time. As such, we identified an opportunity to incorporate the use of AI to evaluate learners’ responses within formative assessment activities and provide detailed, individualised feedback.


Within our solution we have incorporated the means for learners to be able to comment on the usefulness of the feedback provided to them by the AI and rate it out of five. This allows learners to develop their ability to evaluate generative AI output, which is essential to using it ethically. It also allows BCS to monitor and evaluate the performance of the AI through the quantitative and qualitative data generated by the user comments and ratings so to evaluate the user experience, the effectiveness of the tool, and how we can improve its use as a learning and assessment tool.


Many of our customers are education and training providers, and we’re eager to share our experiences to support further thinking and best practice in implementing this sort of AI use.

Finalists:

Buckinghamshire New University with e-Formative Peer Assessment (eFPA) of oral presentations

Students believe assessment and feedback are the teacher’s sole responsibility; however, research shows that PA “contributes to the development of student learning and promotes ownership of assessment processes” (Bryant and Carless, 2010:3). To promote shared responsibility, the eFPA of oral presentations was included in the 2023-24 Blended Postgraduate Certificate in Practice Education (PgCPE) programme for the student practice educators (SPEs) to articulate aspects of their practice as educators in a professional multi-disciplinary environment. The 15-minute oral presentation of how they planned, implemented and reviewed an assessment for their own learners, considering the need to support learners' engagement with the process to promote inclusivity and social justice within the assessment and the wider learning environment happened in ClassCollaborate, the institution's web conferencing platform in the VLE for synchronous communication while asynchronous discussions were in the Discussion Board promoting self-regulatory skills; this also takes into account the SPEs' situational, institutional and dispositional barriers to learning. As the design and delivery of the eFPA, marking, reporting, storing the recorded presentations enabling evaluation from different perspectives (SPEs, Course team, internal/external moderators), this initiative is considered e-assessment (Joint Information Systems JISC, 2007). 36 SPEs, a mature group with diverse backgrounds and work experiences in the health care sector participated in the initiative from January to February 2024. For efficiency, nine virtual Presentation Rooms were created in ClassCollaborate with three/four students each enrolled as moderators to enable them to autonomously manage the assessment and feedback processes in a safe, secure space. For three weeks, the SPEs received guided, hands-on experience of using the tools in the virtual presentation rooms learning to upload slides and recording Mock presentations. In addition, training on how to use the rubric contributed to the SPEs understanding of how the course team would assess their oral presentations. Examples of constructive feedback and evaluative judgements were provided to mirror the course team's feedback practice. Review of recorded mock presentations as well as the course team's weekly observations of the SPEs' engagement with the eFPA and feedback processes was iterative throughout the period enabling timely changes and improvements to the process. The interim findings suggest that the eFPA empowered the SPEs to take over their own learning process and to become a resource for their peers; commenting on others' work appeared to improve their understanding of assessment criteria with a focus on success, helping them to become more engaged in learning and developing their interpersonal skills and their attitude to assessment and feedback as a shared responsibility. For the course team, eFPA can potentially reduce their assessment and feedback workload.

Join our membership

Shape the future of digital assessment

Join the global community advancing e-assessment through innovation, research, and collaboration.

user full
5,000+
Global members
globe point
50+
Countries
cog icon
15+
Years leading

Keep informed

Subscribe to our newsletter

This site uses cookies to monitor site performance and provide a mode responsive and personalised experience. You must agree to our use of certain cookies. For more information on how we use and manage cookies, please read our Privacy Policy.