Evaluation, Academic Research Reports, Data
Analysis and Publications including Case Studies

students-99506_1920.jpg

The output of this activity will be a set of reports, documents, data analysis to provide guidance and support for methodology improvement & future deployment based on pilot & evaluation outcomes. A case study report documenting the project's key findings will also be produced. In addition DCU and APS will collaborate on the production of 2-3 academic articles for publication in peer-reviewed journals, national/international scientific conferences (such as IADIS, Ed-Media, E-Society the CESI national ICT Conference etc.) or an academic book chapter.
The key activities leading to this output include; Pilot Planning, Pre-pilot in school testing, Full School Pilots, Pilot Data Analysis and Pilot Reporting & Evaluation
A full pilot test will be carried out during the 2021 to 2022 school year starting September 2021 in all 6 countries with the complete question sets in all subjects and all 5 languages of the project. 1000 students will participate, with additional schools identified to participate through the multiplier events.
Prior to the full pilot test an initial pilot phase will run from January to May 2021 to get a first set of feedback on the methodology and the content. Based on this first pilot course-correction will be done and user training adapted prior to holding the multiplier events.
The Study Quest database is a key element of the project. Anonymised data will be collected to allow for aggregated analysis of student and question set data.
The following will be analysed and reported:
1. Effective and ineffective questions and question setting approaches.
2. Analysis of groupings of students for differing performance in accuracy of answering, pace of completion or other common attributes.
3. Country to country and curriculum to curriculum differences will be analysed.
4. Data mining will look for other unexpected themes or trends.
A full evaluation report will be completed an made public outlining the effectiveness and results with the methods and the key project learnings to make assessment for learning a broadly available teaching and learning approach throughout Europe..
Expected impact: A broad pilot with 1000 students across 6 countries and 5 languages will provide extensive experience and feedback on the benefits of digital assessment for learning in European classrooms. By assessing both science and modern foreign language the suitability of the approach across a wide range of subjects may be proposed as part of the evaluation. Content rich subjects such as Geography, Business Studies, Economics and History should also suit this approach very well.
The analysis of the extensive data collected in the database which is built into the software will allow the analysis of patterns of effective adn ineffective question setting approaches adn the analysis of different student behaviours. This data can be used to design approaches to personalize the question setting flow and the use of more complex question networks to personalize the approach to achieve better results with different groups of students
Transferability potential: In addition to the open access software and question sets that the project will make available, the evaluation reports and analysis completed in this IO will provide a strong set of new knowledge on assessment for learning gin the context of European schools in many different situations. This evaluation and analysis will be published and made available on the project website.
This will provide a strong guide for the extension of the approach within the project countries and to other countries .Academic publications as outline above will ensure that the project's findings will be disseminated to a wider international audience.