This course is the first of its type in Spain and one of the few in existence in Europe. It seeks to cover the needs of professionals from different areas of testing with theoretical and practical sessions on test design and statistical validation.

This two-week 40-hour course will cover key issues in language test design and validation. The course will be held at the Universidad de Jaén (Spain) from June 16th to June 27th 2025.

uring the first week we will define and learn how to design the main parts of a test: construct, specifications, components (listening, reading, writing, speaking and interaction) through theoretical and practical sessions. Participants will have the opportunity of sharing their own work with colleagues from other institutions and major examining boards.

During the second week we will focus on the statistical analysis of aspects related to validity arguments. We will use both Classical Test Theory and Item-Response Theory to analyze facility values, discrimination indexes, internal reliability, bias, variable maps, etc. and we will see how analytic scales can be validated through Rasch models. No previous knowledge of statistics is necessary.

The course will be taught by experts in language test design with extensive experience: Brian North, co-author of the Common European Framework for Languages and the Companion Volume (1.5 hours); Adolfo Sánchez, expert on mediation at the Universidad de Granada (2 hours); Javier Fruns, Head of language assessment at the Instituto Cervantes (4 horas); David Bradshaw, Senior assessment Services and Recognition Manager for Cambridge University Press and Assessment (4 hours); Carmen Álvarez, Assessment coordinator at the Language Center of the Universidad Politécnica de Madrid (4 hours) and Joaquín M. Cruz, Deputy Director and Assessment Coordinator at the Center for Higher Studies in Modern Languages at the Universidad de Jaén (24.5 hours).

The course will be held in English but its theoretical and practical contents can be applied to test development and validation in any language other than English. Computers will be necessary for the second week. The Universidad de Jaén will provide participants with the necessary computers and pre-installed software, chiefly Word, Excel, SPSS, Winsteps and Facets. This course is considered as a Diploma de Postgrado (postgraduate course) worth 5 ECTS credits.

Content

This course will have 10 sessions. Most of these sessions will include 2 hours of theory and 2 hours of practical work with a 30-minute break. During the first week (16-20 June 2025) we will define and work on the main parts of a test. During the second week (23-27 June 2024) we will focus on statistical analysis using Classical Test Theory and Item-Response Theory. No previous knowledge of statistics is necessary. Participants do not have to work outside the lesson hours and they will receive a link with the materials for the course one week before its beginning. The content of both weeks is broken down as follows:

Week 1

• Introduction
• The CEFR CV, mediation and new challenges in language assessment
• Listening comprehension
• Reading comprehension
• Oral and written production

Week 2

• Introduction to statistical analysis and Classical Test Theory (I)
• Classical Test Theory (II)
• Item Response Theory (I, item analysis)
• Item Response Theory (II, rating scale analysis)
• Wrap-up and guided visit to the campus

During the first week there will be an optional afternoon session in which participants will have the opportunity of sharing the work that they carry out in their institutions. There will also be a gala dinner to be celebrated on Friday 20th at the main hall of the local Castle of Santa Catalina.

The last day of the course participants will be offered a guided visit to the main facilities of the campus, which includes a visit to our private art collection Cesáreo Aguilera, which currently has on display several pieces by Picasso and Tàpies among other modernist artists.

You can download a more detailed list of contents here.

Fees and Registration

The fee for the course is 250€ and it grants access to all necessary materials, including computers and software. Registration will remain open until May 16th 2025. There are only 15 available places in the course which will be allocated on a first-come-first-served basis.

To apply, you have to submit the following documents to [email protected].:

• Motivation letter
• Resume
• Letter of consent from immediate supervisor

Notice that your participation in the course will only be confirmed upon the payment of the fees.

Profile and opinion of participants

Participants must be over 18, have a university degree, an interest in language test development and validation and a minimum B2 CEFRL level in English.

Contact

• Interested students may contact o[email protected]
• Phone: 560-3201
• Attention in person at the International Relations Office from Monday to Friday from 8 am to 4 pm.
• Find us on social networks as @dri_utp