July, 2019
5 days
Russia, Sochi
Summer School
«Applied Psychometrics in Education and Psychology»
The Summer School will provide in-depth field insights and equip the students with advanced skills enabling more objective measurements and assessments in education and psychology. Ample opportunities for professional and academic networking will be a valuable fringe benefit.
Already done:
Since its inception in 2014, IOE's International Summer Schools in Psychometrics have covered a range of specialist topics and areas, such as Evidence Centered Design (Mark Zelman, World Bank consultant); Standards of Test Quality (Bas Hemker, CITO); Performance-based Assessment (Carol Myford, University of Chicago); and Differential Item Functioning Analysis (Thierry Rocher, French Ministry of Education).
Interesting for:
Researchers in social sciences
• New ideas for research
• Up-to-date methods for your research project
• Useful skills for conducting your research
Employees of testing organizations
• Knowledge about latter-day solutions
• Development of new skills
• Discussions with colleagues from different countries
Students in psychometrics
• Get advanced level in psychometrics
• Consult with famous psychometricians
• Get useful contacts for your future career
Test developers
• Learn modern test development techniques
• Practice innovative type development
• Get more experience working with experts
Themes of 2018:
Standard Setting Course (Dr. Mary Pitoniak)
Designed to provide participants with information about a wide range of considerations relevant to setting standards on educational assessments. These include how to choose a standard setting method, which methods are currently being used, and how to know if the cut scores set for an assessment yield valid interpretations within the context of a particular testing program. The fundamentals of standard setting will be presented, including the steps required in all methods. Vertically moderated standards and adjusting committee-recommended cut scores will also be discussed. The course will give a thorough consideration to the validity of standard setting procedures and the resulting cut scores.
Fairness in Educational Testing Course (Dr. Linda Cook)
Dedicated to test fairness, a topic of central importance to test developers, test takers, and those who have been using test scores for many decades. The vision of fair assessment has evolved over time and has psychometric, societal, and legal foundations. With the conceptual framework for a fairness discussion developed, the course will focus on key practical implications of this framework. Fairness in test design and development, as well as test administration will be discussed. The comparison of scores across different tests, modes of administration, grade levels, and across different languages and different populations will be considered.
The Course 'Analyzing Rating Data Using Many-Facet Rasch Measurement and Multilevel Rater Modelling Approaches' by Dr. Carol Myford and Dr. Lidia Dobria
Designed to introduce participants to two approaches to analyzing rating data: a many-facet Rasch measurement (MFRM) approach, and a multilevel rater model (MRM) approach. In performance assessment settings, raters who evaluate students' performances or products may introduce errors (rater effects) into the assessment process. The approaches discussed in the course help assessment administrators learn how various 'facets' (e.g., students, raters, rating criteria) of their assessment systems are performing. This discussion can be helpful in determining to what extent their systems are under statistical control and introducing meaningful changes to improve their systems. The course will include two parts. The first part will focus on how to use a many-facet Rasch measurement (MFRM) approach to analyzing the rating data, while the second part will feature a multilevel rater model (MRM) approach to analyzing the rating data.
Summer School 2018 lectors
Build community
Psychometrics is young and ambitious science. And it have to be grown.
Psychometrics is crucial for equity and fairness in education, recruitment, and psychology. But many psychometrical procedures are expensive, time-consuming and not obvious for people outside of our field. Everyone will benefit if more people learn about our profession, standards, and values. You cannot do much alone. But as a community we can share our experience and find new ways to explain the importance of what we do. We believe that public interest to psychometrics will raise the standards of assessment.
Track 1
Fairness: Test Design and Development
09:00–11:00
Linda Cook
One day at our School 2018
Tuesday, July 31
Experiential graphic design
11:30–13:00
Linda Cook
Track 1
Fairness: Test Administration
Experiential graphic design
14:00–16:00
Mary Pitoniak
Experiential graphic design
16:30–18:00
Mary Pitoniak
Track 1
Standard Setting: Selecting and Training Panelists
Track 1
Standard Setting: Currently-Used Methods
Track 1
Fairness: Test Design and Development
09:00–11:00
Carol Myford
Experiential graphic design
11:30–13:00
Carol Myford
Track 2
MFRM Anchoring Procedures Building a Specification File
Experiential graphic design
14:00–16:00
Carol Myford
Experiential graphic design
16:30–18:00
Lidia Dobria
Track 2
The Partial Credit Form
of the MFRM Approach Rating Scale Optimization
Track 2
Foundations of Bias Interaction Analyses and Hybrid Models
Track 2
Making Sense of Output from MFRM Analyses
Full agenda can be found here
Reviews of school participants
What we learned during summer school, in Track 1, that is standard setting and fairness helps to better evaluate our testing programs. And for me, who, let's say, knows well what we are doing, it helps to take a step back and look what we are doing in terms of fairness because it's a new term to understand.
Vali Huseyn
State Examination Center of the Republic of Azerbaijan
This summer school was wonderful experience for me and I learned many things that would help me in my research. These elements will become a part of our discussion in my research, back in Cyprus.
Tryfonas Papadamou
University of Cyprus
That is a very good summer school you should really come to! It is my first time in Russia, and the setting, the city, people here very friendly. There's a lot of things to do so you don't have to worry about that but in terms of actual summer school itself I learned so much because I come from a developing country where many of these global concepts that are happening in the developed countries are not happening in my country.
Nangamso Mtsatse
Stellenbosch University
Next Summer School possible locations
July, 2019
Russia, Sochi or Kaliningrad
I want to recieve information about next Summer school!
July, 2019
Your email
We promise to use your email only for communication about summer school.
CONTACT US:
monitoring.centre@hse.ru
All photo and video materials belong to their owners and are used for demonstration purposes only. Please do not use them in commercial projects.
Made on
Tilda