HIVK03043U Cph., System Evaluation and User Studier, Constituent elective module A
Informationsvidenskab og kulturformidling, STO 2013
Informationsvidenskab og kulturformidling, STO 2016
The module includes advanced studies of the theoretical and methodological aspects concerning evaluation of interactive information systems in context, the emphasis being on the correlation between information needs, situation and relevance as well as search behaviour seen in the light of dissemination processes and associated technologies. Taking its starting point in the research literature, the module introduces models for information behaviour and information interaction in order to identify approaches to evaluation of system performance and usability, and explicitly to discuss methods for evaluation of interactive information retrieval systems.
The module consists of the following three sub-courses and a project seminar:
Information behaviour
- Basic information behaviour models and interactive information retrieval research approaches
- Types of information needs, including work task related information needs
- The concept of relevance
Data collection and analysis
- Research focus: behavioural studies vs. performance tests
- Research design – test variables
- Data collection methods: qualitative methods and statistical methods of analysis
Evaluation of interaction design
- System centric evaluation; Cranfield-TREC-INEX; Performance measures
- User centric evaluation; usability evaluation and analysis
- Validation of test results
Competence objectives for the module
The objective of the module is to provide the student with:
Knowledge and understanding of:
- Different types of evaluation and evaluation approaches with relevance for information retrieval and evaluation of search systems performance
- Central concepts and models for information behaviour and search/retrieval and the related processes and functions, as well as methods for studying the same.
Skills in:
- Reflecting on central models and methods for the study of information behaviour and search/retrieval as well as the associated processes and functions.
- Assessing suitable methods, and a combination of these, for the study/evaluation os systems performance and information behaviour - including evaluation of interactive information retrieval systems
- Identifying and comparing central evaluation concepts and methods for system evaluation and user studies, and to assess and validate evaluation results in relation to given circumstances.
Competences in:
- Preparing/designing studies and tests for the study/evaluation of systems performance and information behaviour – including evaluation of interactive information retrieval systems.
- Conducting various types of system evaluation and user studies.
Academic objectives:
The examinee is able to
- Give an account of different types of evaluation and evaluation approaches as well as key concepts and models of information behavior and searching / retrieval and related processes and functions as well as methods for the study of the same
- Assess suitable methods, and combinations of these, for studies/evaluation of system performance and information behaviour.
- Conduct various types of system evaluation and user studies independently.
Sample literature:
- Ingwersen, P. & Järvelin, K. (2005). The Turn: Integration of Information Seeking and Retrieval in Context. Berlin/Heidelberg : Springer. 448 s.
- Kelly, D. (2009). Methods for Evaluating Interactive Information Retrieval Systems with Users. Foundations and Trends in Information Retrieval, 3(1-2), 1-224.
- Lazar, Feng & Hochheiser (2010): Research Methods in Human-Computer Interaction. Chichester, Wiley, 426 s.
- Saracevic, T. (2009). Information Science. In: Bates, M.J. & Maack, M.N. (eds.). Encyclopedia of Library and Information Science. New York : Taylor & Francis. 2570-2586.
- Category
- Hours
- Class Instruction
- 45
- Exam
- 120
- Exam Preparation
- 245,8
- Total
- 410,8
- Credit
- 15 ECTS
- Type of assessment
- Written assignmentThis sample form applies to students who are enrolled under STO 2013
Exam language: Danish or English
Extent: 20 standard pages. Extent for group exams: See Academic Regulations for the Masters program in Information Science and Cultural Communications - Aid
- All aids allowed
- Marking scale
- 7-point grading scale
- Censorship form
- No external censorship
- Exam period
Summer exam 2017
- Re-exam
Re-examination form is the same as for the ordinary examination in August 2017
- Credit
- 15 ECTS
- Type of assessment
- Oral examination, 30 minThis sample form applies to students who are enrolled under STO 2016
Exam language: Danish or English
Extent: 10-15 standard pages. Extent for group exams: See Academic Regulations for the Masters program in Information Science and Cultural Communications - Aid
- All aids allowed
- Marking scale
- 7-point grading scale
- Censorship form
- External censorship
Course information
- Language
- English
- Course code
- HIVK03043U
- Credit
- 15 ECTS
- Level
- Full Degree Master
- Duration
- 1 semester
- Placement
- Spring
- Schedule
- Teaching takes place in Copenhagen
- Course capacity
- 35 participants
- Continuing and further education
- Study board
- Royal School of Library and Information Science
Contracting department
- Royal School of Library and Information Science
Course responsibles
- Haakon Lund (2-6d71456d7a7233707a336970)
- Pia Borlund (11-756e6633677477717a7369456d7a7233707a336970)