Oral examination

Description

The oral test is a method of assessing the candidate's spoken word. Here assessor and candidate enter into a spoken interaction. An oral test can take place as a presentation (see AMD Presentation), interrogation or application. The oral test generally does not assess linguistic competence as such, but rather knowledge, understanding and problem solving ability.

Quality Concepts

Validity

Oral tests could be valid for assessing e.g. understanding, applied problem solving, interpersonal competence, intrapersonal qualities (confidence, self-awareness, professionalism, ethics) and intergrated practice. Oral tests are valid if the candidate can demonstrate the competencies that are relevant to the validation process. It must therefore be checked whether the test queries what it should query (face validity). To check the content validity, it must be asked whether the discussed content is part of the required competencies, whether it goes beyond it or whether it is too barely discussed. In order to increase the construct validity of the oral test, the tasks must be in line with the theoretical understanding of the skills of event technology.

Reliability

Reliability can be affected by candidate anxiety, candidate hearing or speech difficulties or assessor bias (e.g. due to gender, ethnicity, language). In order to standardize the test and increase comparability, a criteria list and an answer key should be created. The fact that the assessor can ask questions can affect reliability. An answer that was only given on request should possibly get fewer points. In order to increase the reliability, a competence should be tested in different ways. The use of multiple assessors also increases reliability. Due to the limited number of questions and the many disruptive factors in the interaction, the oral test is less reliable.

Limitations

Since the time and question options are limited, only a limited amount of knowledge can be queried. Due to disturbing factors (excitement, stress, unusual situation) the method should be used in combination with other methods.

Considerations

Tips

The candidates should be informed in advance about the framework conditions of the oral test: e.g. time period, location, requirements and items that are not included. A criteria list helps the assessors to objectively assess the results of the oral test. The assessors should be aware that inquiries can give unwanted tips. Candidates should be given sufficient time to answer.

Traps

It should not be the presentation and speaking skills that are assessed, but rather the competencies that are queried as part of the assessment process. If the oral test is not recorded, the results can be objected afterwards.

Scoring Tools

The results of the oral test can usually be evaluated immediately afterwards. A marking guide can be used here, which also serves as a framework for feedback to the candidate. Since it can be difficult to take notes and interview the candidate at the same time, it makes sense to use several assessors. In this case, one can record the conversation while the other is conducting the conversation. Audio or video recording of the oral test is also highly recommended.

Implementation

Information for Standard

The created marking guide should be aligned with the competence descriptions of the UNITs. The tasks and questions of the oral test should be precisely formulated in advance and each candidate should be asked the same questions. The candidate's answers are compared with the expected answers from the marking guide. In addition, cues and support that the assessors can provide are defined in advance.

Development

The development process involves the creation of tasks and questions that are designed to assess the relevant competencies. Expected answers and possible cues are set out in a marking guide.

Needs/Set-Up

Depending on the task, a preparation room with writing materials for the candidate, an examination room and technical equipment that is part of the task is required. In addition to the questioning assessor, a minute taker is advisable.

Requirements for Assessors

The assessor needs basic skills in conducting unbiased dialogue. He needs professional skills in order to be able to deduce appropriate competencies from the candidate's report according to the marking guide. Professional and pedagogical competences are necessary to create the tasks.

Examples

An oral test can be used to test management skills. For example, the candidate should explain in a subtask how to check which materials and equipment are required for a given job.

In Combination with

Since the oral test does not test practical skills, a combination with corresponding methods like observation or role play is appropriate.

References/Notes

* Joughin, G. (2010): A short guide to oral assessment. Online: https://www.qub.ac.uk/directorates/AcademicStudentAffairs/CentreforEducationalDevelopment/FilestoreDONOTDELETE/Filetoupload,213702,en.pdf (last 21.07.2020). 
* Assessment Resource Centre (2014): Types of Assessment Methods. Online: https://ar.cetl.hku.hk/am_orals.htm (last 21.07.2020). 
* Iqbal, I. et al. (2010): The value of oral assessments: A review. Online: https://publishing.rcseng.ac.uk/doi/pdf/10.1308/147363510X511030 (last 21.07.2020). 
* Centre of Expertise for Higher Education / University of Antwerp (n.d.): Oral tests and objective assessment. Online: https://www.uantwerpen.be/en/centres/centre-expertise-higher-education/didactic-information/teaching-tips-english/assessing-students/oral-tests-objectivity/ (last 21.07.2020).