UBELT

==Test Description: University of Bath English Language Testing for Medical Professionals (UBELT) ==   

Test Purpose 

The purpose of the test is to:

 ·       assess the English level of non-native speaker candidates who are applying for professional positions within the medical field in the UK

 ·     distinguish between candidates whose level of English is good enough to communicate sufficiently well in the native speaker professional   context and those whose level is not

 ·          identify areas of weakness and allow recommendations to be made about the circumstances (if any) under which candidates should be re-considered in cases where the candidate’s language level is assessed to be below the required level.

<p class="MsoNormal" style="margin-left:21.0pt;text-align:justify;line-height: 150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">Broad test creation guidelines

<p class="MsoNormal" style="margin-left:39.0pt;text-align:justify;text-indent: -18.0pt;line-height:150%;mso-list:l8 level1 lfo1;tab-stops:list 39.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:Symbol;mso-fareast-font-family: Symbol;mso-bidi-font-family:Symbol"> ·      <span style="font-size:11.0pt;line-height:150%; font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">All tests are made with the following in mind: selected candidates will work in an English-speaking/ native speaker environment. Selected candidates will have to deal with the British public as well as with colleagues.

<p class="MsoNormal" style="margin-left:39.0pt;text-align:justify;text-indent: -18.0pt;line-height:150%;mso-list:l8 level1 lfo1;tab-stops:list 39.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:Symbol;mso-fareast-font-family: Symbol;mso-bidi-font-family:Symbol"> ·           <span style="font-size:11.0pt;line-height:150%; font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">The test is designed to identify candidates who are at upper intermediate and advanced levels, corresponding to levels B2 through C2 of the Common European Framework or levels 2.5 and above of UBELT.

<p class="MsoNormal" style="margin-left:39.0pt;text-align:justify;text-indent: -18.0pt;line-height:150%;mso-list:l8 level1 lfo1;tab-stops:list 39.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:Symbol;mso-fareast-font-family: Symbol;mso-bidi-font-family:Symbol"> ·           <span style="font-size:11.0pt;line-height:150%; font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">Different professions may choose to have different ‘pass’ levels, corresponding to the different needs of professionals in these areas

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height: 150%;font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">Test Takers 

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">Test takers have been identified in terms of the following:

<p class="MsoNormal" style="margin-left:45.0pt;text-align:justify;text-indent: -27.0pt;line-height:150%;mso-list:l2 level1 lfo4;tab-stops:list 45.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-fareast-font-family:Arial"> i. <span style="font-size:11.0pt;line-height:150%; font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">All have higher education qualifications.

<p class="MsoNormal" style="margin-left:45.0pt;text-align:justify;text-indent: -27.0pt;line-height:150%;mso-list:l2 level1 lfo4;tab-stops:list 45.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-fareast-font-family:Arial"> ii. <span style="font-size:11.0pt;line-height:150%; font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">All are over 20 years of age.

<p class="MsoNormal" style="margin-left:45.0pt;text-align:justify;text-indent: -27.0pt;line-height:150%;mso-list:l2 level1 lfo4;tab-stops:list 45.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-fareast-font-family:Arial"> iii. <span style="font-size:11.0pt;line-height:150%; font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">Some are final year students in a medical profession course (such courses include a component of work experience/ placement), or they may be very recent graduates; in both cases, their experience is not broad.

<p class="MsoNormal" style="margin-left:45.0pt;text-align:justify;text-indent: -27.0pt;line-height:150%;mso-list:l2 level1 lfo4;tab-stops:list 45.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-fareast-font-family:Arial"> iv. <span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">Most are medical professionals with work experience in their own country.

<p class="MsoNormal" style="margin-left:45.0pt;text-align:justify;text-indent: -27.0pt;line-height:150%;mso-list:l2 level1 lfo4;tab-stops:list 45.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-fareast-font-family:Arial"> v. <span style="font-size:11.0pt;line-height:150%; font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">All have a shared knowledge of certain areas, usual practical routines, and information common to their profession.

<p class="MsoNormal" style="margin-left:45.0pt;text-align:justify;text-indent: -27.0pt;line-height:150%;mso-list:l2 level1 lfo4;tab-stops:list 45.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-fareast-font-family:Arial"> vi. <span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">Some have not learned English language in a formal teaching environment.

<p class="MsoNormal" style="margin-left:45.0pt;text-align:justify;text-indent: -27.0pt;line-height:150%;mso-list:l2 level1 lfo4;tab-stops:list 45.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-fareast-font-family:Arial"> vii. <span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">Many are without explicit training in language test taking.

<p class="MsoNormal" style="margin-left:45.0pt;text-align:justify;text-indent: -27.0pt;line-height:150%;mso-list:l2 level1 lfo4;tab-stops:list 45.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-fareast-font-family:Arial"> viii. <span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">Many have no previous experience of language tests.

<p class="MsoNormal" style="margin-left:45.0pt;text-align:justify;text-indent: -27.0pt;line-height:150%;mso-list:l2 level1 lfo4;tab-stops:list 45.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-fareast-font-family:Arial"> ix. <span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">Many may well feel apprehensive or nervous in the test taking environment due to the high stakes involved.

<p class="MsoNormal" style="margin-left:45.0pt;text-align:justify;text-indent: -27.0pt;line-height:150%;mso-list:l2 level1 lfo4;tab-stops:list 45.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-fareast-font-family:Arial"> x. <span style="font-size:11.0pt;line-height:150%; font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">The vast majority who attempt UBELT are at an intermediate and above language level, corresponding to level B1 and higher of the Common European Framework.

<p class="MsoNormal" style="margin-left:45.0pt;text-align:justify;text-indent: -27.0pt;line-height:150%;mso-list:l2 level1 lfo4;tab-stops:list 45.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-fareast-font-family:Arial"> xi. <span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">Many have been pre-selected by third parties according to their English level and clinical knowledge

<p class="MsoNormal" style="margin-left:45.0pt;text-align:justify;text-indent: -27.0pt;line-height:150%;mso-list:l2 level1 lfo4;tab-stops:list 45.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-fareast-font-family:Arial"> xii. <span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">Most candidates are from European language groups; some are from non-European language backgrounds, but are living in a European country (thus, they may be able to communicate in 3 or more languages).

<p class="MsoNormal" style="margin-left:45.0pt;text-align:justify;text-indent: -27.0pt;line-height:150%;mso-list:l2 level1 lfo4;tab-stops:list 45.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-fareast-font-family:Arial"> xiii. <span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">Most are living in a country outside the UK, but some are already living and /or working in the UK.

<p class="MsoNormal" style="margin-left:45.0pt;text-align:justify;text-indent: -27.0pt;line-height:150%;mso-list:l2 level1 lfo4;tab-stops:list 45.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-fareast-font-family:Arial"> xiv. <span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">All want to live and work in the UK in their chosen profession.

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">Feedback of assessment results to test takers

<p class="MsoBodyTextIndent" style="margin-left:45.0pt;text-align:justify; text-indent:-27.0pt;mso-list:l0 level1 lfo6;tab-stops:list 45.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-fareast-font-family:Arial"> i. <span style="font-size:11.0pt;line-height:150%; font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">The certificate shows their overall UBELT score and includes language level descriptions for the UBELT score range.

<p class="MsoBodyTextIndent" style="margin-left:45.0pt;text-align:justify; text-indent:-27.0pt;mso-list:l0 level1 lfo6;tab-stops:list 45.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-fareast-font-family:Arial"> ii. <span style="font-size:11.0pt;line-height:150%; font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">Results are validated by e-mail request.

<p class="MsoBodyTextIndent" style="margin-left:45.0pt;text-align:justify; text-indent:-27.0pt;mso-list:l0 level1 lfo6;tab-stops:list 45.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-fareast-font-family:Arial"> iii. <span style="font-size:11.0pt;line-height:150%; font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">Comments and feedback are available on the test taker’s performance.

<p class="MsoBodyTextIndent" style="margin-left:45.0pt;text-align:justify; text-indent:-27.0pt;mso-list:l0 level1 lfo6;tab-stops:list 45.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-fareast-font-family:Arial"> iv. <span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">If test takers have not met their profession’s required score, they can contact the UBELT office to ask for advice on areas of weakness, how to improve, and how to apply for a re-sit. Such consultation is kept brief. UBELT does not offer any language or test preparation courses.

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height: 150%;font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">Test Users 

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">Test users have been identified as the test takers, recruitment agencies, health profession employers- in both the private and public sectors - and professional boards or governing bodies.

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">Feedback to the test users is via- <p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">
 * <span style="font-size:11.0pt;line-height:150%;     font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">direct contact between the examiner and the agency and/or employers in a feedback session at the end of the test day.
 * <span style="font-size:11.0pt;line-height:150%;     font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">general feedback to interested parties: e-mail and telephone conversations.
 * <span style="font-size:11.0pt;line-height:150%;     font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">annual reports are available to all interested parties, on request.
 * <span style="font-size:11.0pt;line-height:150%;     font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">validation studies are available to all interested parties, on request.

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">Feedback from the test users to UBELT is via- <p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">
 * <span style="font-size:11.0pt;line-height:150%;     font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">direct contact between the examiner and the agency and/or employers in a feedback session at the end of the test day.
 * <span style="font-size:11.0pt;line-height:150%;     font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">direct contact with the UBELT staff: face-to-face, e-mail and telephone.
 * <span style="font-size:11.0pt;line-height:150%;     font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">regular feedback surveys conducted by UBELT.   These contribute to UBELT’s on-going feedback loop, and specifically contribute to validity studies.

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height: 150%;font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">Target Language Use (TLU) 

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">The communicative context for candidates will be daily life and professional, consequently: <p class="MsoNormal" style="margin-left:35.7pt;text-align:justify;text-indent: -17.85pt;line-height:150%;mso-list:l1 level1 lfo2;tab-stops:list 36.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:Symbol;mso-fareast-font-family: Symbol;mso-bidi-font-family:Symbol"> ·           <span style="font-size:11.0pt;line-height:150%; font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">test tasks are related to the broader topics of the profession as they seek to minimise as much as possible any advantage that someone with a specialisation in the profession might have. <p class="MsoNormal" style="margin-left:18.0pt;text-align:justify;line-height: 150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">
 * <span style="font-size:11.0pt;line-height:150%;     font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">all test tasks, and content is based on professional requirements and daily life realities.
 * <span style="font-size:11.0pt;line-height:150%;     font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">test tasks require language knowledge and skills, as well as general professional topic knowledge.
 * <span style="font-size:11.0pt;line-height:150%;     font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">decisions as to what is required in real-life are based on consultation with employers, recruitment agencies, British professionals working in the same area, and foreign language professionals.
 * <span style="font-size:11.0pt;line-height:150%;     font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">detailed reports containing information from professional informants are kept and referred to regularly by test developers.
 * <span style="font-size:11.0pt;line-height:150%;     font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">test creators select from the suggested typical topics and tasks to create test tasks for each component.

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height: 150%;font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">Component Descriptions 

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">The test includes 4 components,   each relating to one of the four skills areas often used in language assessment. It is recognised, however, that each component includes to some extent the use other skills, and all require a level of general communicative competence.

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height: 150%;font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">Constructs and Validity of UBELT tests 

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">The purpose of the test is to assess overall communicative competence rather than to assess correct usage and knowledge about the English language, thus the constructs are broad rather than highly specific.

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">The test prioritises competent linguistic communication over strict notions of accuracy. While accuracy is an important factor in effective communication, UBELT is not an assessment of individual language items in isolation (e.g. discrete grammar questions); instead it focuses on the extent of the candidate’s ability to use English effectively and appropriately in the given context.

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">A continual feedback loop involving medical professionals, candidates and examiners is encouraged by UBELT, and forms an important part of its continued test development.

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height: 150%;font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">Content Validity 

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">UBELT’s content is related to the information, topics, and types of communication required for the profession in question. Since the real professional work situation will be in the U.K., the test is based on authentic native-speaker language, however, great care is taken to maintain an adequate level of standard language, style and content to prevent discriminate against those without specialist or area knowledge.

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">Thus, professional content is related to general information and issues, and performance assessment is related to language usage, communication skills and strategies instead of ‘clinically correct’ answers.

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">Content decisions are based on information from different sources. This process can be seen by taking the pharmacy test as an example.

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">Information collection from professional informants to determine appropriate content and contexts. <p class="MsoNormal" style="margin-left:36.0pt;text-align:justify;text-indent: -18.0pt;line-height:150%;mso-list:l6 level2 lfo5;tab-stops:list 36.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:Symbol;mso-fareast-font-family: Symbol;mso-bidi-font-family:Symbol"> ·           <span style="font-size:11.0pt;line-height:150%; font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">A pilot test was conducted with a small number of pharmacists from the University of Bath. Their feedback and test results were used to develop Version One of the test.
 * <span style="font-size:11.0pt;line-height:150%;     font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">This was done in conjunction with two experienced pharmacists, and recruiters.

<p class="MsoNormal" style="margin-left:36.0pt;text-align:justify;text-indent: -18.0pt;line-height:150%;mso-list:l6 level2 lfo5;tab-stops:list 36.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:Symbol;mso-fareast-font-family: Symbol;mso-bidi-font-family:Symbol"> ·           <span style="font-size:11.0pt;line-height:150%; font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">A small group of recruiters (all pharmacists themselves) took the formal written tests and their feedback was collected in person, on the phone and through questionnaires (November 2004 and January 2005). Their feedback was favourable.

<p class="MsoNormal" style="margin-left:36.0pt;text-align:justify;text-indent: -18.0pt;line-height:150%;mso-list:l6 level2 lfo5;tab-stops:list 36.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:Symbol;mso-fareast-font-family: Symbol;mso-bidi-font-family:Symbol"> ·           <span style="font-size:11.0pt;line-height:150%; font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">A discussion of the test needs and a review of the first version took place with <span lang="EN-US" style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Courier New";color:black;mso-ansi-language:EN-US">the Director of Studies, Advanced Programmes in Pharmaceutical Practice & Therapeutics <span style="font-size:11.0pt;line-height:150%;font-family: "Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">at the University of Bath. His opinion of the test was very favourable. His information and input was recorded and has fed directly into test development.

<p class="MsoNormal" style="margin-left:36.0pt;text-align:justify;text-indent: -18.0pt;line-height:150%;mso-list:l6 level2 lfo5;tab-stops:list 36.0pt left 48.0pt; mso-layout-grid-align:none;text-autospace:none"><span style="font-size:11.0pt;line-height:150%;font-family:Symbol;mso-fareast-font-family: Symbol;mso-bidi-font-family:Symbol"> ·           <span style="font-size:11.0pt;line-height:150%; font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">2 interviews were conducted with non-native speakers who work in Britain as pharmacists. Their information and input was recorded and has fed directly into test development. One of these also participated in a pilot reading of a new version reading test.

<p class="MsoNormal" style="margin-left:36.0pt;text-align:justify;text-indent: -18.0pt;line-height:150%;mso-list:l6 level2 lfo5;tab-stops:list 36.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:Symbol;mso-fareast-font-family: Symbol;mso-bidi-font-family:Symbol"> ·           <span style="font-size:11.0pt;line-height:150%; font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">Genre information and topic collection was done by a team of test developers via a survey of pharmacy websites, products and popular journals. Test developers continue to use these sources as guides for up-to-date topics and information.

<p class="MsoNormal" style="margin-left:18.0pt;text-align:justify;line-height: 150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">English language and communication information

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">This is the development team’s own area of expertise. They are assisted in this by an independent test development consultant with many years of experience in testing.

<p class="MsoHeader" style="text-align:justify;line-height:150%;tab-stops:36.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">

<p class="MsoHeader" style="text-align:justify;line-height:150%;tab-stops:36.0pt"><span style="font-size:11.0pt;line-height: 150%;font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">Authenticity and Face Validity 

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">Authenticity is an important consideration in communicative language testing. UBELT seeks to do this in a number of ways.

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">The actual processes and strategies candidates are required to employ to perform in the test are “authentic” in that they simulate as much as possible typical communication in normal professional contexts.

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">For example, in the speaking test, unlike many other language tests, the examiner engages to some degree in the discussion with the candidate to simulate natural communication. Also, when deciding on the speaking score UBELT considers the level of interactive ease of the candidate and their comprehension of the English as spoken by the interviewer, as well as taking into account the language produced by the candidate. All of these facets of communication are essential in real-life situations.

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">The writing test uses straightforward tasks, which assess language and communication skills rather than formulaic formats and knowledge of strict academic writing conventions.

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">The reading and listening tests use texts and situations which are drawn from some of the topics and exchanges the professional is likely to encounter in the UK, including some current colloquial usage. Standard question types are used.

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">From UBELT’s feedback studies, it has been made clear that UBELT is a user-friendly test in its length and format. A further significant point is that it has a high “face validity” factor, i.e. it includes professionally relevant tasks and topics and so can appear more credible as a test to candidates. As a result, candidates are able to approach the test with greater confidence.

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman""> =<span style="font-size:11.0pt; line-height:150%;font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"; mso-bidi-font-weight:normal">Assessment & validity = <p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">Criteria and Descriptors

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">Assessment criteria and descriptions of language competency have been developed in the following ways:

<p class="MsoNormal" style="margin-left:45.0pt;text-align:justify;text-indent: -27.0pt;line-height:150%;mso-list:l4 level1 lfo7;tab-stops:list 45.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-fareast-font-family:Arial"> i.            <span style="font-size:11.0pt;line-height:150%; font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">according to current language test practices

<p class="MsoNormal" style="margin-left:45.0pt;text-align:justify;text-indent: -27.0pt;line-height:150%;mso-list:l4 level1 lfo7;tab-stops:list 45.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-fareast-font-family:Arial"> ii. <span style="font-size:11.0pt;line-height:150%; font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">according to guidelines in the Common European Framework of References for Languages

<p class="MsoNormal" style="margin-left:45.0pt;text-align:justify;text-indent: -27.0pt;line-height:150%;mso-list:l4 level1 lfo7;tab-stops:list 45.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-fareast-font-family:Arial"> iii. <span style="font-size:11.0pt;line-height:150%; font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">after careful scrutiny with our external test consultant

<p class="MsoNormal" style="margin-left:45.0pt;text-align:justify;text-indent: -27.0pt;line-height:150%;mso-list:l4 level1 lfo7;tab-stops:list 45.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-fareast-font-family:Arial"> iv. <span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">from empirical data gathered from examiner experience, user feedback, as well as moderation of written tests and recordings of speaking tests.

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">The assessment descriptors and reliability procedures for the Dental and Pharmacy tests are of such a nature that they can be applied directly to the other professional tests.

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">Scoring Method

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">Authenticity is also enhanced by the UBELT scoring method which focuses on the actual professional performance needed for the job. This is fundamental to our test design and delivery. For example, while UBELT includes all four language skills in its assessment of a candidate, the overall score is weighted in favour of the skills which are most significant for working in the U.K.

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">The most important language skills for each profession are signalled through consultation with professional informants- practising professionals, employers, recruiters and officials of governing bodies. For example, in both Dentistry and Pharmacy, speaking and listening have been prioritised and given weight accordingly.

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">

<span style="font-size:11.0pt; line-height:150%;font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"; mso-bidi-font-weight:normal">Concurrent Validity
<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"">Concurrent validity involves comparing candidates’ scores obtained by taking UBELT with other known measures of their language ability.

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"">

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"">In the design and piloting stages, information is collected about the volunteers to investigate the extent to which UBELT scores concur with their other language assessments, both formal and informal (e.g. from their teachers, other language tests, informal conversations).

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"">

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"">In the live test stage, UBELT examiners note any comments made by clinical recruiters about candidates’ performance in clinical interviews and report these back to the UBELT project director.

<span style="font-size:11.0pt; line-height:150%;font-family:"Arial","sans-serif"">Predictive Validity
<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">While it must be accepted that no language test can ever replicate the complexity of the real communicative situation, a fundamental premise of all language tests is that the language test samples the candidate’s language ability, measures it, and the results can provide a clearer picture of candidates’ language level. From this the language tester and test user seek to make predictions about how well the candidate is likely to perform in future situations (predictive validity).

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman";color:black"> <span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">In the UBELT test, such an interpretation and prediction hinges on the candidate’s level of ease, fluency, and effectiveness in using English.

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman";color:black">The data to support the UBELT’s claims for a high level of predictive validity derives from tracking candidates’ subsequent performance in the professional situation. Information from language level assessment surveys after the candidates have begun work in the U.K is gathered regularly, and requires support from the candidates as well as agencies or employers.

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height: 150%;font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">  

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height: 150%;font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">Reliability  =<span style="font-size:11.0pt; line-height:150%;font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"; font-weight:normal">Reliability in Test Design = <p class="MsoNormal" style="margin-left:45.0pt;text-align:justify;text-indent: -27.0pt;line-height:150%;mso-list:l0 level2 lfo6;tab-stops:list 45.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-fareast-font-family:Arial"> i. <span style="font-size:11.0pt;line-height:150%; font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">All UBELT tests are designed according to a blueprint.

<p class="MsoNormal" style="margin-left:45.0pt;text-align:justify;text-indent: -27.0pt;line-height:150%;mso-list:l5 level1 lfo10;tab-stops:list 45.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-fareast-font-family:Arial"> ii. <span style="font-size:11.0pt;line-height:150%; font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">All UBELT test creators are trained and work in collaboration with other creators and a supervisor.

<p class="MsoNormal" style="margin-left:45.0pt;text-align:justify;text-indent: -27.0pt;line-height:150%;mso-list:l5 level1 lfo10;tab-stops:list 45.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-fareast-font-family:Arial"> iii. <span style="font-size:11.0pt;line-height:150%; font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">Versions of reading and listening tests are carefully designed, scrutinised and piloted according to standard language test procedures. Tests are piloted first with native speaker teachers, after which the test is re- evaluated and re-written as necessary. Tests are then piloted with mixed groups of students, some of whom have known other English assessment scores so that comparisons can be made with the test results. These groups include volunteers from several science areas, including pharmacy and chemistry. Versions of tests are calibrated against each other. The data from tests used in live situations, is collected for statistical analysis.

<p class="MsoNormal" style="margin-left:45.0pt;text-align:justify;text-indent: -27.0pt;line-height:150%;mso-list:l5 level1 lfo10;tab-stops:list 45.0pt"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-fareast-font-family:Arial"> iv. <span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">There is on-going feedback and monitoring of components. Examiners report back on test events; they include information on any questions, comments, observations, or variations encountered. All components are monitored and statistics are collected regularly.

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">Examiner reliability

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">Of crucial importance is the reliability and consistency of the examiners’ delivery and judgements. UBELT examiners have a high level of language teaching and assessment experience.

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">Within UBELT, examiners undergo careful initial training, regular standardisation, self-reflection, moderation, and monitoring.

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height:150%;font-family:"Arial","sans-serif"; mso-bidi-font-family:"Times New Roman"">

<p class="MsoNormal" style="text-align:justify;line-height:150%"><span style="font-size:11.0pt;line-height: 150%;font-family:"Arial","sans-serif";mso-bidi-font-family:"Times New Roman"">