Establishing and validating standards for measuring English proficiency of prospective Thai tour guides

Abstract

There has been a significant shift in the process of obtaining a Thai tour guide license. The transition has gone from a non-exam-based procedure to one that now requires individuals to pass an examination that includes an English proficiency assessment. However, there is currently no direct link between the exam-based cut score and the reporting of English proficiency of standards for individuals based upon their performance on the exam. In response to this transformative change, this thesis proposes the establishment of standards to measure English proficiency of those who seeking a tour guide license in Thailand. The foundation of this thesis is rooted in the principle of standard-referenced assessment, where test takers' achievements are interpreted against predefined standards of performance. This guiding principle also promotes consistency and coherence in the design of curriculum, instruction, and assessment, all aligned with the established standards. The thesis begins with developing a measurement rubric that describes proficiency standards of what Thai tour guides should know and be able to do at different proficiency levels. This measurement rubric lays the groundwork of reference for implementing an English assessment tailored to tour guides. As the next step, the thesis investigates the alignment between the existing English tests used in Thai tourism education and the proficiency standards outlined in the measurement rubric. Subsequently, the thesis progresses to designing a test blueprint that aligns with the established proficiency standards, serving as the foundation for constructing test items aimed at measuring the level of English proficiency of tour guides. Finally, a cut score (minimum score) to pass each proficiency level and proficiency standard (level) of English required for licensed tour guides are established based on the developed measurement rubric.