Prototype and Trial of CBT Japanese Speaking Test : Verification of Test Quality and Number of Items

国際交流基金日本語国際センターでは、2019年度より、CBT方式による日本語スピーキングテストの可能性を探るための調査・研究を進めてきた。2020年度には、CBT方式のスピーキングテストを3セット試作し、その品質と項目数について検証するため、タイの日本語学習者170名を対象に試行試験を行った。その結果、3つのテストセットにおいて、難易度は0.70～0.74、識別力は0.56～0.57で、セット間に品質の差はほとんどなかった。テストの信頼性（クロンバックのa 係数）は0.834～0.846で、すべてのテストセットにおいて概ね高い信頼性係数が確認でき、信頼性の高いテストであることが立証された。また、試作したテストの項目数が適切であるかどうかを、多変量一般化可能性理論を用いて検証したところ、試作したテストの項目数（インタビュー4問、会話4問）で高い信頼性（0.823）を得られることがわかった。This paper reports on the prototype and trial of CBT-based Japanese speaking test and validates the reliability of the test. The Japan Foundation Japanese-Language Institute, Urawa, has been studying and researching the possibility of a CBT-based Japanese speaking test since 2019. From 2020 to 2021, three sets of prototype CBT speaking tests were made, and a trial test was conducted in Thailand with 170 Japanese language learners. The results of the analysis of test quality showed that the three test sets scored 0.70 to 0.74 in difficulty and 0.56 to 0.57 in discrimination, with no significant differences in quality among the test sets. Cronbach's alpha for the test sets were 0.834 to 0.846, confirming generally high reliability for all the test sets. The appropriate number of test items was also examined using multivariate generalizability theory. The number of items in the test was found to have high reliability (0.823) when there were four items in the interview part and four items in the conversation part of the test.departmental bulletin pape

Contents

othe

Development and Operation of the “IRODORI Japanese Online Course”

「いろどり日本語オンラインコース」は、教材『いろどり生活の日本語』をオンラインコース化したもので、様々な制約により日本語学習の機会が得られない学習者が自学自習できるコースである。開発のコンセプトは、①生活場面で必要な日本語が学べる、②学習者が必要なところだけカスタマイズして学べる、③ストレスなく学べるの3点とし、これらを実現するため、動画や練習コンテンツの制作などを行った。また、コースサイトやページを、だれでも迷わず使えるようにデザインした。コンセプトが実現できているか確認するため分析を行ったところ、ユーザー属性から、想定していたユーザー層が利用していること、ユーザーの行動フロー分析やユーザーアンケートの回答から、それぞれのコンテンツがねらい通りに利用されていることが確認できた。また、ページの閲覧回数やアプリのインストール数から、動画や練習コンテンツのアプリが活用されていることもわかった。The IRODORI Japanese Online Course is an online course based on the textbook, Irodori: Japanese for Life in Japan, and is a self-study course for Japanese language learners who do not have the opportunity to study Japanese because of various limitations. Its development was based on three concepts: 1) to help learn the Japanese language necessary for daily life, 2) to be customizable for learning only what the learner needs, and 3) to provide stress-free learning. Videos, practice content, and other types of content were produced to achieve these concepts. The course site and pages were also designed to make them easy to use and navigate for anyone. An analysis was conducted to check if the concepts have been achieved. The user attributes showed that our expected user demographics are using the course, while results from users’ behavior flow analysis and user survey responses have confirmed that each type of content is being used as intended. Moreover, the number of page views and app installations showed that the video pages and practice content app are being used.departmental bulletin pape

List of Authors, Editors and Referees

othe

The Issues of Japanese Grammar Lessons Faced by Japanese Language Teachers Living Overseas

departmental bulletin pape

Survey of Attitudes Toward Becoming a Teacher Training Instructor

departmental bulletin pape

Teacher training in Japan with emphasis on autonomy and collaboration : Curriculum Design of Training Program for Secondary Japanese Language Teachers in the Republic of Korea

departmental bulletin pape

Front Cover

othe

Submission Guidelines

othe

Teacher’s training of Irodori: Japanese for life in Japan for Japanese language instructors in Cambodia. : Training design combining Synchronous Type and Asynchronous Type

departmental bulletin pape