This research aims to determine the content validity of the Wolio language and culture preservation model measurement instrument. This type of research is development research, using quantitative descriptive methods. The research subjects consisted of 9 experts, namely lecturers and teachers who understand the Wolio language and culture preservation model. Experts assess each item of the instrument statement. The instrument uses an ordinal rating scale and consists of 3 indicators. The collected data was analyzed using the Aiken's V formula. As a result, of the 15 instrument statement items, the content validity coefficient was greater than 0.74, indicating that all items were valid. There are 13 items in the very good category and 2 items in the good category. So this instrument is very suitable for use in measuring or assessing models of sociolinguistic preservation of language and culture

Arsyad

Manaf, Abdul

Mansyur, Firman Alamsyah

English

Universitas Hasanuddin: e-Journals

ELS Journal on Interdisciplinary Studies in HumanitiesVolume 6 Issue 3, 2023DOI: https://doi.org/10.34050/elsjish.v6i3.29667Homepage: journal.unhas.ac.id/index.php/jish567Analysis of The Aiken Index to Measure The Content Validity of The Wolio Languageand Culture Preservation Model InstrumentFirman Alamsyah Mansur1, Arsyad1, Abdul Manaf11Universitas Muhammadiyah Buton, Indonesia*Correspondence: fir.buton@gmail.comABSTRACT ARTICLE HISTORYPublished September 20th 2023KEYWORDSAiken Index; Content Validity;InstrumentARTICLE LICENCE© 2023 Universitas HasanuddinUnder the license CC BY-SA4.0This research aims to determine the content validity of the Wolio language and culturepreservation model measurement instrument. This type of research is developmentresearch, using quantitative descriptive methods. The research subjects consisted of9 experts, namely lecturers and teachers who understand the Wolio language andculture preservation model. Experts assess each item of the instrument statement.The instrument uses an ordinal rating scale and consists of 3 indicators. The collecteddata was analyzed using the Aiken's V formula. As a result, of the 15 instrumentstatement items, the content validity coefficient was greater than 0.74, indicating thatall items were valid. There are 13 items in the very good category and 2 items in thegood category. So this instrument is very suitable for use in measuring or assessingmodels of sociolinguistic preservation of language and culture1. IntroductionThe Wolio language is a symbol of ethnic identity for the Wolio people, and a means of developing culture(Kamaluddin & Munafi, 2020; Mansyur, 2018; Mansyur et al., 2022). Arts, literature, and cultural attractions are veryimportant for supporting the proposal of the Wolio fort area as a world cultural heritage, and for the development oftourism in Baubau City. Various studies on the preservation of the Wolio language have been carried out but have notproduced a comprehensive language and culture preservation model (Mansyur, 2016; Mansyur, 2017; Mansyur &Suherman, 2020; Mansyur & Said 2020; Rahman & Weda, 2019). To support model creation and development, qualityinstruments are needed to measure the model.Psychometric experts state that an instrument as a good quality measuring tool must meet the criteria of validityand reliability. Gronlund, et al., (2009) stated that apart from being valid and reliable, it also has a level of usefulness.Regarding the concept of validity, Azwar (2011) states that validity comes from the word validity which means the extentto which a measuring instrument is accurate and precise in carrying out its measuring function. This statement is in linewith the opinion of Allen & Yen (1979) that the validity of a test instrument can be interpreted as the ability of a test tomeasure what it is supposed to measure.Further to the concept of validity, it is known that there are three types of validity, namely content validity,construct validity and criterion validity (Allen & Yen, 1979). Content validity means the extent to which a test instrumentreflects the overall ability to be measured (Azwar, 2011). Content validity shows the content of the attributes studied(DeVon et al., 2007). Thus, content validity is a stage that must be implemented in instrument development.There are five conditions that must be met in content validity, namely: 1) the indicator must comply with theconceptual definition of the construct, 2) the construct is clearly defined, 3) the content of the construct must be relevantto the measurement objective, 4) there is consensus from qualified experts that the items in the measuring instrumentalready represent the construct to be measured; and 5) the contents of the expert's responses must be properlyobserved and assessed (Guion, 1977). Content validity was obtained based on expert judgment. The expert assessesqualitatively and quantitatively based on the validation sheet. So we need the Aiken Index as a formula to determinewhich items meet valid or invalid criteria.P ISSN: 2621-0843E ISSN: 2621-0835ELS Journal on Interdisciplinary Studies in HumanitiesVolume 6 Issue 3: 567-573568Based on the description above, this research aims to develop an instrument for measuring the preservation ofWolio language and culture. The resulting instrument is of good quality and meets the elements of content validity. Thismodel validity instrument can contribute to field research in sociolinguistics studies or anthropological linguistics.2. MethodologyThis type of research is research and development of measurement instruments for the preservation of Woliolanguage and culture. This study uses a quantitative descriptive method based on the results of content validitycalculations using the Aiken formula.Content validation data was obtained from the results of expert assessments of the 15 instrument itemsdeveloped. There were 9 experts involved in this research. The selection of experts is based on consideration ofexpertise in the fields of Wolio language and culture. Seven regional language and culture teachers who had beenteaching for more than 10 years were selected. Apart from that, you have a bachelor's and master's degree in education.Two language and culture lecturers who had been teaching for more than 10 years were selected. This lecturer has adoctoral education qualification. Experts use validation sheets to assess each statement item in the instrument (Table 1).The assessment criteria used are as follows;Score 5: Very Appropriate/Very UnderstandableScore 4: Decent/UnderstandingScore 3: Quite Decent/Fairly UnderstandableScore 2: Inadequate/Less UnderstandableScore 1: Not Appropriate/UnunderstandableTable 1. The statement items for the measurement model for the preservation of the Wolio language and cultureNo Item Statements1. I can speak Wolio2. My parents and I communicate using Wolio language at home3. My friends and I communicate using Wolio language in everyday society4. I want to learn Wolio language5. I am proud to use Wolio with family or friends6. The school supports me in learning the Wolio language7. I know and know Wolio literature, art or culture8. I have watched Wolio literature, arts and culture activities/performances in the last 2 years9. I have been involved in Wolio's literary, artistic and cultural activities at school in the last 2 years10. I have been involved in Wolio's literary, artistic and cultural activities in the community for the last2 years11. I am interested in studying literature, dance, vocal arts, or other performing arts and Wolio culture12. I learned Wolio culture through the environment where I live13. I realize that language is a culture that must continue to be preserved14. I realize that literature, dance or Wolio vocal art is a culture that must continue to be preserved15. I like and love the preservation of Wolio cultureQuantitative data obtained from expert assessments is used to prove content validity. The Aiken formula is theformula used in proof (Azwar, 2012).P ISSN: 2621-0843E ISSN: 2621-0835ELS Journal on Interdisciplinary Studies in HumanitiesVolume 6 Issue 3: 567-573569Information:s = r – loIo = the lowest validity rating numberc = the highest validity rating scorer = the number given by the ratingn = many repeaters/expertsThe Aiken index obtained from each item based on the calculation results was consulted with the Aiken table(Azwar, 2012).Figure 1. Aiken Index (V)Based on many experts (9 experts) who assessed the instrument and assessment scale categories (5 categories),the statement item on the instrument measuring the language and culture preservation model is said to be valid if the Vvalue obtained must be the same as 0.72 or more. Next, the V values obtained are categorized based on the scorerange (Azwar, 2012).P ISSN: 2621-0843E ISSN: 2621-0835ELS Journal on Interdisciplinary Studies in HumanitiesVolume 6 Issue 3: 567-573570Table 2. Criteria for assessing validation analysis results using Aiken VScore Range Category0.76 < V ≤ 1.00 Very good0,59 < V ≤ 0,76 Good0,41 < V ≤ 0,59 Pretty good0.24 < V ≤ 0,41 Not goodV ≤ 0,24 Very Not Good3. Result and DiscussionThe content validity of the Wolio language and culture preservation model measurement instrument in this studywas determined based on expert assessment. There were 9 experts who assessed qualitatively and quantitatively.Based on the results of quantitative data analysis using the Aiken formula, the Aiken index (V) for each item is obtainedwhich is presented in Table 3.Table 3. Results of the Aiken index analysis of the wolio language and culture preservation model measurementinstrumentStatementR1R2R3R4R5R6R7R8R9S1S2S3S4S5S6S7S8S9Sig.S VinformationItem1 5 4 5 5 5 3 5 5 4 4 3 4 4 4 2 4 4 3 320,889 ValidItem2 5 4 5 5 5 2 5 5 4 4 3 4 4 4 1 4 4 3 310,861 ValidItem3 5 4 4 5 4 3 4 5 3 4 3 3 4 3 2 3 4 2 280,778 ValidItem4 5 4 4 5 4 4 5 5 4 4 3 3 4 3 3 4 4 3 310,861 ValidItem5 5 4 5 5 5 3 5 5 4 4 3 4 4 4 2 4 4 3 320,889 ValidItem6 5 4 5 4 5 4 5 5 4 4 3 4 3 4 3 4 4 3 320,889 ValidItem7 5 4 4 5 3 2 5 5 3 4 3 3 4 2 1 4 4 2 270,750 ValidItem8 5 4 4 5 5 3 5 5 3 4 3 3 4 4 2 4 4 2 300,833 ValidItem9 5 4 3 5 3 2 5 5 4 4 3 2 4 2 1 4 4 3 270,750 ValidItem10 5 4 3 5 5 4 5 5 3 4 3 2 4 4 3 4 4 2 300,833 ValidItem11 5 4 4 4 4 3 5 5 3 4 3 3 3 3 2 4 4 2 280,778 ValidItem12 5 5 4 5 5 4 5 5 4 4 4 3 4 4 3 4 4 3 330,917 ValidItem13 5 5 5 5 5 5 5 5 4 4 4 4 4 4 4 4 4 3 350,972 ValidP ISSN: 2621-0843E ISSN: 2621-0835ELS Journal on Interdisciplinary Studies in HumanitiesVolume 6 Issue 3: 567-573571Item14 5 5 5 5 5 4 5 5 4 4 4 4 4 4 3 4 4 3 340,944 ValidItem15 5 5 4 5 5 4 5 5 3 4 4 3 4 4 3 4 4 2 320,889 ValidAll statement items meet valid criteria or can be said to have an Aiken index value above 0.72. Valid itemsindicate the same agreement from experts (Pandawa et al., 2021). For example, in item 15, 8 experts gave a score of 5or very feasible/very understandable and 1 expert gave a score of 4 or feasible/understandable. On item 9, each expertgave a varying assessment. Some gave a score of 5, a score of 4, a score of 3, and a score of 2. The variation inassessment scores on item 9 shows differences in the understanding of experts. There is (R6) who gives a score of 2which means that item 9 "I have been involved in Wolio's literary, artistic and cultural activities at school in the last 2years" is considered inadequate/not understandable from the language session, indicators and constructs. This finding isin line with Retnawati (2016) opinion regarding the suitability of items and indicators. Therefore, the items of the Woliolanguage and culture preservation model measurement instrument have different Aiken indices. Below is a picture of thevariation in the distribution of the Aiken index for 15 items.Figure 2. Distribution of instrument item Aiken index coefficientsIn the image above, it displays the distribution level of items based on the Aiken index. Item 14 "I realize thatWolio's literature, dance, or vocal art is a culture that must be preserved" has an aiken index value of 0.944 (the highest).Item 7 "I know and know Wolio's literature, art or culture" has an aiken index score of 0.750 (the lowest) and Item 9 "Ihave been involved in Wolio's literary, artistic and cultural activities at school in the last 2 years" has an aiken indexscore of 0.750 (the lowest ). There are 4 items with an aiken index value around 0.72, namely B3, B7, B9 and B11.There are 7 items with an aiken index around 0.80, namely B1, B2, B4, B5, B6, B8, B10, and B15. There are 3 itemswith an aiken index around 0.90, namely B12, B13, and B14. The distribution of the Aiken index values for 15 items ismore detailed and can be trusted as an appropriate measurement tool. This finding is in line with the opinion of Murphy& Davidshofer (1991). Instrument items developed can reduce the variation of instrument measurement errors andreflect the ability of respondents. As stated by Azwar (2011) that an instrument (test) reflects the ability to be measured.Therefore, this instrument can already predict the ability of the respondent or individual to be measured.The measurement instrument for the preservation of Wolio's language and culture was constructed from threeindicators, namely: 1) knowledge and ability to speak Wolio/cultured, 2) support from the family, school and communityenvironment, and 3) language and cultural attitudes. Based on the results of content validation, none of the items wereinvalid, meaning that all items measured the indicators correctly. Indicator 1 contains items B1 and B7. Indicator 2contains items B2, B3, B6, B8, B10, and B12. Indicator 3 contains B4, B5, B11, B13, B14, and B15.P ISSN: 2621-0843E ISSN: 2621-0835ELS Journal on Interdisciplinary Studies in HumanitiesVolume 6 Issue 3: 567-573572In Figure 3, it reflects the item categories, namely there are 2 items in the good category, namely B7 and B9.There are 13 items in the very good category, namely B1, B2, B3, B4, B5, B6, B8, 10, B11, B12, B13, B14, and B15.Items in the good category are in the range of scores 0.59 < V ≤ 0.76. Items in the very good category are in the range0.76 < V ≤ 1.00. Good and very good quality instrument items can be used in individual assessments (Manaf et al.,2023).Figure 3. Aiken index coefficient categories of instrument itemsThe Wolio language and culture preservation model measurement instrument based on content validity with theAiken index approach gave very good results. All instrument items developed are valid based on expert judgmentquantitatively. Therefore, this instrument can be used at the measurement and assessment stage.4. ConclusionBased on the research that has been conducted, it can be concluded that the instruments developed in themeasurement model for preserving the Wolio language and culture have valid items. Furthermore, the instrument itemsfall within the good and very good categories. The instruments, which have undergone content validation stages, canalready be utilized in the measurement and assessment of individuals. This demonstrates that efforts to preserve theWolio language and culture have gone through a robust instrument development process that can be relied upon tomeasure and evaluate the outcomes of preservation endeavors. Therefore, these steps represent a positive initiative insafeguarding the richness of Wolio culture and language to ensure their continued vitality and growth.ReferencesAllen, M.j., & Yen, W.M. (1979). Introduction to measurement theory. Monterey, Mexico: Brooks/Cole PublishingCompany.Aiken, Lewis R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational andpsychological measurement 45(1), 131-142.Azwar, S. (2012). Penyusunan skala psikologi. Yogyakarta: Pustaka pelajar.Azwar, S. (2011). Reliabilitas dan validitas. Yogyakarta: Pustaka BelajarDeVon, H. A., Block, M. E., Moyle‐Wright, P., Ernst, D. M., Hayden, S. J., Lazzara, D. J., ... & Kostas‐Polston, E. (2007).A psychometric toolbox for testing validity and reliability. Journal of Nursing scholarship, 39(2), 155-164.Gronlund, N.E., Linn, R.L., & Miller, M.D. (2009). Measurement & evaluation in teaching. Tenth edition. New York:Macmillan Publishing Co., Inc.Guion, R. M. (1977). Content validity: the source of my discontent. Applied Psychological Measurement, 1(1), 1 – 10.P ISSN: 2621-0843E ISSN: 2621-0835ELS Journal on Interdisciplinary Studies in HumanitiesVolume 6 Issue 3: 567-573573Kamaluddin, LD & LD. Munafi. (2020). Penyusnan naskah akademik rancangan perda pelestarian bahasa, aksara dansastra wolio. Baubau; (Belum dipublikasikan)Manaf, A., Adri, D., Aminu, N., Nur Arini, W. O., & Abdullah, N. (2023). Pelatihan analisis karakteristik item soal tesdengan menggunakan program iteman pada guru sekolah dasar negeri 2 wameo. Jurnal Pelatihan Pendidikan,1(2), 70-81.Mansyur, F. A. (2016). Onina Manga Mancuana Mangenge: Kognisi Religi Orang Wolio (Linguistik Antropologis).Journal Prassasti Conference Series, 326-333. https://jurnal.uns.ac.id/prosidingprasasti/article/view/1526Mansyur, F.A. (2017). Onina Manga Mancuana Mangenge: Kognisi Religi Orang Wolio (Linguistik Antropologis). The 8thInternational Seminar on Diaspora of Austronesian and Non Austronesian Languanges and Literature inIndonesia,199-208. Denpasar, Bali: Faculty of Arts, Universitas Udayana.Mansyur, F.A. (2018). Onina manga mancuana mangenge: traditional wolio (Doctoral dissertation),from.http://digilib.fib.ugm.ac.id/digital/filter/960.Mansyur, F.A., R. Said. (2020). A cognitive semantics Analysis of Wolio proverbs related to the human body. 1stBorobudur International Symposium on Humanities, Economics and Social Sciences (BIS-HESS 2019), 259-262.https://www.atlantis-press.com/proceedings/bis-hess-19/125939499.Mansyur, F. A., & Suherman, L. A. (2020). The Function of Proverbs as Educational Media: Anthropological Linguisticson Wolio Proverbs. ELS Journal on Interdisciplinary Studies in Humanities, 3(2), 271-286.https://doi.org/10.34050/els-jish.v3i2.10505Mansyur, F. A., Arsad, Nazar, A. ., Hikmah, I. ., & Zilani. (2022). A Model of Wolio Language Maintenance Strategies inSociety 5.0. ELS Journal on Interdisciplinary Studies in Humanities, 5(2), 284-292.https://doi.org/10.34050/elsjish.v5i2.21510Murphy, K. R., & Davidshofer, C. O. (1991). Psychological Testing: principles and applications. New Jersey: PrenticeHall.Pandawa, R. M., Ridwan, A., & Mahdiyah. (2021). Analysis of the instrument content validity using the aiken index ondisaster nursing competency assessment. Degres, 20(1), 298–308. https://www.degres.pwRahman, F., & Weda, S. (2019). Linguistic deviation and the rhetoric figures in Shakespeare’s selectedplays. XLinguage" European Scientific Language Journal", 12(1), 37-52.Retnawati, H. (2016). Proving content validity of self-regulated learning scale (The comparison of Aiken index andexpanded Gregory index). Research and Evaluation in Education, 2(2), 155-164.doi:http://dx.doi.org/10.21831/reid.v2i2.11029

Analysis of The Aiken Index to Measure The Content Validity of The Wolio Language and Culture Preservation Model Instrument

https://journal.unhas.ac.id/index.php/jish/article/download/29667/10337/96974

Analysis of The Aiken Index to Measure The Content Validity of The Wolio Language and Culture Preservation Model Instrument

Abstract

Similar works

Full text

Available Versions

Universitas Hasanuddin: e-Journals