The Factorial Structure of Scale in Light of Differential Items Functioning Type

Authors

  • Firas Mahmoud Ali Al Mahasneh Yarmouk University
  • Amal Ahmad Mahmoud Al-Zoubi Yarmouk University

DOI:

https://doi.org/10.33977/1182-014-043-002

Keywords:

Factorial structure, scales differential , functioning type, invariant

Abstract

The current study aimed at verifying the factorial structure of scale in light of differential item functioning (DIF) type (uniform, non-uniform), in order to achieve the study objective. The experimental approach was followed by simulating the study conditions through generating the individual’s responses of the sample study which consisted of 1000individual for each of the focal group and the reference group on a scale of 50items in light of three parameters logistic model (3PLM) using R package. Also the data were replicated 300 times for each type of differential functioning (DIF). The results of the study indicated that the data fit the model of the study, and the indicators values of   was showing an acceptable goodness of fit values. In addition, the study revealed that the invariance levels of configure, metric, scalar, residuals property were confirmed using the (MGCFA) through all of the experimental conditions of the study, but it was differed according to the difference in the (DIF) type; due to the absolute goodness of fit indicators . The study recommended the use of different percentages of (DIF (, and other types of goodness fit indices.

Author Biographies

Firas Mahmoud Ali Al Mahasneh, Yarmouk University

PhD student    

Amal Ahmad Mahmoud Al-Zoubi, Yarmouk University

Associate Professor   Community Verified icon

References

المصادر والمراجع العربية:

­ اجباره، محمد. (2015). أثر نسبة الفقرات ذات الأداء التفاضلي على الخطأ من النوع الأول وقوة الاختبار في الكشف عنه باستخدام طريقتي الإنحدار اللوجستي ونسبة الأرجحية العظمى. أطروحة دكتوراة غير منشورة، جامعة اليرموك.

­ تيغزة، محمد.(2012). التحليل العاملي الاستكشافي والتوكيدي عمان: دار المسيرة.

­ الحربي، آلاء والمدني، فاطمة. (2021). الكشف عن أثر نسبة المفردات ذات الأداء التفاضلي على قوة وفاعلية اختبار منحنى خصائص المفردة في النموذج ثلاثي المعلم. مجلة العلوم التربوية والنفسية، 5(14)، 46-62.

­ أبو حطب، فؤاد وصادق، آمال. (1991). مناهج البحث وطرق التحليل الإحصائي في العلوم النفسية والاجتماعية والتربوية. مكتبة الأنجلو المصرية.

­ السعيد، أريج. (2021). فعالية طريقة المواءمة في الكشف عن اللاتغير في أداء طلبة الصف الثالث الأساسي على الاختبار التقييمي لمهارات الرياضيات عبر مديريات التربية والتعليم الأردنية. أطروحة دكتوراه غير منشورة، جامعة اليرموك، الأردن.

­ السيد، سعيد. (2022). مقياس العوامل الستة المنقح للشخصية (HEXAC0-PI-R) للبيئة الأردنية باستخدام نظرية الاستجابة للفقرة والتحقق من بنيته العاملية. .أطروحة دكتوراة غير منشورة، جامعة اليرموك.

­ الشريفين، نضال .(2018). أثر نوع الأداء التفاضلي للفقرات على الخصائص السيكومترية للفقرات والاختبار وفق النماذج المعلمية والنماذج اللامعلمية لنظرية الاستجابة للفقرة، دراسات، العلوم التربوية، 45 (4)، 605-632.

­ الشوبكي، فاطمة. (2021). البناء العاملي واللاتغير في القياس لمقياس جودة الحياة بدلالة طول المقياس. أطروحة دكتوراة غير منشورة، جامعة اليرموك، الأردن.

­ عبد العزيز، بوسالم وأحمد، كريش. (2016). الأداء التفاضلي للبند في الاختبارات النفسیة، مصادره وتفسیره. مجلة العلوم الاجتماعي ة، 10 (2)، 127-142.

­ عدس، عبد الرحمن والكيلاني، عبد الله(1993). برنامج التربية للقياس والتقويم في التعلم والتعليم.

­ أبو علام، رجاء والمرابحة، عامر.(2015). أثر نسبة المفردات ذات الأداء التفاضلي وحجم العينة على قوة وفاعلية اختبار تحيز المفردة المتزامن ( دراسة محاكاة). المجلة العربية للعلوم الاجتماعية، 2(7) ، 139-165.

­ عودة، أحمد(2014(، القياس والتقويم في العملية التدريسية. دار الأمل.

­ النوافلة، علي. (2013). أثر نسبة الفقرات ذات الأداء التفاضلي ومستواه في تقدير معالم فقرات الاختبار وقدرات الأفراد وفق نموذج الاستجابة ثلاثي المعلمة. أطروحة دكتوراة غير منشوره، جامعة اليرموك، الأردن.

References

­ Abdel-Alaziz, B., &Ahmed, K. (2016). Differential item functioning its resources and interpretations. (in Arabic), Journal of Social Sciences, 10(2),127-142.

­ Abo-Alam, R., & Al-Marabhah, A. (2015). The effect differential item functioning ratio & sample size on the strength & power of SIBTEST. (in Arabic), Arabian Journal for Social Sciences, 2(7), 139-165.

­ Abo-Hatab, F., & Sadeq, A. (1991). Research Methodology &Statistical analysis Methods for Psychological and Educational Sciences. (in Arabic), Englo-Eygptian for Publishing and Distribution.

­ Ackerman, T. (1992). A didactic explanation of item bias impact, and item validity from a multidimensional perspective. Journal of Educational Measurement, 29, 67-91.

­ Addas, A., &Al-Kalany, A. (1993). Measurement and evaluation program for teaching and learning. (in Arabic)

­ Albright, J., & Park, H. (2009). Confirmatory factor analysis using AMOS, LISREL, Mpluse, SAS/STAT CALIS. Working Paper. The University Information Technology Services (UITS) Center for Statistical and Mathematical Computing, Indiana University.

­ Al-Harbi, A., & Madany, F. (2021). Detecting the effect of differential item functioning on ICC test strength and power for third logistic IRT model. (in Arabic), Journal of Psychological & Educational Sciences,5(14), 45-62.

­ Al-nawafleh, A. (2013). The effect of differential item functioning percentage and its level on the estimations of items and individuals parameters (Un published doctoral dissertation), (in Arabic),Yarmouk University, Jordan.

­ Al – Saeed, A. (2020). The Effectiveness of the Alignment Method in Detecting the Invariance in the Performance of the Third Grade Students on the Evaluation Test of Mathematics Skills across the Directorates of Jordanian Education, (Un published doctoral dissertation), (in Arabic), Yarmouk university, Jordan.

­ Alseid, S. (2022). Standardizing the Revised Scale of the Personality Six Factors (HEXACO-PI-R) for Jordanian Environment using Item Response Theory (IRT) and Verifying its Factorial Structure, (Un published doctoral dissertation), (in Arabic), Yarmouk University, Jordan.

­ Al-Sharefeen, N. (2018). The effect of differential item functioning type on Psychological characteristics for item and test in light of IRT parametric and non-parametric models. (in Arabic), Journal of Educational Sciences,45(4), 605-632.

­ Al – Shobaki, F. (2021). Factor Structure and invariance of Measurement of the Quality-of-Life Scale According to Scale Length, (Un-published doctoral dissertation), (in Arabic), Yarmouk University, Jordan.

­ Angoff, W. (1993).Perspectives on differential item functioning methodology. In P.W.

­ Braun, H. (2013). Differential item performance and the procedure in Mantel-Haenszel test Validity. Routledge.

­ Brown, T. (2006). Confirmatory factor analysis for applied research. Guilford Press.

­ Byrne, M. (2001). Structural equation modeling with AMOS, EQS, and LISREL: comparative approach for the factor validity of a measuring instrument. International. Journal of Testing, 1, 55-86.

­ Byrne, B., & Watkins, D. (2003). The issue of measurement invariance revisited. Journal of Cross- Cultural Psychology,34(2),155-157.

­ Camilli, G. & Shepard, L. (1994). Methods for identifying bias test item. Sage publication.

­ Capalleri, JC., Lundy, Jason & Hays, RD. (2014). Overview of classical test theory and item response theory for the quantitative assessment of items in developing patient-reported outcomes measures. Clin Ther, 36(5), 648-662.

­ Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural equation modeling: a multidisciplinary journal, 14(3), 464-504.

­ Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit Index’s for testing measurement invariance. Structural equation modeling, 9(2), 233-255.

­ Crocker, L. & Algina, J. (1986). Introduction to Classical and Modern Test Theory. University of Florida.

­ DeCoster, J. (1998). Overview of Factor Analysis. Tuscaloosa. Retrieved from https://www.researchgate.net/file.PostFileLoader.html?id=54464aefd2fd6405388b45bb&assetKey=AS%3A273627033866242%401442249176796.

­ Drasgow, F. (1982). Biased test items and differential validity. Psychological Bulletin,92,526-531.

­ Ejbara, M. (2015). The Effect of Percentage of items with DIF on Type I Error & Test Power in detecting, Using Logistic Regression & Likelihood Ratio Method, (Un published doctoral dissertation), (in Arabic), Yarmouk university, Jordan.

­ Eysenck, H. J. (2013). The structure of human personality (psychology Revivals). Routledge.

­ Frick, P., Barry, C., & Kamphaus, R. (2020). Clinical Assessment of Child and Adolescernt Personality and Behavior. Springer.

­ Gabriel E. L. (2011). Detection and Classification of DIF Types Using Parametric and Nonparametric Methods: A comparison of the IRT- Likelihood Ratio Test, Crossing-SIBTEST, and Logistic Regression Procedures Unpublished dissertation. University of South Florida.

­ Gruijter.J & Kamp.V. (2008). Statistical Test Theory for the Behavioral Sciences. Tylor and Frances Group L.L.E.

­ Hair, F., Black, C., Babin, J., Anderson, E. & Tatham, L. (2006). Multivariate data analysis (6 ed.): Prentice Hall.

­ Hambleton, R, Swaminathan, H, & Rogerrs, H. (1991). Fundamentals of item response theory, Sage.

­ Hambleton, R., Merenda, P., & Spielberger, C. (Eds.). (2004). Adapting educational and psychological tests for cross-cultural assessment. Psychology Press.

­ Harrington, D. (2009). Confirmatory factor analysis. University Press.

­ Huang, J., & Han, T. (2012). Revisiting differential item functioning; Implications for fairness investigation. International Journal of Education, 4(2), 74-86.

­ Hu, L. & Bentler, P. (1999). Evaluating model fit .In R.h. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and application (pp. 76- 99). Thous and Oaks, CA: Sage.

­ Hult, G. T. M., D. J. KetchenJr, D. A. Griffith, B. R. Chabowski, M. K. Hamman, B. J. Dykes, W. A. Pollitte and S. T. Cavusgil (2008). ‘An assessment of the measurement of performance in international business research’, Journal of International Business Studies, 39, 1064– 1080.

­ Joseph, F., Hair, J., & Marco, J. (2017). Advanced Issues in Partial Structural Equation Modling: Conceptual and methodological Norwell, MA: Kluwer Academic.

­ Kalaycioglu, D. & Berberoglu, G. (2011). Differential item functioning analysis of the science and mathematics items in the university entrance examinations in turkey. Journal of Psycho Educational Assessment, 29 (5), 467-478.

­ Kline, R. B. (2015). Principles and practice of structural equation modeling. Guilford Press.

­ Lord, F. (1980). Application of item response theory to practical testing problems. Lawrence Erlbaum Associates, Publishers.

­ Maller, S. (2003). Best practices in detecting bias in nonverbal tests. Springer.

­ Michel ides, P. (2008). An illustration of a Mantel-Haenszel procedure to flag misbehaving common itemsin test equating. Practical Assessment Research and Evaluation, 13(7), 1-13.

­ Millsap, R. E. (2011). Statistical approaches to measurement invariance. Routledge.

­ Odeh, A. (2014). Measurement and evaluation in teaching process, (in Arabic), Dar Al- for Publishing and Distribution, Irbid, Jordan.

­ Salubayba, T. (2013). Differential item functioning detection in reading comprehension test using Mantel-Haenszel, Item response theory, and logical data Analysis. The International Journal of Social Sciences, 14(1), 76-82.

­ Sarmento, R. P., Costa, V. (2019). Confirmatory Factor Analysis--A Case study. Ar Xiv preprint arXiv: 1905 .05598.

­ Schumacher, E., & Lomax, G. (2004). A beginner's guide to structural equation modeling. Psychology Press.

­ Tan, X., & Jeral, M. (2005). Using local DIF analyses to assess group differences on multilingual examination. Applied Measurement in Education, 2,313-334.

­ Tegza, M. (2012). The exploratory and confirmatory factor analysis, Dar Al-Maserah for Publishing and Distribution, (in Arabic), Amman, Jordan.

­ Teresi, J. & Fleishman, J. (2007). Differential item functioning and healt h assessment. Quality of Life Research, 16 (1), 33–42.

­ Ulman, J. B. (2001). Structural equation modeling. In B. G. Tabachnick & L. S. Fidell (2001). Using Multivariate Statistics (4th ed & pp 653- 771). Needham Heights, MA: Allyn & Bacon.

­ Vandenberg, R. and Lance, C. (2000). A review and synthesis of the measurement invariance Literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods 3(1), 4-69.

­ Walker, C. (2011). What’s the DIF? Why differential item functioning analyses are an important part of instrument development and validation. Journal of Psychoeducational Assessment, 29 (4), 364-376.

­ Zhan, L. and Zumbo, B. (2009). Impact of Differential Item Functioning on Subsequent Statistical concluons Based on observed test Score Data, Psychological, 30(2), 243-370.

­ Zumbo, D. (1999). A handbook on the theory and methods of differential item functioning (DIF): Logistic regression modeling as a unitary framework for binary and likert type item scores: Directorate of Human Resources Research and Evaluation, Department of National Defense. Abo-Alam, R., & Al-Marabhah, A. (2015). The effect differential item functioning ratio & sample size on the strength & power of SIBTEST. (in Arabic), Arabian Journal for Social Sciences, 2(7), 139-165.

Downloads

Published

2023-12-31

How to Cite

Al Mahasneh, F. M. A., & Al-Zoubi, A. A. M. (2023). The Factorial Structure of Scale in Light of Differential Items Functioning Type. Journal of Al-Quds Open University for Educational & Psychological Research & Studies, 14(43). https://doi.org/10.33977/1182-014-043-002

Issue

Vol. 14 No. 43 (2023): Journal of Al-Quds Open University for Educational & Psychological Research & Studies

Section

searches

License

Copyright (c) 2023 Journal of Al-Quds Open University for Educational & Psychological Research & Studies

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

  1. The editorial board confirms its commitment to the intellectual property rights
  2. Researchers also have to commit to the intellectual property rights.
  3. The research copyrights and publication are owned by the Journal once the researcher is notified about the approval of the paper. The scientific materials published or approved for publishing in the Journal should not be republished unless a written acknowledgment is obtained by the Deanship of Scientific Research.
  4. Research papers should not be published or republished unless a written acknowledgement is obtained from the Deanship of Scientific Research.
  5. The researcher has the right to accredit the research to himself, and to place his name on all the copies, editions and volumes published.
  6. The author has the right to request the accreditation of the published papers to himself.

 

Most read articles by the same author(s)

Obs.: This plugin requires at least one statistics/report plugin to be enabled. If your statistics plugins provide more than one metric then please also select a main metric on the admin's site settings page and/or on the journal manager's settings pages.