Issue
Authors retain the copyright without restrictions for their published content in this journal. HSSR is a SHERPA ROMEO Green Journal.
Publishing License
This is an open-access article distributed under the terms of
THE APPLICATION OF DIFFERENTIAL PERSON FUNCTIONING ON THE SCIENCE LITERACY OF TAIWAN PISA 2015
Corresponding Author(s) : Pei-Ming Chiang
Humanities & Social Sciences Reviews,
Vol. 6 No. 1 (2018)
Abstract
Purpose of Study: This study is an application of differential person functioning (DPF) on the data of Taiwan PISA 2015 science literacy. We use this method to understand the strength and weakness of Taiwan students in science literacy. It is also hoped that the results could be helpful in improving the content of curriculum and the remedial instruction.
Methodology: We transpose the person-item data matrix into an item-person matrix, and use Mantel-Haenszel method to analyze this matrix. The focal and reference groups change from persons to item clusters, that is, cognitive domains in the PISA science assessment.
Main Findings: Results show the proportions of DPF are very few. This implies most Taiwan students have a comprehensive science literacy. Up to 5.9% students perform differentially in three science competencies. Most DPF students perform better in the explain phenomena scientifically (EP) competency than the others no matter what proficiency level they are belong to. This may reflect the current situation of science education in Taiwan. The experts and teachers should develop more curriculums to reinforce the students’ competencies about evaluate and design scientific enquiry (ED) and interpret data and evidence scientifically (ID).
Limitations: The effect sizes of DPF are not provided, the degree of DPF is unidentified. DPF analyses only test the relative difference in two cognitive scales. Future studies can incorporate other cognitive diagnostic model to obtain more information in detail.
Importance of Study: The PISA assessments provide a favorable framework to examine students’ literacy. The results of international reports show that Taiwan students performed well in science. The application of differential person functioning can find out the weaknesses of Taiwan students in science literacy. Furthermore, we applied the DPF procedure to explore the characteristics of students in the different level of performance.
Keywords
Download Citation
Endnote/Zotero/Mendeley (RIS)BibTeX
-
1. Alsmadi, A. (1998). Differential person functioning. Doctoral Dissertation, Ohio University.
2. Brozo, W. G., Shiel, G., & Topping K. (2007). Engagement in reading: Lessons learned from three PISA countries. Journal of Adolescent and Adult Literacy, 51(4), 304-315.
3. Holland, P. W., & Thayer, D. T. (1988). Differential item performance and the Mantel-
Haenszel procedure. In H. Wainer & H. I. Braun (Eds.), Test validity (pp.129-145). Hillsdale, NJ: Lawrence Erlbaum.
4. Johanson, G. A., & Alsmadi, A. (1998). Differential Person Functioning. Paper presented at the annual meeting of the American Educational Research Association in San Diego, CA.
5. Johanson, G. A., & Alsmadi, A. (2002). Differential person functioning. Educational and Psychological Measurement, 62(3), 435-443..
6. Johanson, G. A. & Osborn, C. J. (2000). Acquiescence as Differential Person Functioning. Paper presented at the annual meeting of the American Educational Research Association in New Orleans, LA.
7. OECD (2016a), PISA 2015 Results (Volume I): Excellence and Equity in Education, PISA, OECD Publishing, Paris. http://dx.doi.org/10.1787/9789264266490-en
8. OECD (2016b), PISA 2015 Assessment and Analytical Framework: Science, Reading, Mathematics and Financial Literacy, OECD Publishing, Paris, http://dx.doi.org/10.1787/9789264255425-en
References
2. Brozo, W. G., Shiel, G., & Topping K. (2007). Engagement in reading: Lessons learned from three PISA countries. Journal of Adolescent and Adult Literacy, 51(4), 304-315.
3. Holland, P. W., & Thayer, D. T. (1988). Differential item performance and the Mantel-
Haenszel procedure. In H. Wainer & H. I. Braun (Eds.), Test validity (pp.129-145). Hillsdale, NJ: Lawrence Erlbaum.
4. Johanson, G. A., & Alsmadi, A. (1998). Differential Person Functioning. Paper presented at the annual meeting of the American Educational Research Association in San Diego, CA.
5. Johanson, G. A., & Alsmadi, A. (2002). Differential person functioning. Educational and Psychological Measurement, 62(3), 435-443..
6. Johanson, G. A. & Osborn, C. J. (2000). Acquiescence as Differential Person Functioning. Paper presented at the annual meeting of the American Educational Research Association in New Orleans, LA.
7. OECD (2016a), PISA 2015 Results (Volume I): Excellence and Equity in Education, PISA, OECD Publishing, Paris. http://dx.doi.org/10.1787/9789264266490-en
8. OECD (2016b), PISA 2015 Assessment and Analytical Framework: Science, Reading, Mathematics and Financial Literacy, OECD Publishing, Paris, http://dx.doi.org/10.1787/9789264255425-en