Evidence for the Reliability and Validity of the Arabic Version of the Student Risk Screening Scale for Internalizing and Externalizing Behaviors (SRSS-IE)
School-based universal screening for behavioral/emotional risk is a necessary first step to providing services in an educational setting for students with emotional and behavioral disorders (EBDs). Psychometric properties are critical to making decisions about choosing a screening instrument. The purpose of the present study was to examine the psychometric properties of the student risk screening scale for internalizing and externalizing behaviors (SRSS-IE). Participants included 3145 students and their teachers. Item-level analyses of the current sample supported the retention of all items. The internal consistency of the SRSS items ranged from 0.83 to 0.85. Convergent validity between the SRSS-IE and a well-established screening tool, the strength and difficulties questionnaire (SDQ), was found for the total score (r = 0.70). Additionally, the results of this study demonstrate strong social validity, suggesting the SRSS-IE to be a useful and functional screening tool. We conclude that the SRSS-IE is a valid and reliable instrument for assessing the level of emotional and behavioral difficulties among elementary students.
References
[1]
United Nations (2023) Sustainable Development Goal 4: Quality Education in Saudi Arabia. https://saudiarabia.un.org/en/sdgs/4
[2]
Tang, Q. (2015) Goal 4: Ensure Inclusive and Equitable Quality Education and Promote Lifelong Learning Opportunities for All. UN Chron, 51, 11-12. https://link.gale.com/apps/doc/A417020502/AONE?u=anon~8237a3b5&sid=googleScholar&xid=406bc6c8 https://doi.org/10.18356/b2b87b7d-en
[3]
Celestial, W.J. (2019) A Historical Perspective of the Field of Emotional and Behavioral Disorders: A Review of Literature. International Journal of Psychology and Counselling, 11, 81-85. https://doi.org/10.5897/IJPC2019.0512
[4]
(2023) Saudi Vision 2030. https://www.vision2030.gov.sa/media/rc0b5oy1/saudi_vision203.pdf
[5]
(2023) The National Center for Mental Health Promotion. https://ncmh.org.sa/view/16/3th
[6]
Walker, H.M. and Gresham, F.M. (2013) Handbook of Evidence-Based Practices for Emotional and Behavioral Disorders: Applications in Schools. Guilford Publications, New York.
[7]
Zionts, P., Zionts, L. and Simpson, R.L. (2002) Emotional and Behavioral Problems: A Handbook for Understanding and Handling Students. Corwin Press, Thousand Oaks.
[8]
Lane, K.L., Menzies, H.M., Oakes, W.P. and Kalberg, J.R. (2011) Systematic Screenings of Behavior to Support Instruction: From Preschool to High School. Guilford Press, New York.
[9]
Hepburn, L. and Beamish, W. (2019) Towards Implementation of Evidence-Based Practices for Classroom Management in Australia: A Review of Research. Australian Journal of Teacher Education, 44, 82-98. https://doi.org/10.14221/ajte.2018v44n2.6
[10]
Cortes, K.E., Fricke, H., Loeb, S., Song, D.S. and York, B.N. (2023) When Behavioral Barriers Are Too High or Low—How Timing Matters for Text-Based Parenting Interventions. Econ. Economics of Education Review, 92, Article ID: 102352. https://doi.org/10.1016/j.econedurev.2022.102352
[11]
Kern, L., Weist, M.D., Mathur, S.R. and Barber, B.R. (2021) Empowering School Staff to Implement Effective School Mental Health Services. Behavioral Disorders, 47, 207-219. https://doi.org/10.1177/01987429211030860
[12]
Carlock, K., Nygaard, M.A. and Ormiston, H.E. (2023) School Principals’ Perceived Barriers and Facilitators to the Normalization of School-Based Mental Health Services: A Multimethod Investigation. School Mental Health, 15, 940-954. https://doi.org/10.1007/s12310-023-09597-8
[13]
Jenkins, L.N., Demaray, M.K., Wren, N.S., Secord, S.M., Lyell, K.M., Magers, A.M., Setmeyer, A.J., Rodelo, C., Newcomb-McNeal, E. and Tennant, J. (2014) A Critical Review of Five Commonly Used Social-Emotional and Behavioral Screeners for Elementary or Secondary Schools. Contemporary School Psychology, 18, 241-254. https://doi.org/10.1007/s40688-014-0026-6
[14]
Walker, H.M. and Severson, H.H. (1992) Systematic Screening for Behavior Disorders (SSBD). Pacific Northwest Publishing, Longmont.
[15]
Kalberg, J.R., Lane, K.L., Driscoll, S. and Wehby, J. (2011) Systematic Screening for Emotional and Behavioral Disorders at the High School Level. Remedial and Special Education, 32, 506-520. https://doi.org/10.1177/0741932510362508
[16]
Wood, B.J. and Ellis, F. (2022) Universal Mental Health Screening Practices in Midwestern Schools: A Window of Opportunity for School Psychologist Leadership and Role Expansion? Contemporary School Psychology. https://doi.org/10.1007/s40688-022-00430-8
[17]
Kamphaus, R.W. and Reynolds, C.R. (2007) BASC-2 Behavioral and Emotional Screening System. APA, Washington DC. https://doi.org/10.1037/t29902-000
[18]
Lane, K.L., Oakes, W. and Menzies, H. (2010) Systematic Screenings to Prevent the Development of Learning and Behavior Problems: Considerations for Practitioners, Researchers, and Policy Makers. Journal of Disability Policy Studies, 21, 160-172. https://doi.org/10.1177/1044207310379123
[19]
Stiffler, M.C. and Dever, B.V. (2015) Mental Health Screening at School. Springer, Dordrecht. https://doi.org/10.1007/978-3-319-19171-3
[20]
Harrison, J.R., Vannest, K.J. and Reynolds, C.R. (2013) Social Acceptability of Five Screening Instruments for Social, Emotional, and Behavioral Challenges. Behavioral Disorders, 38, 171-189. https://doi.org/10.1177/019874291303800305
[21]
Lane, K.L., Kalberg, J.R., Lambert, E.W., Crnobori, M. and Bruhn, A.L. (2009) A Comparison of Systematic Screening Tools for Emotional and Behavioral Disorders. Journal of Emotional and Behavioral Disorders, 18, 100-112. https://doi.org/10.1177/1063426609341069
[22]
Drummond, T. (1994) Student Risk Screening Scale. APA PsycTests. https://doi.org/10.1037/t27737-000
[23]
Lane, K.L. and Menzies, H.M. (2009) Student Risk Screening Scale for Early Internalizing and Externalizing Behavior (SRSS-IE). https://www.ci3t.org/screening
[24]
Oakes, W.P., Wilder, K.S., Lane, K.L., Powers, L., Yokoyama, L.T.K., O’Hare, M.E. and Jenkins, A.B. (2010) Psychometric Properties of the Student Risk Screening Scale: An Effective Tool for Use in Diverse Urban Elementary Schools. Assessment for Effective Intervention, 35, 231-239. https://doi.org/10.1177/1534508410379796
[25]
Lane, K.L., Bruhn, A.L., Eisner, S.L. and Kalberg, J.R. (2010) Score Reliability and Validity of the Student Risk Screening Scale: A Psychometrically Sound, Feasible Tool for Use in Urban Middle Schools. Journal of Emotional and Behavioral Disorders, 18, 211-224. https://doi.org/10.1177/1063426609349733
[26]
Lane, K.L., Richards-Tutor, C., Oakes, W.P. and Connor, K. (2013) Initial Evidence for the Reliability and Validity of the Student Risk Screening Scale with Elementary Age English Learners. Assessment for Effective Intervention, 39, 219-232. https://doi.org/10.1177/1534508413496836
[27]
Lane, K.L., Buckman, M.M., Common, E.A., Oakes, W.P., Lane, N.A., Schatschneider, C., Perez-Clark, P., Sherod, R.L. and Menzies, H.M. (2020) The Student Risk Screening Scale for Early Childhood: Additional Validation Studies. Topics in Early Childhood Special Education, 41, 129-146. https://doi.org/10.1177/0271121420922299
[28]
Lane, K.L., Menzies, H.M., Oakes, W.P., Lambert, W., Cox, M. and Hankins, K. (2012) A Validation of the Student Risk Screening Scale for Internalizing and Externalizing Behaviors: Patterns in Rural and Urban Elementary Schools. Behavioral Disorders, 37, 244-270. https://doi.org/10.1177/019874291203700405
[29]
Lane, K.L., Oakes, W.P., Swogger, E.D., Schatschneider, C., Menzies, H.M. and Sanchez, J. (2015) Student Risk Screening Scale for Internalizing and Externalizing Behaviors: Preliminary Cut Scores to Support Data-Informed Decision Making. Behavioral Disorders, 40, 159-170. https://doi.org/10.17988/0198-7429-40.3.159
[30]
Lane, K.L., Oakes, W.P., Buckman, M.M., Lane, N.A., Lane, K.S., Fleming, K., Romine, R.E.S., Sherod, R.L., Chang, C.N., Jones, J., et al. (2023) Examination of the Factor Structure and Measurement Invariance of the SRSS-IE. Remedial and Special Education. https://doi.org/10.1177/07419325231193147
[31]
Barger, B., Graybill, E., Roach, A. and Lane, K. (2020) Differential Item and Test Functioning of the SRSS-IE12 across Race, Ethnicity, Gender, and Elementary Level. Assessment for Effective Intervention, 47, 79-88. https://doi.org/10.1177/1534508420976830
[32]
Lane, K.L., Oakes, W.P., Monahan, K., Smith, A., Lane, K.S., Buckman, M.M., Lane, N.A. and Sherod, R. (2023) A Comparison of DESSA-Mini and SRSS-IE Screening Tools. Education and Treatment of Children, 46, 367-381. https://doi.org/10.1007/s43494-023-00106-9
[33]
Li, X., Zhu, Y.T., Jiao, D.D., Sawada, Y., Tanaka, E., Watanabe, T., Tomisaki, E., Zhu, Z., Ajmal, A., Matsumoto, M., et al. (2022) Subtyping of Internalizing and Externalizing Behaviors in Japanese Community-Based Children: A Latent Class Analysis and Association with Family Activities. Children, 9, Article 210. https://doi.org/10.3390/children9020210
[34]
Wild, D., Grove, A., Martin, M., Eremenco, S., McElroy, S., Verjee-Lorenz, A., Erikson, P. and ISPOR Task Force for Translation and Cultural Adaptation (2005) Principles of Good Practice for the Translation and Cultural Adaptation Process for Patient-Reported Outcomes (PRO) Measures: Report of the ISPOR Task Force for Translation and Cultural Adaptation. Value Health, 8, 94-104. https://doi.org/10.1111/j.1524-4733.2005.04054.x
[35]
Schumacker, R.E. and Lomax, R.G. (2004) A Beginner’s Guide to Structural Equation Modeling. 2nd Edition, Lawrence Erlbaum Associates, Mahwah.
[36]
Sousa, V.D. and Rojjanasrirat, W. (2011) Translation, Adaptation and Validation of Instruments or Scales for Use in Cross-Cultural Health Care Research: A Clear and User-Friendly Guideline. Journal of Evaluation in Clinical Practice, 17, 268-274. https://doi.org/10.1111/j.1365-2753.2010.01434.x
[37]
Mondrzak, R., Reinert, C., Sandri, A., Spanemberg, L., Nogueira, E.L., Bertoluci, M., Eizirik, C.L., Furtado, N.R. and Pucrs, B. (2016) Translation and Cross-Cultural Adaptation of the Rating Scale for Countertransference (RSCT) to American English. Trends in Psychiatry and Psychotherapy, 38, 221-226. https://doi.org/10.1590/2237-6089-2015-0078
[38]
Goodman, R. (1997) The Strengths and Difficulties Questionnaire: A Research Note. Journal of Child Psychology and Psychiatry, 38, 581-586. https://doi.org/10.1111/j.1469-7610.1997.tb01545.x
[39]
Goodman, R. (2001) Psychometric Properties of the Strengths and Difficulties Questionnaire. Journal of the American Academy of Child & Adolescent Psychiatry, 40, 1337-1345. https://doi.org/10.1097/00004583-200111000-00015
[40]
Goodman, A. and Goodman, R. (2009) Strengths and Difficulties Questionnaire as a Dimensional Measure of Child Mental Health. Journal of the American Academy of Child & Adolescent Psychiatry, 48, 400-403. https://doi.org/10.1097/CHI.0b013e3181985068
[41]
Muris, P., Meesters, C. and Berg, F.V.D. (2003) The Strengths and Difficulties Questionnaire (SDQ). European Child & Adolescent Psychiatry, 12, 1-8. https://doi.org/10.1007/s00787-003-0298-2
[42]
Bourdon, K.H., Goodman, R., Rae, D.S., Simpson, G. and Koretz, D.S. (2005) The Strengths and Difficulties Questionnaire: U.S. Normative Data and Psychometric Properties. Journal of the American Academy of Child & Adolescent Psychiatry, 44, 557-564. https://doi.org/10.1097/01.chi.0000159157.57075.c8
[43]
Lane, K.L. and Oakes, W.P. (2010) Social validity: Screening Tool Rating Scale.
[44]
Lane, L.K., Oakes, W.P., Cantwell, E.D., Schatschneider, C., Menzies, H., Crittenden, M. and Messenger, M. (2016) Student Risk Screening Scale for Internalizing and Externalizing Behaviors: Preliminary Cut Scores to Support Data-Informed Decision Making in Middle and High Schools. Behavioral Disorders, 42, 271-284. https://doi.org/10.17988/BD-16-115.1
[45]
Cronbach, L.J. and Shavelson, R.J. (2004) My Current Thoughts on Coefficient Alpha and Successor Procedures. Educational and Psychological Measurement, 64, 391-418. https://doi.org/10.1177/0013164404266386
[46]
Furr, R.M. (2011) Scale Construction and Psychometrics for Social and Personality Psychology. SAGE, Thousand Oaks. https://doi.org/10.4135/9781446287866
[47]
Lane, K.L., Oakes, W.P., Harris, P.J., Menzies, H.M., Cox, M. and Lambert, W. (2012) Initial Evidence for the Reliability and Validity of the Student Risk Screening Scale for Internalizing and Externalizing Behaviors at the Elementary Level. Behavioral Disorders, 37, 99-122. https://doi.org/10.1177/019874291203700204
[48]
Gregory, C., Graybill, E.C., Barger, B., Roach, A.T. and Lane, K. (2020) Predictive Validity of the Student Risk Screening Scale-Internalizing and Externalizing (SRSS-IE) Scores. Journal of Emotional and Behavioral Disorders, 29, 105-112. https://doi.org/10.1177/1063426620967283
[49]
Lane, K.L., Oakes, W.P., Cantwell, E.D., Common, E.A., Royer, D.J., Leko, M.M., Schatschneider, C., Menzies, H.M., Buckman, M.M. and Allen, G.E. (2018) Predictive Validity of Student Risk Screening Scale—Internalizing and Externalizing (SRSS-IE) Scores in Elementary Schools. Journal of Emotional and Behavioral Disorders, 27, 221-234. https://doi.org/10.1177/1063426618795443
[50]
Lane, K.L., Oakes, W.P., Menzies, H.M., Major, R., Allegra, L., Powers, L. and Schatschneider, C. (2014) The Student Risk Screening Scale for Early Childhood. Topics in Early Childhood Special Education, 34, 234-249. https://doi.org/10.1177/0271121414544801
[51]
Lane, K.L., Parks, R.J., Kalberg, J.R. and Carter, E.W. (2007) Systematic Screening at the Middle School Level. Journal of Emotional and Behavioral Disorders, 15, 209-222. https://doi.org/10.1177/10634266070150040301
[52]
Lane, K.L., Oakes, W.P., Cantwell, E.D., Royer, D.J., Leko, M.M., Schatschneider, C. and Menzies, H.M. (2018) Predictive Validity of Student Risk Screening Scale for Internalizing and Externalizing Scores in Secondary Schools. Journal of Emotional and Behavioral Disorders, 27, 86-100. https://doi.org/10.1177/1063426617744746
[53]
Lane, K.L., Oakes, W.P., Cantwell, E.D., Menzies, H.M., Schatschneider, C., Lambert, W. and Common, E.A. (2016) Psychometric Evidence of SRSS-IE Scores in Middle and High Schools. Journal of Emotional and Behavioral Disorders, 25, 233-245. https://doi.org/10.1177/1063426616670862
[54]
Lane, K.L., Oakes, W.P., Ennis, R.P., Cox, M.L., Schatschneider, C. and Lambert, W. (2011) Additional Evidence for the Reliability and Validity of the Student Risk Screening Scale at the High School Level. Journal of Emotional and Behavioral Disorders, 21, 97-115. https://doi.org/10.1177/1063426611407339
[55]
Lane, K.L., Oakes, W.P., Common, E.A., Brunsting, N., Zorigian, K., Hicks, T. and Lane, N.A. (2018) A Comparison between SRSS-IE and BASC-2 BESS Scores at the Middle School Level. Behavioral Disorders, 44, 162-174. https://doi.org/10.1177/0198742918794843
[56]
Lane, K.L., Oakes, W.P., Common, E.A., Zorigian, K., Brunsting, N.C. and Schatschneider, C. (2014) A Comparison between SRSS-IE and SSiS-PSG Scores. Assessment for Effective Intervention, 40, 114-126. https://doi.org/10.1177/1534508414560346
[57]
Lane, K.L., Oakes, W.P., Ennis, R.P. and Royer, D.J. (2015) Additional Evidence of Convergent Validity between SRSS-IE and SSiS-PSG Scores. Behavioral Disorders, 40, 213-229. https://doi.org/10.17988/0198-7429-40.4.213
