All Title Author
Keywords Abstract

PLOS ONE  2011 

Psychometric Properties of the Nurses Work Functioning Questionnaire (NWFQ)

DOI: 10.1371/journal.pone.0026565

Full-Text   Cite this paper   Add to My Lib


Objectives The Nurses Work Functioning Questionnaire (NWFQ) is a 50-item self-report questionnaire specifically developed for nurses and allied health professionals. Its seven subscales measure impairments in the work functioning due to common mental disorders. Aim of this study is to evaluate the psychometric properties of the NWFQ, by assessing reproducibility and construct validity. Methods The questionnaire was administered to 314 nurses and allied health professionals with a re-test in 112 subjects. Reproducibility was assessed by the intraclass correlations coefficients (ICC) and the standard error of measurement (SEM). For construct validity, correlations were calculated with a general work functioning scale, the Endicott Work Productivity Scale (EWPS) (convergent validity) and with a physical functioning scale (divergent validity). For discriminative validity, a Mann Whitney U test was performed testing for significant differences between subjects with mental health complaints and without. Results All subscales showed good reliability (ICC: 0.72–0.86), except for one (ICC = 0.16). Convergent validity was good in six subscales, correlations ranged from 0.38–0.62. However, in one subscale the correlation with the EWPS was too low (0.22). Divergent validity was good in all subscales based on correlations ranged from (?0.06)–(?0.23). Discriminative validity was good in all subscales, based on significant differences between subjects with and without mental health complaints (p<0.001–p = 0.003). Conclusion The NWFQ demonstrates good psychometric properties, for six of the seven subscales. Subscale “impaired decision making” needs improvement before further use.


[1]  Hultman B, Hemlin S, Hornquist JO (2006) Quality of life among unemployed and employed people in northern Sweden. Are there any differences? Work 26: 47–56.
[2]  Aronsson G, Gustafsson K, Dallner M (2000) Sick but yet at work. An empirical study of sickness presenteeism. J Epidemiol Community Health 54: 502–509.
[3]  Hilton MF, Scuffham PA, Sheridan J, Cleary CM, Whiteford HA (2008) Mental ill-health and the differential effect of employee type on absenteeism and presenteeism. J Occup Environ Med 50: 1228–1243. 10.1097/JOM.0b013e31818c30a8 [doi];00043764-200811000-00004 [pii].
[4]  Lerner D, Adler DA, Chang H, Berndt ER, Irish JT, et al. (2004) The clinical and occupational correlates of work productivity loss among employed patients with depression. J Occup Environ Med 46: S46–S55. 00043764-200406001-00006 [pii].
[5]  Lerner D, Henke RM (2008) What does research tell us about depression, job performance, and work productivity? J Occup Environ Med 50: 401–410. 10.1097/JOM.0b013e31816bae50 [doi];00043764-200804000-00005 [pii].
[6]  McKnight PE, Kashdan TB (2009) The importance of functional impairment to mental health outcomes: a case for reassessing our goals in depression treatment research. Clin Psychol Rev 29: 243–259. S0272-7358(09)00006-3 [pii];10.1016/j.cpr.2009.01.005 [doi].
[7]  Bultmann U, Kant I, Kasl SV, Beurskens AJ, van den Brandt PA (2002) Fatigue and psychological distress in the working population: psychometrics, prevalence, and correlates. J Psychosom Res 52: 445–452. S0022399901002288 [pii].
[8]  Wieclaw J, Agerbo E, Mortensen PB, Bonde JP (2006) Risk of affective and stress related disorders among employees in human service professions. Occup Environ Med 63: 314–319. 63/5/314 [pii];10.1136/oem.2004.019398 [doi].
[9]  G?rtner FR, Nieuwenhuijsen K, van Dijk FJ, Sluiter JK (2010) The impact of common mental disorders on the work functioning of nurses and allied health professionals: A systematic review. Int J Nurs Stud. S0020-7489(10)00115-X [pii];10.1016/j.ijnurstu.2010.03.013 [doi].
[10]  Suzuki K, Ohida T, Kaneita Y, Yokoyama E, Miyake T, et al. (2004) Mental health status, shift work, and occupational accidents among hospital nurses in Japan. J Occup Health 46: 448–454. JST.JSTAGE/joh/46.448 [pii].
[11]  Adler DA, McLaughlin TJ, Rogers WH, Chang H, Lapitsky L, et al. (2006) Job performance deficits due to depression. Am J Psychiatry 163: 1569–1576. 163/9/1569 [pii];10.1176/appi.ajp.163.9.1569 [doi].
[12]  Aronsson G, Gustafsson K (2005) Sickness presenteeism: prevalence, attendance-pressure factors, and an outline of a model for research. J Occup Environ Med 47: 958–966. 00043764-200509000-00011 [pii].
[13]  Burton WN, Conti DJ, Chen CY, Schultz AB, Edington DW (1999) The role of health risk factors and disease on worker productivity. J Occup Environ Med 41: 863–877.
[14]  Burton WN, Pransky G, Conti DJ, Chen CY, Edington DW (2004) The association of medical conditions and presenteeism. J Occup Environ Med 46: S38–S45. 00043764-200406001-00005 [pii].
[15]  Haslam C, Atkinson S, Brown S, Haslam RA (2005) Perceptions of the impact of depression and anxiety and the medication for these conditions on safety in the workplace. Occup Environ Med 62: 538–545. 62/8/538 [pii];10.1136/oem.2004.016196 [doi].
[16]  Pilette PC (2005) Presenteeism in nursing: a clear and present danger to productivity. J Nurs Adm 35: 300–303.
[17]  Schultz AB, Edington DW (2007) Employee health and presenteeism: a systematic review. J Occup Rehabil 17: 547–579. 10.1007/s10926-007-9096-x [doi].
[18]  Stewart WF, Ricci JA, Chee E, Hahn SR, Morganstein D (2003) Cost of lost productive work time among US workers with depression. JAMA 289: 3135–3144. 10.1001/jama.289.23.3135 [doi];289/23/3135 [pii].
[19]  Nieuwenhuijsen K, Franche RL, van Dijk FJ (2010) Work functioning measurement: tools for occupational mental health research. J Occup Environ Med 52: 778–790. 10.1097/JOM.0b013e3181ec7cd3 [doi].
[20]  Reilly MC, Zbrozek AS, Dukes EM (1993) The validity and reproducibility of a work productivity and activity impairment instrument. Pharmacoeconomics 4: 353–365.
[21]  Lerner D, Amick BC III, Rogers WH, Malspeis S, Bungay K, et al. (2001) The Work Limitations Questionnaire. Med Care 39: 72–85.
[22]  G?rtner FR, Nieuwenhuijsen K, van Dijk FJ, Sluiter JK (2010) Impaired work functioning due to common mental disorders in nurses and allied health professionals: the Nurses Work Functioning Questionnaire (NWFQ).
[23]  Koopman C, Pelletier KR, Murray JF, Sharda CE, Berger ML, et al. (2002) Stanford presenteeism scale: health status and employee productivity. J Occup Environ Med 44: 14–20.
[24]  de Vet HC, Terwee CB, Knol DL, Bouter LM (2006) When to use agreement versus reliability measures. J Clin Epidemiol 59: 1033–1039. S0895-4356(06)00029-1 [pii];10.1016/j.jclinepi.2005.10.015 [doi].
[25]  Streiner DL, Norman GR (2008) Health measurement scales: a practical guide to their development and use. Oxford: Oxford University Press.
[26]  Endicott J, Nee J (1997) Endicott Work Productivity Scale (EWPS): a new measure to assess treatment effects. Psychopharmacol Bull 33: 13–16.
[27]  Goldberg D, Bridges K, Duncan-Jones P, Grayson D (1988) Detecting anxiety and depression in general medical settings. BMJ 297: 897–899.
[28]  Bultmann U, Kant IJ, Kasl SV, Schroer KA, Swaen GM, et al. (2002) Lifestyle factors as risk factors for fatigue and psychological distress in the working population: prospective results from the Maastricht Cohort Study. J Occup Environ Med 44: 116–124.
[29]  Terluin B (1998) De Vierdimensionele Klachtenlijst (4DKL) in de huisartspraktijk [The Four Dimensional Symptom Questionnaire (4DSQ)]. De Psycholoog 33: 18–24.
[30]  Terluin B, van Marwijk HW, Ader HJ, de Vet HC, Penninx BW, et al. (2006) The Four-Dimensional Symptom Questionnaire (4DSQ): a validation study of a multidimensional self-report questionnaire to assess distress, depression, anxiety and somatization. BMC Psychiatry 6: 34. 1471-244X-6-34 [pii];10.1186/1471-244X-6-34 [doi].
[31]  Terluin B, van Rhenen W, Schaufeli WB, De Haan M (2004) The four-dimensional symptom questionnaire (4DSQ): measuring distress and other mental health problems in a working population. Work Stress 18: 187–207.
[32]  van Rhenen W, van Dijk FJ, Schaufeli WB, Blonk RW (2008) Distress or no distress, that's the question: A cutoff point for distress in a working population. J Occup Med Toxicol 3: 3. 1745-6673-3-3 [pii];10.1186/1745-6673-3-3 [doi].
[33]  Jenkinson C, Layte R, Coulter A, Wright L (1996) Evidence for the sensitivity of the SF-36 health status measure to inequalities in health: results from the Oxford healthy lifestyles survey. J Epidemiol Community Health 50: 377–380.
[34]  Ware JE Jr, Gandek B (1998) Overview of the SF-36 Health Survey and the International Quality of Life Assessment (IQOLA) Project. J Clin Epidemiol 51: 903–912. S0895-4356(98)00081-X [pii].
[35]  Brazier JE, Harper R, Jones NM, O'Cathain A, Thomas KJ, et al. (1992) Validating the SF-36 health survey questionnaire: new outcome measure for primary care. BMJ 305: 160–164.
[36]  Bland JM, Altman DG (1986) Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1: 307–310.
[37]  Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, et al. (2007) Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol 60: 34–42. S0895-4356(06)00174-0 [pii];10.1016/j.jclinepi.2006.03.012 [doi].
[38]  Mantha S, Roizen MF, Fleisher LA, Thisted R, Foss J (2000) Comparing methods of clinical measurement: reporting standards for bland and altman analysis. Anesth Analg 90: 593–602.
[39]  Mcgraw KO, Wong SP (1996) Forming inferences about some intraclass correlation coefficients. Psychological Methods 1: 30–46.
[40]  Innes E, Straker L (1999) Validity of work-related assessments. Work 13: 125–152.


comments powered by Disqus