The purpose of this research was to examine the psychometric properties of the Flow Short Scale by Rheinberg, Vollmeyer, and Engeser in 160 Greek adults. State flow (as opposed to dispositional flow) was measured while participants were involved in a leisure time activity. First, construct validity was evaluated with factor analysis techniques like ICM-CFA, ESEM, Bifactor CFA and Bifactor ESEM. A total of 15 alternative models were evaluated. Two solutions showed optimal fit. First, it was the two-factor structure replicating the original structure but with different item allocation on each factor, probably due to cultural differences. Second, it was a shorter version of FSS with 6 items in the two original factors instead of 10. A MIMIC model indicated a significant direct effect of age on FSS factors thus, population heterogeneity. A significant direct effect on an indicator was also found, hence measurement noninvariance. Reliability (α and ω) was acceptable, but not AVE. Flow had a significant positive, moderately strong relation with emotionality and life satisfaction. In sum, the suggested factor structures for FSS were found to be reliable and valid to use in Greek cultural context.
Awang, Z., Afthanorhan, A., & Asri, M. A. M. (2015). Parametric and Non Parametric Approach in Structural Equation Modeling (SEM): The Application of Bootstrapping. Modern Applied Science, 9, 58-67. https://doi.org/10.5539/mas.v9n9p58
[3]
Bentler, P. M., & Yuan, K. H. (1999). Structural Equation Modeling with Small Samples: Test of Global Self-Esteem. Journal of Personality and Social Psychology, 89, 623-642.
[4]
Berlyne, D. E. (1960). Conflict, Arousal and Curiosity. New York, NY: McGraw-Hill. https://doi.org/10.1037/11164-000
[5]
Boniwell, I. (2012). Positive Psychology in a Nutshell, the Science of Happiness (3rd ed.). England: Open University Press, McGraw-Hill Education.
[6]
Brislin, R., Lonner, W., & Thorndike, R. (1973). Cross-Cultural Research Methods. New York, NY: John Wiley & Sons.
[7]
Brown, T. A. (2015). Confirmatory Factor Analysis for Applied Research (2nd ed.). New York, NY: Guilford Publications.
[8]
Brunner, M., Nagy, G., & Wilhelm, O. (2012). A Tutorial on Hierarchically Structured Constructs. Journal of Personality, 80, 796-846. https://doi.org/10.1111/j.1467-6494.2011.00749.x
[9]
Comrey, A. L. (1988). Factor Analytic Methods of Scale Development in Personality and Clinical Psychology. Journal of Consulting and Clinical Psychology, 56, 754-761. https://doi.org/10.1037/0022-006X.56.5.754
[10]
Comrey, A. L., & Lee, H. B. (1992). A First Course in Factor Analysis (2nd ed.). Hillsdale, NJ: Erlbaum.
[11]
Cortina, J. M. (1993). What Is Coefficient Alpha? An Examination of Theory and Applications. Journal of Applied Psychology, 78, 98-104. https://doi.org/10.1037/0021-9010.78.1.98
[12]
Crawford, J. R., & Henry, J. D. (2004). The Positive and Negative Affect Schedule (PANAS): Construct Validity, Measurement Properties and Normative Data in a Large Non-Clinical Sample. British Journal of Clinical Psychology, 43, 245-265. https://doi.org/10.1348/0144665031752934
[13]
Cronbach, L. J. (1951). Coefficient Alpha and the Internal Structure of Tests. Psychometrika, 16, 297-334. https://doi.org/10.1007/BF02310555
[14]
Csikszentmihalyi, M. (1975/2000). Beyond Boredom and Anxiety: Experiencing Flow in Work and Play (2nd ed.). San Francisco, CA: Jossey Bass.
[15]
Csikszentmihalyi, M. (1978). Attention and the Holistic Approach to Behavior. In K. S. Pope, & J. L. Singer (Eds.), The Stream of Consciousness (pp. 335-356). New York: Plenum. https://doi.org/10.1007/978-1-4684-2466-9_13
[16]
Csikszentmihalyi, M. (1990). Flow: The Psychology of Optimal Experience. New York, NY: Harper Perennial.
[17]
Csikszentmihalyi, M. (1996). Creativity. New York, NY: HarperCollins.
[18]
Csikszentmihalyi, M. (2014). Flow and the Foundations of Positive Psychology. The Netherlands: Springer. https://doi.org/10.1007/978-94-017-9088-8
[19]
Csikszentmihalyi, M., & Csikszentmihalyi, I. (1988). Optimal Experience: Psychological Studies of Flow in Consciousness. Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9780511621956
[20]
Csikszentmihalyi, M., & LeFevre, J. (1989). Optimal Experience in Work and Leisure. Journal of Personality and Social Psychology, 56, 815-822. https://doi.org/10.1037/0022-3514.56.5.815
[21]
Csikszentmihalyi, M., & Robinson, R. (1990). The Art of Seeing. Malibu, CA: J. Paul Getty Museum and the Getty Center for Education in the Arts.
[22]
Csikszentmihalyi, M., Larson, R. J., & Prescott, S. (1977). The Ecology of Adolescent Activity and Experience. Journal of Youth and Adolescence, 6, 281-294. https://doi.org/10.1007/BF02138940
[23]
Debus, M. E., Sonnentag, S., Deutsch, W., & Nussbeck, F. W. (2014). Making Flow Happen: The Effects of Being Recovered on Work-Related Flow between and within Days. Journal of Applied Psychology, 99, 713-722. https://doi.org/10.1037/a0035881
[24]
DeCharms, R. (1968). Personal Causation. New York, NY: Academic Press.
[25]
Deci, E. L., & Ryan, R. M. (1980). The Empirical Exploration of Intrinsic Motivational Processes. In L. Berkowitz (Ed.), Advances in Experimental Social Psychology (pp. 39-80). New York, NY: Academic Press. https://doi.org/10.1016/S0065-2601(08)60130-6
[26]
Delle Fave, A. (2013). Past, Present and Future of Flow. In S. A. David, I. Boniwell, & A. ConleyAyers (Eds.), The Oxford Handbook of Happiness (pp. 60-72). New York, NY: Oxford University Press. https://doi.org/10.1093/oxfordhb/9780199557257.013.0005
[27]
DeVellis, R. F. (2017). Scale Development: Theory and Applications (4th ed.). Thousand Oaks, CA: Sage.
[28]
Diener, E., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985). The Satisfaction with Life Scale. Journal of Personality Assessment, 49, 71-75. https://doi.org/10.1207/s15327752jpa4901_13
[29]
Diener, E., Wirtz, D., Biswas-Diener, R., Tov, W., Kim-Prieto, C., Choi, D., et al. (2009). New Measures of Well-Being. The Netherlands: Springer. https://doi.org/10.1007/978-90-481-2354-4_12
[30]
Diener, E., Wirtz, D., Tov, W., Kim-Prieto, C., Choi, D., Oishi, S., & Biswas-Diener, R. (2010). New Well-Being Measures: Short Scales to Assess Flourishing and Positive and Negative Feelings. Social Indicators Research, 97, 143-156. https://doi.org/10.1007/s11205-009-9493-y
[31]
Doornik, J. A., & Hansen, H. (2008). An Omnibus Test for Univariate and Multivariate Normality. Oxford Bulletin of Economics and Statistics, 70, 927-939. https://doi.org/10.1111/j.1468-0084.2008.00537.x
[32]
Ellis, G. D., Voelkl, J. E., & Morris, C. (1994). Measurements and Analysis Issues with Explanation of Variance in Daily Experience Using the Flow Model. Journal of Leisure Research, 26, 337-356. https://doi.org/10.1080/00222216.1994.11969966
[33]
Engeser, S. (2012). Advances in Flow Research. New York, NY: Springer. https://doi.org/10.1007/978-1-4614-2359-1
[34]
Engeser, S., & Rheinberg, F. (2008). Flow Performance and Moderators of Challenge-Skill Balance. Motivation & Emotion, 32, 158-172. https://doi.org/10.1007/s11031-008-9102-4
[35]
Engeser, S., & Schiepe-Tiska, A. (2012). Historical Lines and an Overview of Current Research on Flow. In S. Engeser (Ed.), Advances in Flow Research (pp. 1-22). New York: Springer.
[36]
Fornell, C., & Larcker, D. F. (1981). Structural Equation Models with Unobservable Variables and Measurement Error: Algebra and Statistics. Journal of Marketing Research, 18, 382-388. https://doi.org/10.2307/3150980
[37]
Fullagar, C., Delle Fave, A., & Van Krevelen, S. (2017). Flow at Work: The Evolution of a Construct. In C. Fullagar, A. Delle Fave, & S. Van Krevelen (Eds.), Flow at Work, Measurement and Implications (pp. 1-39). New York: Routledge.
[38]
Getzels, J. W., & Csikszentmihalyi, M. (1976). The Creative Vision. New York, NY: Wiley.
[39]
Goldberg, I. I., Harel, M., & Malach, R. (2006). When the Brain Loses Its Self: Prefrontal Inactivation during Sensorimotor Processing. Neuron, 50, 329-339. https://doi.org/10.1016/j.neuron.2006.03.015
[40]
Green, S. B., Lissitz, R. W., & Mulaik, S. A. (1977). Limitations of Coefficient Alpha as an Index of Test Unidimensionality. Educational and Psychological Measurement, 37, 827-836. https://doi.org/10.1177/001316447703700403
[41]
Hair, J., Black, W., Babin, B., & Anderson, R. (2010). Multivariate Data Analysis (7th ed.). Upper Saddle River, NJ: Prentice-Hall, Inc.
[42]
Hammer, J. H., & Toland, M. D. (2016). Bifactor Analysis in Mplus. Lexington, KY: University of Kentucky. http://sites.education.uky.edu/apslab/upcoming-events/
[43]
Hebb, D. O. (1955). Drives and the CNS. Psychological Review, 62, 243-254. https://doi.org/10.1037/h0041823
[44]
Henze, N., & Zirkler, B. (1990). A Class of Invariant Consistent Tests for Multivariate Normality. Communications in Statistics-Theory and Methods, 19, 3595-3617. https://doi.org/10.1080/03610929008830400
[45]
Hoque, A. S., Awang, Z., Jusoff, K., Salleh, F., &Muda, H. (2017). Social Business Efficiency: Instrument Development and Validation Procedure Using Structural Equation Modeling. International Business Management, 11, 222-231.
[46]
Howard, J., Gagné, M., Morin, A. J. S., Wang, Z. N., & Forest, J. (2016). Using Bifactor Exploratory Structural Equation Modeling to Test for a Continuum Structure of Motivation. Journal of Management, 1-59.
[47]
Hu, L., & Bentler, P. M. (1999). Cutoff Criteria for Fit Indexes in Covariance Structure Analysis: Conventional Criteria versus New Alternatives. Structural Equation Modeling, 6, 1-55. https://doi.org/10.1080/10705519909540118
[48]
Hunt, J. (1965). Intrinsic Motivation and Its Role in Development. Nebraska Symposium on Motivation, 12, 189-282.
[49]
IBM Corporation (2017). IBM SPSS Statistical Software, Release 25. Spring House, PA: IBM Corporation.
[50]
Jackson, S. (1995). Factors Influencing the Occurrence of Flow State in Elite Athletes. Journal of Applied Sport Psychology, 7, 138-166. https://doi.org/10.1080/10413209508406962
[51]
Jackson, S. (1996). Toward a Conceptual Understanding of the Flow Experience in Elite Athletes. Research Quarterly for Exercise and Sport, 67, 76-90. https://doi.org/10.1080/02701367.1996.10607928
[52]
Jackson, S. A., & Csikszentmihalyi, M. (1999). Flow in Sports: The Keys to Optimal Experiences and Performances. Champaign, IL: Human Kinetics.
[53]
Jackson, S. A., & Eklund, R. C. (2002). Assessing Flow in Physical Activity: The Flow State Scale-2 and Dispositional Flow Scale-2. Journal of Sport & Exercise Psychology, 24, 133-150. https://doi.org/10.1123/jsep.24.2.133
[54]
Jackson, S. A., & Eklund, R. C. (2004). Relationships between Quality of Experience and Participation in Diverse Performance Settings. Australian Journal of Psychology, 56, 193.
[55]
Jackson, S. A., & Marsh, H. W. (1996). Development and Validation of a Scale to Measure Optimal Experience: The Flow State Scale. Journal of Sport & Exercise Psychology, 18, 17-35. https://doi.org/10.1123/jsep.18.1.17
[56]
Jackson, S. A., Thomas, P. R., Marsh, H. W., & Smethurst, C. J. (2001). Relationships between Flow, Self-Concept, Psychological Skills, and Performance. Journal of Applied Sport Psychology, 13, 129-153. https://doi.org/10.1080/104132001753149865
[57]
Joshanloo, M., & Jovanovic, V. (2016). The Factor Structure of the Mental Health Continuum-Short Form (MHC-SF) in Serbia: An Evaluation Using Exploratory Structural Equation Modeling. Journal of Mental Health, 26, 510-515. https://doi.org/10.1080/09638237.2016.1222058
[58]
Joshanloo, M., Jose, P. E., & Kielpikowski, M. (2017). The Value of Exploratory Structural Equation Modeling in Identifying Factor Overlap in the Mental Health Continuum-Short Form (MHC-SF): A Study with a New Zealand Sample. Journal of Happiness Studies, 8, 1061-1074. https://doi.org/10.1007/s10902-016-9767-4
[59]
Keller, J., & Bless, H. (2008). Flow and Regulatory Compatibility: An Experimental Approach to the Flow Model of Intrinsic Motivation. Journal of Personality and Social Psychology Bulletin, 34, 196-209. https://doi.org/10.1177/0146167207310026
[60]
Keller, J., & Landhäußer, A. (2012). The Flow Model Revisited. In S. Engeser (Ed.), Advances in Flow Research (pp. 51-64). New York: Springer. https://doi.org/10.1007/978-1-4614-2359-1_3
[61]
Kline, P. (1999). Handbook of Psychological Testing. London: Routledge.
[62]
Kline, R. B. (2016). Principles and Practice of Structural Equation Modeling (4th ed.). New York, NY: The Guilford Press.
[63]
Kyriazos, T. A., Stalikas, A., Prassa, K., Yotsidi, V. (2018). A 3-Faced Construct Validation and a Bifactor Subjective Well-Being Model Using the Scale of Positive and Negative Experience, Greek Version. Psychology, 9, 1143-1175. https://doi.org/10.4236/psych.2018.95071
[64]
Malhotra, N. K., & Dash, S. (2011). Marketing Research an Applied Orientation. London: Pearson Publishing.
[65]
Mardia, K. V. (1970). Measures of Multivariate Skewness and Kurtosis with Applications. Biometrika, 57, 519-530. https://doi.org/10.1093/biomet/57.3.519
[66]
Marsh, H. W., Ludtke, O., Nagengast, B., Morin, A. J. S., & Von Davier, M. (2013). Why Item Parcels Are (Almost) Never Appropriate: Two Wrongs Do Not Make a Right—Camouflaging Misspecification with Item Parcels in CFA Models. Psychological Methods, 18, 257-284. https://doi.org/10.1037/a0032773
[67]
Marsh, H. W., Morin, A. J. S., Parker, P. D., & Kaur, G. (2014). Exploratory Structural Equation Modeling: An Integration of the Best Features of Exploratory and Confirmatory Factor Analysis. Annual Review of Clinical Psychology, 10, 85-110. https://doi.org/10.1146/annurev-clinpsy-032813-153700
[68]
Massey, F. J. (1951). The Kolmogorov-Smirnov Tests for Goodness of Fit. Journal of American Statistical Association, 46, 68-78. https://doi.org/10.1080/01621459.1951.10500769
[69]
Massimini, F., & Delle Fave, A. (2000). Individual Development in a Bio-Cultural Perspective. American Psychologist, 55, 24-33. https://doi.org/10.1037/0003-066X.55.1.24
[70]
McDonald, R. P. (1999). Test Theory: A Unified Treatment. Mahwah, NJ: Erlbaum.
[71]
McReynolds, P. (1971). The Nature and Assessment of Intrinsic Motivation. In P. McReynolds (Ed.), Advances in Psychological Assessment (Vol. 2, pp. 157-177). Palo Alto: Science and Behavior Books.
[72]
Moneta, G. B. (2012). On the Measurement and Conceptualization of Flow. In S. Engeser (Ed.), Advances in Flow Research (pp. 23-50). New York, NY: Springer. https://doi.org/10.1007/978-1-4614-2359-1_2
[73]
Moneta, G. B., & Csikszentmihalyi, M. (1996). The Effect of Perceived Challenges and Skills on the Quality of Subjective Experience. Journal of Personality, 64, 274-310. https://doi.org/10.1111/j.1467-6494.1996.tb00512.x
[74]
Muthén, B. (1989). Latent Variable Modeling in Heterogeneous Populations. Psychometrika, 54, 557-585. https://doi.org/10.1007/BF02296397
[75]
Muthen, B., & Asparouhov, T. (2002). Using Mplus Monte Carlo Simulations in Practice: A Note on Non-Normal Missing Data in Latent Variable Models. Mplus Web Notes: No. 2.
[76]
Muthen, L. K., & Muthen, B. O. (2012). Mplus Statistical Software, 1998-2012. Los Angeles, CA: Muthén & Muthén.
[77]
Nakamura, J. (1988). Optimal Experience and the Uses of Talent. In M. Csikszentmihalyi, & I. Csikszentmihalyi (Eds.), Optimal Experience: Psychological Studies of Flow in Consciousness (pp. 319-326). Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9780511621956.019
[78]
Nakamura, J., & Csikszentmihalyi, M. (2005). The Concept of Flow. In C. R. Snyder, & S. J. Lopez (Eds.), Handbook of Positive Psychology (pp. 89-105). Oxford: University Press.
[79]
Novak, T. P., Hoffman, D. L., & Yung, Y. (1997). Measuring the Flow Experience among Web Users. Paper Presented at the Interval Research Corporation, Project 2000, Vanderbilt University.
[80]
Nunnally, J., & Berstein, I. (1995). Psychometric Theory. New York, NY: McGraw-Hill.
[81]
Pavot, W., & Diener, E. (1993). The Affective and Cognitive Context of Self-Reported Measures of Subjective Well-Being. Social Indicators Research, 28, 1-20. https://doi.org/10.1007/BF01086714
[82]
Pavot, W., & Diener, E. (2008). The Satisfaction with Life Scale and the Emerging Construct of Life Satisfaction. The Journal of Positive Psychology, 3, 137-152. https://doi.org/10.1080/17439760701756946
[83]
Perry, S. K. (1999). Writing in Flow. Cincinnati, OH: Writer’s Digest Books.
[84]
Pfister R. (2002). Flow im Alltag. Untersuchungen zum Quadrantenmodell des Flow-Erlebens und zum Konzept der autotelischen Personlichkeit mit der Experience Sampling Method (ESM) [Flow in Everyday Life: Studies on the Quadrant Model of Flow Experiencing and on the Concept of the Autotelic Personality with the Experience Sampling Method (ESM)]. Bern: Peter Lang.
[85]
Puca, R. M., & Schmalt, H. D. (1999). Task Enjoyment: A Mediator between Achievement Motives and Performance. Motivation and Emotion, 23, 15-29. https://doi.org/10.1023/A:1021327300925
[86]
Quinn, R. W. (2005). Flow in Knowledge Work: High Performance Experience in the Design of National Security Technology. Administrative Science Quarterly, 50, 610-641. https://doi.org/10.2189/asqu.50.4.610
[87]
Reise, S. (2012). The Rediscovery of Bifactor Measurement Models. Multivariate Behavioral Research, 47, 667-696. https://doi.org/10.1080/00273171.2012.715555
[88]
Reise, S. P., Morizot, J., & Hays, R. D. (2007). The Role of the Bifactor Model in Resolving Dimensionality Issues in Health Outcomes Measures. Quality of Life Research, 16, 19-31. https://doi.org/10.1007/s11136-007-9183-7
[89]
Rheinberg, F. (2008). Intrinsic Motivation and Flow-Experience. In H. Heckhausen, & J. Heckhausen (Eds.), Motivation and Action (pp. 323-348). Cambridge, UK: Cambridge University Press. https://doi.org/10.1017/CBO9780511499821.014
[90]
Rheinberg, F., Manig, Y., Kliegl, R., Engeser, S., & Vollmeyer, R. (2007). Flow bei der Arbeit,doch Glóck in der Freizeit [Flow during Work but Happiness during Leisure Time: Goals, Flow-Experience, and Happiness]. Zeitschrift fór Arbeitsund Organisationspsychologie [Journal of Work and Organizational Psychology], 51, 105-115.
[91]
Rheinberg, F., Vollmeyer, R., & Engeser, S. (2003). Die Erfassung des Flow-Erlebens [The Assessment of Flow Experience]. In J. Stiensmeier-Pelster, & F. Rheinberg (Eds.), Diagnostik von Selbstkonzept, Lernmotivation und Selbstregulation [Diagnosis of Motivation and Self-Concept]. Göttingen: Hogrefe.
[92]
Sahoo, F. M., & Sahu, R. (2009). The Role of Flow Experience in Human Happiness. Journal of the Indian Academy of Applied Psychology, 35, 40-47.
[93]
Schmid, J., & Leiman, J. N. (1957). The Development of Hierarchical Factor Solutions. Psychometrika, 22, 53-61. https://doi.org/10.1007/BF02289209
[94]
Schuler, J. (2010). Achievement Incentives Determine the Effects of Achievement-Motive Incongruence on Flow Experience. Motivation and Emotion, 34, 2-14. https://doi.org/10.1007/s11031-009-9150-4
[95]
Seligman, E. P. (2002). Authentic Happiness. New York, NY: Free Press.
[96]
Singh, K., Junnarkar, M., & Kaur, J. (2016). Measures of Positive Psychology, Development and Validation. Berlin: Springer. https://doi.org/10.1007/978-81-322-3631-3
