Published online Jul 26, 2021.
https://doi.org/10.3346/jkms.2021.36.e216
Development and Verification of an Internet Game Literacy Scale
Abstract
Background
Education on internet games for parents and internet game literacy are needed to prevent problematic internet game playing in Korea. We created an 18-item Internet Game Literacy Scale (IGLS). It is a valuable tool for assessing the positive and negative aspects of internet game play. We aimed to determine the validity of the IGLS and the cut-off for the tendency for internet gameplay.
Methods
An online research company gathered data from 300 participants. Factor analysis, including Cronbach's α and consistency coefficient, exploratory factor analysis, and confirmatory factor analysis were conducted to verify the 18 items of the IGLS. Additionally, a K-means cluster analysis was performed to determine the cut-off values for positive and negative IGLS scores.
Results
The 18 items of the IGLS were proven to be reliable, as evidenced by a high Cronbach's alpha (α = 0.892). The Kaiser-Meyer-Olkin measure of sampling adequacy was 0.903, and Bartlett's test of sphericity was good (χ2 = 1,623.314, P < 0.001). All 18 items were segregated into two factors, with nine items each. The eigenvalue of all 18 items was significant at > 0.4. In the analysis of the validity of the 18-item IGLS with confirmatory factor analysis (CFA) (maximum likelihood estimation, with an oblique method), the fit indices of the standard three-factor model reached acceptable standards. The cut-off point of the total score between the low positive and average positive groups was 23, and the cut-off point of the total score between the average positive and high positive groups was 30. The cut-off point of the total score between the low negative and the average negative groups was 24. The cut-off point of the total score between the average negative group and the high negative group was 32.
Conclusion
The study assessed the reliability and validity of the IGLS and suggested a cut-off for low, average, and high Internet game literacy degree with 300 Korean adults aged 21–49 years. The current results suggest that the IGLS has good internal consistency and a proper cut-off for positive and negative internet game literacy degrees.
Graphical Abstract
INTRODUCTION
Internet games are the most popular entertainment applications among online activities. Furthermore, children and adolescents demonstrate high attachment to internet gameplaying.1, 2 In a 2019 Korea Creative Content Agency (KOCCA) survey, about 70% of South Koreans stated that they were playing internet games. Of these, 60% of the survey participants indicated that they played mobile games, while 40% indicated that they played personal computer games.3 A total of 74.4% of Korean adolescents aged 13–19 years played internet games for leisure. Nevertheless, internet gameplaying has been linked to many negative consequences, including failure in school and social activities, job loss, and increased family conflicts.4
In Korea, there have been several problems with adolescents' internet gameplay in recent decades. To prevent problematic internet gameplaying in Korea, the “Game Shutdown System” was implemented on November 20, 2011, and was finally legalized on April 24, 2014.5 The system could ban children aged ≤ 16 years from playing internet games between midnight and 6:00 a.m.5 However, Sung6 reported that the game shutdown system was not effective in preventing internet gaming disorder in children and adolescents. According to critics of the Game Shutdown Law, the law violated children's civil rights. The government could not show that playing internet games was more harmful than watching television or movies, listening to music, or engaging in other indoor activities.7 In Korea, a selective shutdown system has been suggested to overcome the shortcomings of the Game Shutdown System.7 A selective game shutdown system where parents regulate their children's internet gameplay through controlling internet gaming data and login times may be implemented.6, 7 Parents are given control on the regulation of the permission and duration of their children's internet gameplay; hence, their perception of internet games is fundamental in addressing internet gaming disorder in Korea.
Internet games for parents and internet game literacy are needed to reduce the strength of the selective game shutdown system and compensate for these shortcomings. Adolescent patterns of internet use and internet gameplay are closely associated with their parents' perception of internet gameplay.8, 9 The experience of internet gameplay and intimacy for game cultures in adults could narrow the gaps in internet game culture and behaviors between adolescents and adults.10 However, there have been a few scoring systems to determine the degree of internet game literacy. In a focused group interview of KOCCA, 30 parents, teachers, and health caregivers reported that internet games could be a good material for leisure time; internet games could also contribute economically in the Korean industry. However, the players were at risk for problematic internet gameplay.11 Based on these results, the KOCCA 2018 version of the game literacy scale was developed and verified with 217 healthy adults. In an online survey of 1,000 healthy adults, Kim et al.12 classified four internet game perception styles: 1) “online game is an obstacle of study,” 2) “online game is just a game,” 3) “online game is a stain in life,” and 4) “online game is vaguely bad.”
Considering these surveys, we created an 18-item questionnaire called the Internet Game Literacy Scale (IGLS). We hypothesized that the IGLS would be a valuable tool for assessing the positive or negative perceptions towards internet gameplay. We aimed to demonstrate the validity of the IGLS and the cut-off for the tendency for internet gameplay.
METHODS
Participants
An online research company (Embrain®, Seoul, Korea) collected data from 300 participants to verify 18 items of the IGLS (Table 1). They sent invitation e-mail letters to 170,000 members of the Embrain company who had already agreed to participate in the research from January 18, 2021, to January 25, 2021. Their ages ranged from 20 to 49 years. The participants were classified into three groups: 20-29 years old, 30–39 years old, and 40–49 years old. The data of 100 participants (50 males and 50 females) in each age group were accepted in the following order: first answered, first accepted, in order to achieve equal distribution of sex and age among the participants (Table 2). Once the answers of 100 participants in each age group were gathered, no more data were collected in that age group. Each participant received $15 as compensation for the completion of the questionnaire.
Table 1
The items of the Internet Game Literacy Scale
Table 2
General descriptions of the population in this research
Development of IGLS
The IGLS was designed to measure the general perception of internet games. Eighteen items were rated using a five-point Likert scale, with 1 representing “strongly disagree,” 2: “disagree,” 3: “neutral,” 4: “agree,” and 5: “strongly agree.” The IGLS consists of nine positive internet game literacy scales and nine negative internet game literacy scales (Table 1). The 18 items of the IGLS were extracted from 11 items (six positive internet game literacy and five negative internet game literacy) in the report of the focused group interview of KOCCA11 and seven items (three positive Internet game literacy and four negative Internet game literacy) from the online game perception type as described by Kim et al.12
Statistical analysis
The factor analysis for items of the IGLS included Cronbach's α and the consistency coefficient. In the analysis of the validity of the IGLS with the exploratory factor analysis (EFA), the Kaiser-Meyer-Olkin Measure (KMO) of sampling adequacy was applied using the extraction method with maximum likelihood, rotation method, and oblimin with Kaiser normalization.
To determine how well the original two-factor model fits the Korean adult sample, we performed a confirmatory factor analysis (CFA). We evaluated five fit indices to examine the model fit: χ2 test, comparative fit index, Tucker-Lewis index (TLI), root-mean-square error of approximation (RMSEA), and standardized root mean square residual (SRMR). The following standards were used to evaluate the model fit: CFI of > 0.90, TLI > 0.90,13 RMSEA ≤ 0.08, and SRMR < 0.08.14, 15, 16, 17, 18, 19
Considering the individual concept of internet game assessed with positive (negative) IGLS scores, a K-means cluster analysis was performed to classify all the participants into three groups: the low positive internet game concept (negative) group, general positive (negative) Internet game concept group, and high positive (negative) internet game concept group.
An independent t-test was used to compare the positive (negative) IGLS scores between the male and female participants. An analysis of variance test was used to compare the positive (negative) IGLS scores between study groups.
All statistical analyses were performed using SPSS version 24 (IBM Corp., Armonk, NY, USA). A result is statistically significant when the P value is < 0.05.
Ethics statement
The Institutional Review Board of Chung Ang University Hospital approved this study (IRB number-2090005434). In addition, the current study was conducted following the principles embodied in the Declaration of Helsinki for all investigations involving humans. Informed consent was obtained from all participants before commencing the study.
RESULTS
Description of the IGLS
The average scores of the positive scale items in the IGLS were 25.29 ± 5.29 (range: 12–38), and the average scores of the negative scale items in the IGLS were 29.13 ± 6.79 (range: 13–45). Both were normally distributed in terms of skewness (positive IGLS: −0.161 ± 0.141, negative IGLS: 0.044 ± 0.172) and kurtosis (positive IGLS: −0.122 ± 0.281, negative IGLS: −0.015 ± 0.281).
Analysis of the reliability of the IGLS
Analysis of the reliability of IGLS for the 18 items
The 18-item IGLS was proven to be reliable, with a high Cronbach's alpha (α = 0.892). Cronbach's alpha for the standardized items was also high (α = 0.891). When each item was eliminated from the IGLS one by one, all the Cronbach's α for the 18 eliminated items was above 0.850, which means that none of the items compromised reliability within the IGLS. The test-retest reliability of the 18 items was r = 0.78 (P < 0.001).
Analysis of the reliability of the IGLS for positive and negative items
The reliability of the IGLS for the nine positive items was proven with a high Cronbach's alpha (α = 0.835). Cronbach's alpha for the standardized items was also high (α = 0.836). When each item was eliminated from the IGLS with nine positive items one by one, all the Cronbach's α for the nine eliminated items was above 0.801, which means that none of the nine positive items compromised reliability within the IGLS (Table 3).
Table 3
Reliability of the Internet Game Literacy Scale
The reliability of the IGLS for the nine negative items was proven with a higher Cronbach's alpha (α = 0.910). Cronbach's alpha for the standardized items was also higher (α = 0.911). When each item was eliminated from the IGLS with nine negative items one by one, all the Cronbach's α for the nine eliminated items was above 0.895, which means that none of the items of the nine negative items compromised reliability within the IGLS (Table 3).
Analysis of the validity of the IGLS with the EFA
The KMO was 0.903, and Bartlett's test of sphericity was good (χ2 = 1,623.314, P < 0.001) (Table 4). All 18 items were segregated into two factors, with nine items each. The eigenvalue of all 18 items was significant at > 0.4. Under factor 1, nine negative items of the IGLS were segregated with 36.57% variance, 36.57% cumulative percentage, and 6.582 total eigenvalues (Table 4). The range of parameter estimates for factor 1 was 0.627 for negative item 8 and 0.791 for negative item 7. Under factor 2, nine positive items of the IGLS had 15.263% variance, 51.830 cumulative percentage, and 2.747 total eigenvalues. The range of parameter estimates for factor 2 was 0.751 for positive item 5 and 0.430 for positive item 4.
Table 4
Exploratory factor analysis of Internet Game Literacy Scale
Analysis of the validity of the IGLS with the CFA
In the analysis of the validity of the 18-item IGLS with the CFA (maximum likelihood estimation, with an oblique method), the fit indices of the standard three-factor model reached acceptable standards, CFI = 0.933, TLI = 0.923, RMSEA = 0.062, and SPMR = 0.0594 (90% confidence interval, 0.049–0.075) (Fig. 1). In CFA, the range of factor loadings of the nine positive items was between 0.43 and 0.79, and they were correlated well with one another. The range of factor loadings of the nine negative items was between 0.63 and 0.83, and nine negative items correlated better with one another (Fig. 1).
Fig. 1
Analysis of the validity of the Internet Game Literacy Scale with the confirmatory factor analysis.
K-means cluster analysis of IGLS
We performed a K-means cluster analysis of 300 participants with positive and negative IGLS items. In the positive items of the IGLS, all participants were divided into three groups: low positive internet game concept group (n = 78, final centroid: 19), average positive internet game concept group (n = 173, final centroid: 26), and high positive internet game concept group (n = 49, final centroid: 33). The final Euclidean distance between the low positive internet game concept group and the average positive internet game concept group was 7.478. The final Euclidean distance between the average positive internet game concept group and the high positive internet game concept group was 6.692. The cut-off point of the total score between the low positive and average positive groups was 23, and the cut-off point of the total score between the average positive and high positive groups was 30.
In the negative items of the IGLS, all participants were divided into three groups: low negative internet game concept group (n = 58, final centroid: 19), average negative internet game concept group (n = 128, final centroid: 28), and high negative internet game concept group (n = 114, final centroid: 38). The final Euclidean distance between the low positive internet game concept group and the average positive internet game concept group was 8.106. Further, the final Euclidean distance between the average positive internet game concept group and the high positive internet game concept group was 8.279. The cut-off point of the total score between the low negative and average negative groups was 24. The cut-off point of the total score between the average negative group and the high negative group was 32.
Comparison of IGLS scores between male and female participants as well as between generations
Male participants showed higher positive IGLS scores (t = 3.48, P = 0.002) and lower negative IGLS scores (t = −3.66, P = 0.001) compared to female participants (Table 5). There was no significant difference in the positive IGLS scores between age groups (F = 2.3, P = 0.102). However, negative IGLS scores were higher in participants in their thirties and forties than in those in their twenties (F = 10.6, P < 0.001) (Table 5). Female participants in the forties age group showed the highest negative IGLS scores compared to female participants in the other age groups (Fig. 2). In participants in their twenties, there were no significant differences in the positive and negative IGLS scores between male and female participants (Fig. 2).
Table 5
Comparisons of Internet Game Literacy Scale scores between male and female participants
Fig. 2
Comparisons of Internet Game Literacy Scale scores between male and female participants.
(A) Positive Internet Game Literacy Scale scores. (B) Negative Internet Game Literacy Scale scores.
DISCUSSION
The current study assessed the reliability and validity of the IGLS and suggested a cut-off for low, average, and high positive (negative) Internet game literacy degree among 300 Korean adults aged 21–49 years. The results suggest that the IGLS has good internal consistency and a proper cut-off for positive and negative internet game literacy scores.
The internet consistency of the IGLS in all 18 items was high (Cronbach's α = 0.892). The reliability of nine positive 9 IGLS items and nine negative 9 IGLS items was also high (Cronbach's α = 0.836 and Cronbach's α = 0.910, respectively). All items of the IGLS had significant meanings in the EFA. Additionally, the IGLS showed an excellent model of fit in CFA in terms of positive and negative IGLS items. Results suggested that IGLS had good reliability and validity for assessing the internet game perception.
Parental monitoring and restriction for children are known to effectively control healthy internet gaming in children and adolescents.20, 21, 22 However, Krossbakken et al.23 reported that the psychoeducational parental guide had no effect in preventing problematic internet gameplay in children with internet gaming disorder. These results suggest that parental guides should provide important information to those who already have problems rather than as a means of primary prevention.23 Before providing information, we believe that proper assessment tools for parental internet game concepts should be developed. In that aspect, the IGLS could suggest the educational content of internet game etiquette for parents and caregivers. However, future studies should develop a more detailed IGLS that also considers the genre of games and the age of users.
Furthermore, misunderstanding the concept of internet games could lead to negative stigma in internet games. It might provoke indiscreet criticisms for internet games, despite its benefits.24, 25 Indiscreet criticism of parents could lead to conflicts between parents and adolescents regarding internet gaming.26 The conflicts due to internet gaming could lead to successive game-related conflicts between parents and adolescents.26, 27 Thus, neutral concepts for internet games may be necessary for reducing conflicts between parents and children in monitoring children's internet gameplay. Two systematic review papers also suggested adolescents' healthy internet use habits using educational programs based on school and family.28, 29
In the K-means cluster analysis with 23 and 30 cut-off scores, 300 participants were classified into 78 low positive internet game concept group, 173 in the positive internet game concept group, and 49 in the high positive internet game concept group. In the K-means cluster analysis with 24 and 32 cut-off scores, 300 participants were classified into 58 low negative Internet game concept group, 128 in the positive Internet game concept group, and 114 in the high positive internet game concept group.
As shown in the current study, internet games were perceived more negatively among Korean adults. Due to game companies' attractive marketing for continued playing and negative consequences leading to health problems, internet games might be regarded negatively. Nonetheless, internet games play an integral role in daily life, from communication to entertainment and work.30, 31
Among the negative consequences, academic failure and irregular life patterns due to problematic internet games could lead to severe conflicts between parents and children in Korea.32 As shown in the current results, the negative perception scores of internet games among female participants in their forties who might have children aged from teenagers in Korea was the highest compared to other generations. Interestingly, participants in their twenties had no differences in negative IGLS scores between male and female participants. Korean female participants in their twenties may be exposed to internet games at an early stage of their life,33 and most of them had no children. For these reasons, we think that they can be perceive internet games positively, and few female participants in their twenties experienced negative consequences of internet gameplay between parents and children.
The current study had several limitations. First, the current study was conducted through an online survey with a relatively small sample size. In particular, members of online survey companies could have different characteristics, such as greater familiarity with active questionnaire surveys or digital activities. The study findings must be interpreted with caution considering the small sample size and inclusion biases. Second, the participants in the study were not assessed through a structured clinical interview. Psychological state and psychiatric comorbidities could affect the corresponding answers and analyses. Future studies should focus on the development of scales and cut-off scores, including psychological and psychiatric status. Finally, current data were not validated using other scales that are used to assess perception types of internet games. Future studies should compare the current IGLS with other scales.
In conclusion, the IGLS may be a reliable, valid, and relevant tool for assessing the perception of internet games. It can be used to assess negative and positive perception on internet gaming.
Funding:Current study was supported by Korea Association of Game Industry 2020-2021.
Disclosure:The authors have no potential conflicts of interest to disclose.
Author Contributions:
Conceptualization: Kim S, Han DH.
Data curation: Kim S, Han DH.
Formal analysis: Jin J, Han DH.
Investigation: Jin J, Han DH.
Validation: Chung US.
Writing - original draft: Chung US.
Writing - review & editing: Han DH.
ACKNOWLEDGMENTS
Thank you to the Korea Association of Game Industry.
References
-
Arakji RY, Lang KR. Avatar business value analysis: a method for the evaluation of business value creation in virtual commerce. J Econ Commer Res 2008;9(3):207–218.
-
-
Lu HP, Wang SM. The role of internet addiction in online game loyalty: an exploratory study. Internet Res 2008;18(5):499–519.
-
-
Yoon HM, editor. “70% of Korean are gamers...” Increased playing time of internet game. Chosun Daily Newspaper;2020 Aug 7: Sect. IT.
-
-
Kang SK, Kim GJ. An comparative study on the self-regulation of the digital game. J Korea Game Soc 2012;12(6):107–120.
-
-
Sung W. A study on the effect of the policy of online game shutdown on the game time of youth. Soc Sci Res Rev 2014;30(2):233–256.
-
-
Kim MY. A study on the problem and its improvement in game shutdown policy. Legis Polic 2012;6:61–88.
-
-
Eklund L, Bergmark KH. Proceedings of the 8th International Conference on the Foundations of Digital Games (FDG 2013); 2013 May 14-17; Chania, Greece. Santa Cruz, CA, USA: Society for the Advancement of the Science of Digital Games; 2013. pp. 63-70.
-
-
Kutner LA, Olson CK, Warner DE, Hertzog SM. Parents' and sons' perspectives on video game play: a qualitative study. J Adolesc Res 2008;23(1):76–96.
-
-
Beck J, Wade M, editors. Got Game: How the Gamer Generation is Reshaping Business Forever. Boston, MA, USA: Harvard Business School Press; 2004.
-
-
Han DH, Jung EJ, Park SO, Kim MC, Bae SJ, editors. A Study on the Difference between the Professional Approach Methodology and Coping Strategies in Internet Gaming Disorder. Naju, Korea: Korea Creative Content Agency; 2018.
-
-
Kim JY, Kim D, Lee J, Mo SH, Chang G. A study on the perception types of online games and their characteristics. J Korea Game Soc 2013;13(4):91–104.
-
-
Byrne BM, editor. Structural Equation Modeling with EQS and EQS/Windows. Thousand Oaks, CA, USA: Sage Publications; 1994.
-
-
Anderson JC, Gerbing DW. The effect of sampling error on convergence, improper solutions, and goodness-of-fit indices for maximum likelihood confirmatory factor analysis. Psychometrika 1984;49:155–173.
-
-
Marsh HW, Balla JR, Mcdonald RP. Goodness-of-fit indexes in confirmatory factor analysis: the effect of sample size. Psychol Bull 1988;103(3):391–410.
-
-
Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Modeling 1999;6(1):1–55.
-
-
Griffiths MD, Király O, Pontes HM, Demetrovics Z, editors. An Overview of Problematic Gaming. Oxford, UK: Oxford University Press; 2015.
-
-
Vondráčková P, Gabrhelík R. Prevention of internet addiction: a systematic review. J Behav Addict 2016;5(4):568–579.
-
-
Király O, Griffiths MD, King DL, Lee HK, Lee SY, Bányai F, et al. Policy responses to problematic video game use: a systematic review of current measures and future possibilities. J Behav Addict 2018;7(3):503–517.
-
-
Zhu JJ, Zhang W, Yu CF, Bao ZZ. Early adolescent internet game addiction in context: how parents, school, and peers impact youth. Comput Human Behav 2015;50:159–168.
-
-
Choung HM, Lee DS. A study on difference of internet game addiction tendency according to the game with use. J Korea Soc Comput Inf 2008;13(2):159–166.
-
Cited by
Figures
1 / 2
Tables
1 / 5
