ISSN 2079-6617 (Print)
ISSN 2309-9828 (Online)
Articles

Article

MainArticlesVolumes

Soldatova G.U., Rasskazova E.I. (2018) Brief and screening versions of the Digital Competence Index: verification and application possibilities. National Psychological Journal. 3, 47-56.

Abstract

Background. Diagnostics of the schoolchildren digital competence is now an important educational task that requires an index applicable to children of the early school age and brief enough for population studies. The Digital Competence Index (DCI) as a component of social competence was proposed for measuring knowledge, skills, motivation and responsibility / security online in each of the following areas: content, communication, consumption, and technologicalsphere.

Objective. The development and subsequent verification of a brief and screening versions of DCI, and also the study of DCI in children under 12 years of age.

Design. During the first stage based on the first sample of DCI approbation, items with the highest correlation with each subscale were selected. Digital competence was assessed on the basis of the Index as well as the solution of experimental tasks. User activity was assessed using EU-Kids online methodology. During the second stage, the methodwas verified in the sample of children aged 7-11 and parents of children of primary school age. User activity was measured as well. The children also filled measure of Excessive Internet Use from EU-Kids online methodology and the Dembo-Rubinstein scales assessing their general and online self-esteem.

Sample. The first study included 1203 adolescents aged 12-17 and 1209 parents. The second sample included 50 children aged 7-11 years old and 100 parents of children aged 5-11 years.

Results. In the first study a brief version (32 points) allows to reliably (alpha 0.69-0.85) evaluate the four components and index ensuring the prediction accuracy of more than 90%. The screening version (16 points) makes it possible to reliably (0.71-0.73) estimate the overall index with the prediction accuracy of more than 85%. Both versions reproduced the basic patterns of the differences between correctly and incorrectly solved digital competence tasks by teenagers and parents. According to the second study, brief and screening versions can be used with the primary school age, although the screening version allows to estimate only the general index, but not the components of digital competence. The average digital competence of children 7-11 years old is 30% of the maximum possible, parents take 46%, which demonstrates the improvement of digital competence in the recent five years. Digital competence in both children and parents is associated with greater user activity, and in children – with a more positive self-esteem online and signs of excessive Internet use. In parents correct answers to the digital competence tasks were associated with greater competence, primarily on the components of responsibility/safety and skills.

Conclusion. The data support the possibility of using the screening version of the Digital Competence Index to obtain the general indicator in diagnosing adults and children of the primary school age, whereas a brief version of the DCI can be used not only as an overall index but also of its components.

Received: 08/26/2018
Accepted: 09/05/2018
Pages: 47-56
DOI: 10.11621/npj.2018.0305

Sections: Psychology of virtual reality;

PDF: Download

Keywords: Digital Competence Index; screening version; parents; psychodiagnostic of digital competence;

Available Online 30.09.2018

Table 1. Cronbach’s Alpha and DCI coefficient of brief versions and screening versions

DCI Spheres and Components

DCI Brief Version (32 items)

DCI Screening Version (16 items)

Adolescents

Parents

Adolescents

Parents

α

R2

Α

R2

α

R2

α

R2

DCI

0.82

94.3%

0.85

94.8%

0.71

85.4%

0.73

86.9%

Knowledge

0.69

93.6%

0.78

95.3%

0.44

71.7%

0.54

76.7%

Skills

0.72

75.3%

0.78

76.3%

0.57

66.6%

0.64

71.6%

Motication

0.38

88.9%

0.46

91.7%

0.00

61.0%

0.22

63.2%

Responsibility / safety

0.71

93.3%

0.73

94.4%

0.61

78.5%

0.62

80.1%

Content

0.44

81.1%

0.58

85.0%

0.22

58.4%

0.34

63.2%

Communication

0.59

82.9%

0.74

85.9%

0.44

61.8%

0.43

68.2%

Technosphere

0.56

86.2%

0.61

88.8%

0.36

68.2%

0.48

70.7%

Consumption

0.58

87.1%

0.57

87.4%

0.41

69.6%

0.35

64.2%

Table 2. Comparison of parents who answered correctly and incorrectly based on their digital competence of full. Short and screening versions (only components and spheres with differences in the full version)

DCI Spheres and Components

DCI Full Version

DCI Screening Version

DCI Brief Version

 

Student’s t-Test

Statistical Effect η2

Student’s t-Test

Statistical Effect η2

Student’s t-Test

Statistical Effect η2

1

2

3

4

5

6

7

Competence Task for Content

Knowledge

-2.45**

0.006

-2.18*

0.005

-2.36*

0.006

Skills

-2.15*

0.005

-1.51

0.002

-2.12*

0.004

Responsibility / safety

-4.15**

0.017

-4.12**

0.017

-4.29**

0.018

DCI

-3.00**

0.009

-2.51**

0.006

-3.22**

0.010

Communication

-2.66**

0.007

-1.73

0.003

-2.16*

0.005

Technosphere

-2.94**

0.009

-1.51

0.002

-3.02**

0.009

Consumption

-3.53**

0.012

-2.89**

0.008

-3.62**

0.013

Competence Task for Communication

Knowledge

-4.09**

0.016

-4.71**

0.022

-4.38**

0.019

Skills

-5.11**

0.025

-4.53**

0.020

-4.78**

0.022

Responsibility / safety

-6.37**

0.039

-6.15**

0.036

-6.65**

0.042

DCI

-5.74**

0.032

-5.55**

0.030

-6.10**

0.036

Content

-2.98**

0.009

-2.50**

0.006

-2.72**

0.007

Communication

-6.33**

0.038

-4.61**

0.021

-6.45**

0.040

Technosphere

-4.91**

0.023

-4.31**

0.018

-4.96**

0.024

Consumption

-5.78**

0.032

-4.94**

0.024

-5.93**

0.034

Competence Task for Technosphere

Skills

-2.70**

0.007

-1.94*

0.004

-2.46**

0.006

Motivation

2.99**

0.009

3.23**

0.010

2.71**

0.007

Responsibility / safety

-3.19**

0.010

-4.29**

0.018

-3.29**

0.011

DCI

-2.05*

0.004

-2.75**

0.007

-2.18*

0.005

Communication

-3.33**

0.011

-2.93**

0.008

-2.45**

0.006

Competence Task for Consumption

Knowledge

-4.02**

0.016

-4.24**

0.018

-3.60**

0.013

Skills

-3.95**

0.015

-3.52**

0.012

-3.72**

0.014

Responsibility / safety

-5.29**

0.027

-4.58**

0.020

-5.36**

0.028

DCI

-5.07**

0.025

-5.22**

0.026

-4.96**

0.024

Content

-3.92**

0.015

-3.11**

0.009

-3.70**

0.013

Communication

-4.31**

0.018

-4.88**

0.023

-4.42**

0.019

Technosphere

-4.32**

0.018

-2.71

0.007

-4.04**

0.016

Consumption

-4.49**

0.020

-4.83**

0.023

-4.31**

0.018

Table. 3. Comparison of adolescents who answered correctly and incorrectly based on their digital competence of short and screening versions (only components and spheres with differences in the full version)

DCI Spheres and Components

DCI Full Version

DCI Screening Version

DCI Brief Version

Student’s t-Test

Statistical Effect η2

Student’s t-Test

Statistical Effect η2

Student’s t-Test

Statistical Effect η2

Competence Task for Content

Knowledge

-2.12*

0.004

-1.34

0.001

-1.93*

0.003

Responsibility / safety

-3.91**

0.013

-3.42**

0.010

-3.83**

0.012

DCI

-2.52*

0.005

-2.16*

0.004

-2.43*

0.005

Content

-2.22*

0.005

-1.40

0.002

-1.11

0.001

Communication

-2.26*

0.004

-2.16*

0.004

-2.71*

0.006

Competence Task for Technosphere

Skills

-3.20**

0.009

-1.43

0.002

-0.62

0.000

Responsibility / safety

-4.05**

0.013

-4.33**

0.015

-3.90**

0.013

DCI

-2.62*

0.006

-2.79*

0.006

-1.84

0.003

Communication

-3.96**

0.013

-3.04**

0.008

-2.76*

0.006

Technosphere

-2.17*

0.004

-2.22*

0.004

-1.28

0.001

Consumption

-2.70*

0.006

-3.63**

0.011

-2.85**

0.007

Competence Task for Consumption

Knowledge

-3.29**

0.009

-2.22*

0.004

-3.25**

0.009

Skills

-4.34**

0.015

-4.26**

0.039

-3.75**

0.012

Responsibility / safety

-6.14**

0.076

-4.66**

0.018

-5.84**

0.028

DCI

-5.24**

0.022

-4.74**

0.018

-5.28**

0.023

Content

-4.91**

0.020

-2.78*

0.006

-4.14**

0.036

Communication

-4.45**

0.016

-3.89**

0.012

-4.62**

0.017

Technosphere

-4.64**

0.018

-4.01**

0.013

-4.42**

0.016

Consumption

-3.77**

0.028

-3.10**

0.008

-3.94**

0.032

* – p<0,05, ** – p<0,01.

Table 4. Cronbach’s Alpha index of and DCI coefficient in children and parents

DCI Components

Screening Version (children. N=50)

Screening Version (parents. N=100)

Brief Version (parents. N=100)

DCI

0.59

0.76

0.85

Components of knowledge. skills and responsibility / safety

0.65

0.80

0.89

Components of skills and responsibility / safety

0.71

0.79

0.86

Knowledge

0.81

Skills

0.73

Motivation

0.41

Responsibility / safety

0.80

References:

Asmolov A.G. (2012). Optics of enlightenment: socio-cultural perspectives. Moscow, Prosveschenie.

Asmolova A.G., & Soldatova G.U. (Eds.) (2006). Social competence of the class teacher: the direction of joint action. Moscow, Smysl.

Asmolov A.G., Semenov A.L., & Uvarov A.Yu. (2010). Russian school and new information technologies: a look into the future decade. Moscow, Nexprint.

Ayanyan A.N., & Martsinkovskaya T.D. (2016). Socialization of adolescents in the information space. [Psikhologicheskie Issledovaniya: ehlektronnyy nauchnyy zhurnal], 9(46), 8. Retrieved from: http://psystudy.ru/index.php/num/2016v9n46/1262-ayanyan46.html

Badarcha Dendeva (Ed.) (2013). Information and communication technologies in education: monograph. Moscow, IITO UNESCO.

Belinskaya, E.P. (2013). Information socialization of adolescents: the experience of using social networks and psychological well-being. [Psikhologicheskie Issledovaniya: ehlektronnyy nauchnyy zhurnal], 6(30), 5. Retrieved from: http://www.psystudy.ru/index.php/num/2013v6n30/858-belinskaya30.html

Dutta S., & Mia I. (2011). The Global Information Technology Report 2010–2011 Transformations 2.0. World Economic Forum. URL: http://www.ictliteracy.info/rf.pdf/Global-ITReport-2010-2011.pdf

Fedorov, A.V. (2009). Media Education: Yesterday and Today. Moscow, Izdatel’stvo MOO WPP UNESCO “Informatsiya dlya vsekh”.

Gilster, P. (1997). Digital Literacy. New York: Wiley Computer Publishing.

Golubeva N.A., & Marcinkovskaya T.D. (2011) Information socialization: the psychological approach. [Psikhologicheskie Issledovaniya: ehlektronnyy nauchnyy zhurnal], 6(20), 2. Retrieved from: http://psystudy.ru/num/2011n6-20/579-golubeva-marsinkovskaya20.html.

Henson R. K. (2006). Effect-Size Measures and Meta-Analytic Thinking in Counseling Psychology Research. The Counseling Psychologist, 34(5), 601–629. doi: 10.1177/0011000005283558

Ilomäki L., Lakkala M. & Kantosalo A. (2011). What is digital competence? Linked portal. Brussels, European Schoolnet (EUN), 1–12.

Koutrooulos A. (2011). Digital natives: Ten years after. MERLOT Journal of Online Learning and Teaching, 7(4), 525–538.

Kuzmin E.I., & Parshakova A.V. (2013). Media and information literacy in knowledge societies. Moscow, МTSBS.

Lau H. (2006). A guide to information literacy for lifelong learning. Moscow, MOO VPP UNESCO «Informatsiya dlya vsekh».

Livingstone, S., & Haddon, L. (2009). EU Kids Online: final report. LSE, London: EU Kids Online. Retrieved from: http://www.lse.ac.uk/media@lse/research/EUKidsOnline/EU%20Kids%20I%20(2006-9)/EU%20Kids%20Online%20I%20Reports/EUKidsOnlineFinalReport.pdf

Livingstone S., Haddon L., Görzig A., & Olafsson K. (2011). Risks and safety on the internet: the perspective of European children: full findings and policy implications from the EU Kids Online survey of 9–16 year olds and their parents in 25 countries. London: EU Kids Online Network.

Livingstone S.M., Haddon L., Görzig A. (eds.) (2012). Children, risk and safety on the internet. Bristol: Policy Press. doi: 10.1332/policypre ss/9781847428837.001.0001

Martin, A. & Madigan, D. (Eds.) (2006). Digital Literacies for Learning, London, Facet.

(2012). Measuring the information society. International Telecommunication Union: Geneva. Retrieved from: http://www.itu.int/ITU-D/ict/publications/idi/material/2012/MIS2012_without_Annex_4.pdf

Mossberger, K., Tolbert, C.J., & McNeal, R.S. (2008) Digital Citizenship: The Internet, Society, and Participation. Cambridge, MA: MIT Press.

Rubinstein S.Ya. (1999). Experimental methods of pathopsychology. Moscow, EKSMO-Press.

Sirgy, M.J., Michalos, A.C., Ferris, A.L., Easterlin, R.A., Patrick, D., & Pavot, W. (2006) The quality of life (QOL) research movement: past, present and future. Social Indicators Research, 76, 343–466. doi: 10.1007/s11205-005-2877-8

Soldatova, G., Rasskazova, E., Zotova, E., Lebesheva, M., Geer, M., & Roggendorf, P. (2013). Russian Kids Online Key findings of the EU Kids Online II survey in Russia. Moscow, Fond razvitiya Internet. Retrieved from: http://www.lse.ac.uk/media@lse/research/EUKidsOnline/ParticipatingCountries/PDFs/RU-RussianReport.pdf

Soldatova G., Zotova E., Chekalina A., & Gostimskaya O. (2011). Caught by one network: a social and psychological study of the views of children and adults about the Internet. Moscow, Fond razvitiya Internet.

Soldatova G.U., Rasskazova E.I., & Nestik T.A. (2017) Digital generation of Russia: competence and safety. Moscow, Smysl.

Soldatova G.U., Nestik T.A., Rasskazova E.I., & Zotova E.Yu. (2013). Digital competence of Russian teenagers and parents: the results of the all-Russian study. Moscow, Fond razvitiya Internet.

Soldatova G.U., & Rasskazova E.I. (2017). Motivation in the structure of digital competence of Russian teenagers. National Psychological Journal, 1, 3–14. doi: 10.11621 / npj.2017.0101.

Subrahmanyam K., & Smahel D. (2011) Digital youth: The role of media in development. N.Y.: Springer Science & Business Media. doi: 10.1007/978-1- 4419-6278-2

Tarpley T. (2001). Children, the Internet, and other new technologies. In Singer D., & Singer J. (Eds.). Handbook of Children and the Media. Thousands Oaks (CA): Sage Publications, 547–556.

For citing this article:

Soldatova G.U., Rasskazova E.I. (2018) Brief and screening versions of the Digital Competence Index: verification and application possibilities. National Psychological Journal. 3, 47-56.