Digital Educational Content for a Modern Lesson: Quality Assessment Technology
https://doi.org/10.26907/esd.19.3.08
EDN: MZIPFX
Abstract
Widely and universally used e-learning systems (ELS) remain the subject of close attention of researchers. An integral and most important part of the ELS is digital educational content. This is a key element for both distance and full-time education, and in recent years it has been widely used not only in higher education, but also in general education. Assessing the quality of educational content for the expert community is a delicate issue, the complexity of which is due to the examinator subjectivity. Modern automation tools, developed within the framework of the artificial intelligence paradigm, which have already demonstrated the ability to solve various problems, allow us to approach this issue from a new position.
The purpose of the article is to present the results of a preliminary study of approaches to increasing the accuracy and objectivity of the examination of the quality of digital educational content through partial automation of expert procedures. The leading research methods are analysis, examination, modeling, ascertaining experiment, description.
As a result, a theoretical justification for automating the examination of the quality of digital educational content as a new interdisciplinary scientific research area is presented, tasks are set, goals and methods are defined, and the first results obtained within this area are presented. It is shown that the development goal will be the formation of an expanded description of the process of examination of the quality of digital educational content, including proposals for expert procedures implemented only by automation means, description of the examination information model and interpretation of the results of automatic examination.
The novelty of the results obtained lies in the formation of the theoretical foundations for automatic analysis of the digital educational content quality. This will form a fundamentally new quality of assessment procedures in relation to electronic means of teaching and education, based on objective and measurable qualitative characteristics and indicators, formalized stages (processes) of examination, and quantitatively qualified assessment results
About the Authors
A. Bosov
FRC CSC RAS
Russian Federation
Russian Federation
Alexey Bosov
Moscow, Russia
N. Selivanova
Federal State Budget Scientific Institution “Institute for Strategy of Education Development”
Russian Federation
Russian Federation
Natalia Selivanova
Yu. Pustylnik
Federal State Budget Scientific Institution “Institute for Strategy of Education Development”
Russian Federation
Russian Federation
Yulia Pustylnik
References
1. Bosov, A. V., & Ivanov, A. V. (2022). Technology for classification of content types of e-textbooks. Informatika i ee primeneniya – Informatics and Applications, 16(4), 63–72. https://doi.org/10.14357/19922264220410
2. Bosov, A. V., & Ivanov, A. V. (2023). Multifactor classification technology of mathematical content of e-learning system. Informatika i ee primeneniya – Informatics and Applications, 17(4), 32–41. https://doi.org/10.14357/19922264230405
3. Bosov, A. V., & Ivanov, A. V. (2023). Two Approaches to E-Book Content Classification. In R. Silhavy & P. Silhavy (Eds.), Artificial Intelligence Application in Networks and Systems. CSOC 2023.
4. Lecture Notes in Networks and Systems, Vol. 724 (pp. 77–87). https://doi.org/10.1007/978-3-031-35314-7_6
5. Bosov, A. V., Martyushova, Ya. G., & Naumov, A. V. (2022a). Directions selection for assessing the quality of electronic learning tools for the organization of the educational process of the higher educational process. Sibirskiy pedagogicheskiy zhurnal – Siberian Pedagogical Journal, 2, 54–63. https://doi.org/10.15293/1813-4718.2202.05
6. Bosov, A. V., Martyushova, Ya. G., & Naumov, A. V. (2022b). Peculiarities of e-textbook content formation on the basis of didactic principles of textbook design. Otechestvennaya i zarubezhnaya pedagogika – Domestic and Foreign Pedagogy, 1, 4(85), 34–45.
7. Bosov, A. V., Martyushova, Ya. G., Naumov, A. V., & Sapunova, A. P. (2020). Bayesian approach to the construction of an individual user trajectory in the system of distance learning. Informatika i ee primeneniya – Informatics and Applications, 14(3), 89–96. https://doi.org/10.14357/19922264200313
8. Bosov, A. V., Mkhitaryan, G. A., Naumov, A. V., & Sapunova, A. P. (2019). Using the model of gamma distribution in the problem of forming a time-limited test in a distance learning system. Informatika i ee primeneniya – Informatics and Applications, 13(4), 11–17. https://doi.org/10.14357/19922264190402
9. Ivanova, E. O. (2015). Electronic textbook - subject information-educational environment of independent work of students. Obrazovanie i nauka – The Education and Science Journal, 5(124), 118–128. https://doi.org/10.17853/1994-5639-2015-5-118-128
10. Ivanova, E. O., & Osmolovskaya, I. M. (2014). Theory of learning in the information society. Prosveshchenie.
11. Ivanova, E. O., Osmolovskaya, I. M., & Shabalin, Y. E. (2017). Construction of textbooks for implementation of the learning process in the information and education environment. Institute for Strategy of Education Development of the Russian Academy of Education.
12. Kiseleva, E. V. (2020). Pedagogical examination of the process of upbringing in an educational organization [Unpublished doctoral dissertation]. Institute for Strategy of Education Development of the Russian Academy of Education.
13. Kiseleva, E. V., Kiselev, N. N., & Selivanova, N. L. (2019). Construction of the Concept of Developmental Pedagogical Expertise of Education Process. In S. K. Lo (Ed.), Education Environment for the Information Age, vol 69. European Proceedings of Social and Behavioural Sciences (pp. 416-423). Future Academy. https://doi.org/10.15405/epsbs.2019.09.02.48
14. Kiseleva, E. V., Selivanova, N. L., & Kiselev, N. N. (2018). Pedagogical Expert Assessment of Character Building Process. In S. K. Lo (Ed.), Education Environment for the Information Age, vol 46. European Proceedings of Social and Behavioural Sciences (pp. 301-308). Future Academy. https://doi.org/10.15405/epsbs.2018.09.02.35
15. Konasova, N. Yu. (2023). Public examination of the quality of school education. KARO.
16. Lygina, N. I., & Lauferman, O. V. (2020). Quality of training materials: design, use, evaluation. Mir nauki. Pedagogika i psihologija – World of Science. Pedagogy and psychology, 8(1), 27. https://mirnauki.com/PDF/64PDMN120.pdf
17. Martyushova, Ya. G. (2017). Scenario approach to the development and use of learning management system in universities. Psikhologicheskaya nauka i obrazovanie – Psychological Science and Education, 22(6), 45–55. https://doi.org/10.17759/pse.2017220604
18. Martyushova, Ya. G. (2018). Theoretical bases of creation of learning management systems for students of technical universities. Otechestvennaya i zarubezhnaya pedagogika – Domestic and Foreign Pedagogy, 1, 5(54), 151–165.
19. Mkhitaryan, G., Kibzun, A., Martyushova, Y., & Zharkov, E. (2020). Interdisciplinary Aspects of Development and Software Implementation of Electronic Textbooks for Students of Technical Universities. In V. Sukhomlin & E. Zubareva (Eds.), Modern Information Technology and IT Education. Communications in Computer and Information Science, Vol. 1201 (pp. 110–120). Springer. https://doi.org/10.1007/978-3-030-46895-8_9
20. Pustylnik, Yu. Yu., Trubina, I. I., & Chmykhova, E. V. (Eds). (2022). Pedagogical Practices of Preparing Schoolchildren for the Olympiads in Artificial Intelligence. Institute for Strategy of Education Development of the Russian Academy of Education.
21. Rasch, G. (1980). Probabilistic models for some intelligence and attainment tests. The University of Chicago Press.
22. Selivanova, N. L., Stepanov, P. V., Kruglov, V. V., & Parfyonova, I. S. (2021). Risks of Modern Digital Environment Hindering the Implementation of Upbringing Programs. In Е. Tareva & T. Bokova (Eds.), ARPHA Proceedings 4: TSNI 2021 – Textbook: focus on students' national identity (pp. 766–779). ARPHA Proceedings. https://ap.pensoft.net/article/22085/download/pdf/550004
23. Shisharina, N., Ivantsova, N., Romm, T., Selivanova, N., & Podlinyaev, O. (2020). Hygienic Evaluation of Innovative Educational Technologies. In N. L. Shamne, S. Cindori, E. Yu. Malushko, O. Larouk, & V. G. Lizunkov (Eds.), Individual and Society in the Modern Geopolitical Environment, vol 99. European Proceedings of Social and Behavioural Sciences (pp. 839–847). European Publisher. https://doi.org/10.15405/epsbs.2020.12.04.96
24. Solov'ev, A. V., & Krivcov, V. E. (2019). Expert Competency Modeling. Iskusstvennyy intellekt i prinyatie resheniy – Artificial Intelligence and Decision Making, 3, 32–39. https://doi.org/10.14357/20718594190304
25. Stepanov, P. V., Kruglov, V. V., Stepanova, I. V., Cherkashin, E. O., Shustova, I. Yu., Parfenova, I. S., Selivanova, N. L., & Nurullova, A. Yu. (2022). Scientific and methodological recommendations for teachers of educational organizations about the possibilities and risks of using digital technologies in the personal development of a school student. Institute for Strategy of Education Development of the Russian Academy of Education.
26. Sukhovienko, E. A. (2005). Electronic textbook: Design, Training, Diagnostics. Obrazovaniye. Sychev, O. A. & Denisov, M. E. (2024). Method of automatic constructing training exercises for electronic tutoring systems. Iskusstvennyy intellekt i prinyatie resheniy – Artificial Intelligence and Decision Making, 1, 38–51. https://doi.org/10.14357/20718594240104
27. Trubina, I. I., & Pustylnik, Yu. Yu. (2023). Artificial Intelligence in the Russian School. Pedagogicheskiy poisk. Bosov, A. V. Adaptation of Kohonen's Self-Organizing Map to the Task of Constructing an Individual User Trajectory in an E-Learning System // Data Science and Algorithms in Systems. CoMeSySo 2022. Lecture Notes in Networks and Systems. – 2022. – Vol. 597. – P. 554–564. – DOI:10.1007/978-3-031-21438-7_44
28. Bosov, A. V., Ivanov, A. V. Two Approaches to E-Book Content Classification // Artificial Intelligence Application in Networks and Systems. Proceedings of 12th Computer Science Online Conference (CSOC 2023). – 2023. – Vol. 3. – P. 77–87. – DOI:10.1007/978-3-031-35314-7_6
29. Kiseleva, E. V., Selivanova, N. L., Kiselev, N. N. Pedagogical expert assessment of character building process // EEIA 2018 – International Conference “Education Environment for the Information Age” / S. K. Lo (Ed.). – European Publisher, 2018. – 888 p. – P. 301–308. – DOI:10.15405/epsbs.2018.09.02.35
30. Kiseleva, E. V., Kiselev, N. N., Selivanova, N. L. Construction of the concept of developmental pedagogical expertise of education process // EEIA 2019 – International Conference “Education Environment for the Information Age”. The European Proceedings of Social & Behavioural Sciences EpSBS / S. K. Lo (Ed.). – Vol. LXIX. – European Publisher, 2019. – 1054 p. – P. 416–423. – DOI:10.15405/epsbs.2019.09.02.48
31. Mkhitaryan, G., Kibzun, A., Martyushova, Y., Zharkov, E. Interdisciplinary Aspects of Development and Software Implementation of Electronic Textbooks for Students of Technical Universities // Communications in Computer and Information Science. – 2020. – Vol. 1201. – P. 110–120. – DOI:10.1007/978-3-030-46895-8_9
32. Rasch, G. Probabilistic models for some intelligence and attainment tests. – Chicago: The University of Chicago Press, 1980. – 186 p.
33. Selivanova, N. L., Stepanov, P. V., Kruglov, V. V., Parfyonova, I. S. Risks of Modern Digital Environment Hindering the Implementation of Upbringing Programs // ARPHA Proceedings 4: TSNI 2021 – Textbook: focus on students' national identity / Tareva, Е., Bokova, T. (Eds.). – Sofia: ARPHA Proceedings, 2021. – 1150 p. – P. 766–779. – URL: https://ap.pensoft.net/article/22085/download/pdf/550004 (дата обращения 01.09.2024).
34. Shisharina, N., Ivantsova, N., Romm, T., Selivanova, N., Podlinyaev, O. Hygienic Evaluation Of Innovative Educational Technologies // European proceedings of social and behavioural sciences (EpSBS) : II International Scientific and Practical Conference / Shamne, N. L., Cindori, S., Malushko, E. Yu., Larouk, O., Lizunkov, V. G. (Eds.). – Vol. 99. – European Publisher, 2020. – 1040 p. – P. 839–847. – DOI:10.15405/epsbs.2020.12.04.96
35. Van der Linden, W. J. A Lognormal Model for Response Times on Test Items // Journal of Educational and Behavioral Statistics. – 2006. – Vol. 31. – No. 2. – P. 181–204.
Review
For citations:
Bosov A., Selivanova N., Pustylnik Yu. Digital Educational Content for a Modern Lesson: Quality Assessment Technology. Education and Self-Development. 2024;19(3):98-113. (In Russ.) https://doi.org/10.26907/esd.19.3.08. EDN: MZIPFX
Views:
2
Email this article 