July 2021, Volume 24, Issue 3
Special Issue on "From Conventional AI to Modern AI in education- Re-examining AI and Analytics Techniques for Teaching and Learning"
Guest Editor(s): Haoran Xie, Gwo-Jen Hwang and Tak-Lam Wong
Full Length Articles
The Professionalism of Online Teaching in Arab Universities: Validation of Faculty Readiness
Ahmed Ramadan Khtere and Ahmed Mohamed Fahmy Yousef
Ahmed Ramadan Khtere
Foundations of Education Department, Faculty of Education, Fayoum University, Egypt // ahmed.s.a@fayoum.edu.eg
Ahmed Mohamed Fahmy Yousef
Educational Technology Department, Faculty of Specific Education, Fayoum University, Egypt // ahmed.fahmy@fayoum.edu.eg
ABSTRACT:
The study aimed to examine the readiness of faculty members in Arab universities for blended learning environments through an investigation of the attributes, skills, and knowledge in three roles of professional online teachers. Online teaching professionalism has been described as a set of required competencies, and behaviours for the effectiveness of educational online sessions. The authors have argued some requirements of teachers’ roles as an instructional planner, an assessor, and as a mentor. A purposive sample of 24 experts from diverse disciplines contributed to the reference panel in a Delphi study through three rounds. Qualitative content analysis and some descriptive statistics e.g., the median and frequency distribution, have been used to reach a consensus among the panel of experts. A matrix of 30 requirements was shortlisted by experts in different roles. The panelists provided insight into the top 10 requirements for each role to measure the professionalism of faculty before, during, and after the online sessions. The readiness for online teaching was concluded by six main domains namely evaluating students’ achievements and limitations, problem-solving skills, information technology and computer skills, monitoring and motivating techniques, communication, and class management skills. The study results can be used to plan faculty development programs based on performance gaps of faculty members at three levels: individual, departmental, and program or college. Moreover, the listed faculty attributes help higher education institutions to evaluate the perceptible skills and personal characteristics of faculty in enhancing the efficacy of online teaching in different academic disciplines.
Keywords:
Teaching professionalism, Online learning, Faculty readiness, Faculty competences
Cite as:Khtere, A. R., & Yousef, A. M. F. (2021). The Professionalism of Online Teaching in Arab Universities: Validation of Faculty Readiness. Educational Technology & Society, 24(3), 1–12. https://doi.org/10.30191/ETS.202107_24(3).0001
Exploring Effects of Geometry Learning in Authentic Contexts Using Ubiquitous Geometry App
Wu-Yuin Hwang, Uun Hariyanti, Yan Amal Abdillah and Holly S. L. Chen
Wu-Yuin Hwang
Graduate Institute of Network Learning Technology, National Central University, Jhongli City, Taiwan // wyhwang@cc.ncu.edu.tw
Uun Hariyanti
Graduate Institute of Network Learning Technology, National Central University, Jhongli City, Taiwan // uun.hariyanti1802@g.ncu.edu.tw
Yan Amal Abdillah
Graduate Institute of Network Learning Technology, National Central University, Jhongli City, Taiwan// yan.amal91@gmail.com
Holly S. L. Chen
Luzhou Elementary School, Taipei City, Taiwan // hollyc4826@gmail.com
ABSTRACT:
Geometry is essential for mathematics learning given that it is strongly related to our surroundings; however, few studies concentrated on using geometry in our daily life, especially using mobile devices with their sensors. Thus, this study proposed one app, Ubiquitous Geometry (UG), and explored its effects on learning angles and polygons in authentic contexts. The experiment was conducted for grade four learners of an elementary school. The control group used protractors and pencil/paper in measuring angles and polygons, whereas the experimental group did measurements with UG. The results showed that in terms of learning achievement, the experimental group outperformed the control group. Further investigation of the relationship between learning behaviors and learning achievement in the experimental group found that both learning effectiveness and quantity of learning, including measuring angles of elevation and depression (MED), note drawing, and comment drawing, have significantly positive correlations with learning achievement. These three behaviors also become significant predictors of learning achievement after multiple regression analysis. Moreover, MED was found to be the most critical factor to affect learning achievement. Additionally, in perception evaluation, participants felt satisfied with UG and authentic measurement activities by which their learning motivation and interests in authentic contexts were indeed stimulated. Hence, we suggested that UG was worth promoted and further investigated its effects on authentic geometry learning.
Keywords:
Measurement in authentic contexts, Learning behaviors, Cognitive abilities, Ubiquitous Geometry
Cite as:Hwang, W.-Y., Hariyanti, U., Abdillah, Y. A., & Chen, H. S. L. (2021). Exploring Effects of Geometry Learning in Authentic Contexts Using Ubiquitous Geometry App. Educational Technology & Society, 24(3), 13–28. https://doi.org/10.30191/ETS.202107_24(3).0002
Tsung-Yen Chuang, Martin K.-C. Yeh and Yu-Lun Lin
Tsung-Yen Chuang
National University of Tainan, Taiwan // chuangyen@mail.nutn.edu.tw
Martin K.-C. Yeh
Penn State University – Brandywine, Pennsylvania, USA // martin.yeh@psu.edu
Yu-Lun Lin
National University of Tainan, Taiwan // allenwubai@gmail.com
ABSTRACT:
Students with different cognitive styles benefit from different instructional strategies, including learning through playing video games. Although playing video games can be an effective learning method, we do not know its impact on the reasoning ability of students with different cognitive styles. The purposes of this study are to investigate whether students with different cognitive styles improve their reasoning ability after playing video games and whether the effect is the same for all students. We used a pretest-posttest experimental design with multivariant analyses and found that elementary school students’ reasoning ability improved reliably after playing a puzzle adventure game for four weeks, twice a week. In addition, field-independent students’ reasoning ability improved reliably more than field-dependent students did. Students with different cognitive styles also demonstrated noticeably different information search strategies during game playing. Our work answers the questions regarding the impact of playing video games in students’ reasoning ability and in students with different cognitive styles. We also suggested guidelines of designing educational video games for field-dependent and field-independent students. Future studies are needed to expand our understanding to the relationships between other types of video game, cognitive ability, and cognitive styles.
Keywords:
Cognitive style, Digital game, Reasoning ability, Game-based learning
Cite as:Chuang, T.-Y., Yeh, M. K.-C., & Lin, Y. L. (2021). The Impact of Game Playing on Students’ Reasoning Ability, Varying According to Their Cognitive Style. Educational Technology & Society, 24(3), 29–43. https://doi.org/10.30191/ETS.202107_24(3).0003
Héctor Galindo-Dominguez
Facultad de Educación y Psicología, Universidad Francisco de Vitoria, Spain // hector.galindo@ufv.es
ABSTRACT:
Flipped Classroom methodology is gaining relative importance as time goes by, in part due to the spreading and accessibility of technological resources in the educational field. Nonetheless, the effectiveness of this methodology is still being discussed. In this sense, the aim of this study is to analyse whether flipped classroom methodology is a more effective methodology than other methodologies. For this purpose, a systematic review was carried out, considering as valid studies those that had a pre-post and a control group. Based on a total of 61 studies (n = 5541 students) from 18 databases, results revealed that Flipped Classroom methodology is more effective than other methodologies in terms of learning achievement, in secondary and higher education, and it could be more beneficial than other methodologies in other constructs as motivation, self-efficacy, cooperativeness and engagement, among others. In primary education, findings revealed that Flipped Classroom could be as effective as other methodologies with regard to learning achievement, and other construct, such as self-concept and social climate. Depending on the educational stage, the effect size of differences was between 1.36 to 1.80 times larger in the case of Flipped Classroom group in comparison with control group. Based on these results, the Flipped Classroom could be more beneficial in comparison with traditional methodologies that are mainly used in higher education. However, it would not more beneficial in other educational stages where traditional approaches are not commonly used, such as in primary education.
Keywords:
Flipped classroom, Primary education, Secondary education, Higher education, Effectiveness
Galindo-Dominguez, H. (2021). Flipped Classroom in the Educational System: Trend or Effective Pedagogical Model Compared to Other Methodologies? Educational Technology & Society, 24(3), 44–60. https://doi.org/10.30191/ETS.202107_24(3).0004
Mohamad Ridhuan Mat Dangi and Maisarah Mohamed Saat
Mohamad Ridhuan Mat Dangi
Faculty of Accountancy, Universiti Teknologi MARA, Selangor Branch, Puncak Alam Campus, Malaysia // ridhuan@uitm.edu.my
Maisarah Mohamed Saat
Azman Hashim International Business School, Universiti Teknologi Malaysia, Johor, Malaysia // maisarahsaat@utm.my
ABSTRACT:
The findings of this study reveal that it is unlikely for the interaction effects of situational context, namely educational technology experience (EXP), training frequency (TF), voluntariness (VOL), and class size (CSIZE), to influence accounting educators’ intention to adopt educational technology. The original Technology Acceptance Model (TAM), which has been modified numerous times, is still relevant, especially for developing countries since their educational technology penetration is still very low. Conscientiousness trait from the Big Five Personality Model was applied in this study to measure intention as a powerful factor associated with the nature of individuals involved in the accounting profession. Measuring the factors from the individual perspective adds insight into the extant literature since past studies focused on organisational factors and student as the subject. The current study also overcomes the issue of stagnation in the accounting literature, specifically in the field of educational technology. Furthermore, this paper contributes by offering a good indication of using Structural Equation Modelling in the study, especially in the area of accounting and education, and using the most current reporting requirement for information system research.
Keywords:
Accounting Education, Acceptance Behaviour, Conscientiousness, Educational Technology
Cite as:Mat Dangi, M. R., & Mohamed Saat, M. (2021). Interaction Effects of Situational Context on the Acceptance Behaviour and the Conscientiousness Trait towards Intention to Adopt: Educational Technology Experience in Tertiary Accounting Education. Educational Technology & Society, 24(3), 61–84. https://doi.org/10.30191/ETS.202107_24(3).0005
Special Issue Articles
Haoran Xie, Gwo-Jen Hwang and Tak-Lam Wong
Haoran Xie
Department of Computing and Decision Sciences, Lingnan University, Hong Kong SAR // hrxie2@gmail.com
Gwo-Jen Hwang
Graduate Institute of Digital Learning and Education, National Taiwan University of Science and Technology, Taiwan // gjhwang.academic@gmail.com
Tak-Lam Wong
Department of Computing Studies and Information Systems, Douglas College, Canada // tlwong@ieee.org
ABSTRACT:
With the rapid development and significant successfulness of various deep learning techniques in artificial intelligence (AI) in recent years, the connotation of AI has been transformed from traditional rule-based or statistical learning models to deep learning models. Such a transformation of AI has led to a significant evolution in both academic and industrial fields. To understand the potential impact of AI evolution for future teaching and learning, it is necessary to re-examine the opportunities, research issues, and roles of AI in education as modern AI enables the possibility of playing vital roles in education, which are not only limited to intelligent tutors/tutees but also intelligent learning partners or policy making advisors. Motivated by the recent transformation and trends in AI in education, this special issue, including 13 research articles, aims to launch an in-depth discussion on re-examining AI and analytics techniques in teaching and learning applications.
Keywords:
Modern AI, AI transformation, Deep neural networks, Analytic techniques, AI in education
Xie, H., Hwang, G. J. & Wong, T. L. (2021). Editorial Note: From Conventional AI to Modern AI in Education: Re-examining AI and Analytic Techniques for Teaching and Learning. Educational Technology & Society, 24(3), 85–88. https://doi.org/10.30191/ETS.202107_24(3).0006
Ching Sing Chai, Pei-Yi Lin, Morris Siu-Yung Jong, Yun Dai, Thomas K. F. Chiu and Jianjun Qin
Ching Sing Chai
Department of Curriculum and Instruction & Centre for Learning Sciences and Technologies, The Chinese University of Hong Kong, Hong Kong, China // cschai@cuhk.edu.hk
Pei-Yi Lin
Department of Education, National Kaohsiung Normal University, Taiwan // pylin@nknu.edu.tw
Morris Siu-Yung Jong
Department of Curriculum and Instruction & Centre for Learning Sciences and Technologies, The Chinese University of Hong Kong, Hong Kong, China // mjong@cuhk.edu.hk
Yun Dai
Department of Curriculum and Instruction & Centre for Learning Sciences and Technologies, The Chinese University of Hong Kong, Hong Kong, China // yundai@cuhk.edu.hk
Thomas K. F. Chiu
Department of Curriculum and Instruction & Centre for Learning Sciences and Technologies, The Chinese University of Hong Kong, Hong Kong, China // tchiu@cuhk.edu.hk
Jianjun Qin
School of Mechanical-Electronic and Vehicle Engineering, Beijing University of Civil Engineering and Architecture, Beijing, China // qinjianjun@bucea.edu.cn
ABSTRACT:
Artificial Intelligence (AI) is increasingly popular, and educators are paying increasing attention to it. For students, learning AI helps them better cope with emerging societal, technological, and environmental challenges. This theory of planned behavior (TPB)-based study developed a survey questionnaire to measure behavioral intention to learn AI (n = 682) among primary school students. The questionnaire was administered online, and it measured responses to five TPB factors. The five factors were (1) self-efficacy in learning AI, (2) AI readiness, (3) perceptions of the use of AI for social good, (4) AI literacy, and (5) behavioral intention. Exploratory factor analysis and a subsequent confirmatory factor analysis were used to validate this five-factor survey. Both analyses indicated satisfactory construct validity. A structural equation model (SEM) was constructed to elucidate the factors’ influence on intention to learn AI. According to the SEM, all factors could predict intention to learn AI, whether directly or indirectly. This study provides new insights for researchers and instructors who are promoting AI education in schools.
Keywords:
Artificial intelligence, Self-efficacy, Readiness, Social good, Literacy, Behavioral intention
Cite as:Chai, C. S., Lin, P.-Y., Jong, M. S.-Y., Dai, Y., Chiu, T. K. F., & Qin, J. (2021). Perceptions of and Behavioral Intentions towards Learning Artificial Intelligence in Primary School Students. Educational Technology & Society, 24(3), 89–101. https://doi.org/10.30191/ETS.202107_24(3).0007
Gender Differences in Cognitive Load when Applying Game-Based Learning with Intelligent Robots
Beyin Chen, Gwo-Haur Hwang and Shen-Hua Wang
Beyin Chen
Department of Information Technology, Ling Tung University, Taiwan // byc@teamail.ltu.edu.tw
Gwo-Haur Hwang
Bachelor Program in Industrial Technology, National Yunlin University of Science and Technology, Taiwan // ghhwang0424@gmail.com
Shen-Hua Wang
Department of Information Management, Ling Tung University, Taiwan // happy0487587@gmail.com
ABSTRACT:
The application of artificial intelligence (AI) in education is now widespread, and the use of robots in education has demonstrated a positive influence on students’ behavior and development. However, the use of emerging technologies usually results in cognitive load, especially for elementary school students whose learning capacity has not yet been established. In addition, students of different genders have different physical, psychological and learning characteristics, so gender differences affect cognitive load. Cognitive load can be divided into two types: positive cognitive load and negative cognitive load. Usually, positive cognitive load results in good learning performance while negative cognitive load results in bad learning performance. Therefore, we use the cognitive load theory to define learning efficiency as the co-impact of learning performance and cognitive load. We take game-based intelligent robots for Chinese idiom learning as an example, and explore the impacts of gender differences on elementary school students. To achieve these aims, this study combined games and Zenbo robots, and applied them to educate elementary school students in the use of Chinese idioms. Secondly, this study conducted an experiment and analyzed the experimental results. The participants were 24 fourth-grade elementary school students from the central region of Taiwan. Results showed that this system is more beneficial for boys as their cognitive load was significantly lower. Boys’ learning performance was also better, although the difference did not reach significance. Furthermore, learning efficiency for boys was significantly higher. Reasons for these results are explained.
Keywords:
Artificial intelligence, Cognitive load theory, Game-based learning, Gender differences, Robots
Cite as:Chen, B., Hwang, G.-H., & Wang, S.-H. (2021). Gender Differences in Cognitive Load when Applying Game-Based Learning with Intelligent Robots. Educational Technology & Society, 24(3), 102–115. https://doi.org/10.30191/ETS.202107_24(3).0008
Youmei Wang, Chenchen Liu and Yun-Fang Tu
Youmei Wang
Department of Educational technology, University of Wenzhou, 325035, China // wangyoumei@126.com
Chenchen Liu
Department of Educational technology, University of Wenzhou, 325035, China // lcc5424548@126.com
Yun-Fang Tu
Department of Educational technology, University of Wenzhou, 325035, China // Department of Library and Information Science, Research and Development Center for Physical Education, Health, and Information Technology, Fu Jen Catholic University, Taiwan // sandy0692@gmail.com
ABSTRACT:
Owing to the rapid advancements in artificial intelligence (AI) technologies, there has been increasing concern about how to promote the use of AI technologies in school settings to enhance students’ learning performance. Teachers’ intention to adopt AI tools in their classes plays a crucial role in this regard. Therefore, it is important to explore factors affecting teachers’ intention to incorporate AI technologies or applications into course designs in higher education. In this study, a structural equation modeling approach was employed to investigate teachers’ continuance intention to teach with AI. In the proposed model, 10 hypotheses regarding anxiety (AN), self-efficacy (SE), attitude towards AI (ATU), perceived ease of use (PEU) and perceived usefulness (PU) were tested, and this study explored how these factors worked together to influence teachers’ continuance intention. A total of 311 teachers in higher education participated in the study. Based on the SEM analytical results and the research model, the five endogenous constructs of PU, PEU, SN, and ATU explained 70.4% of the changes in BI. In this model, SN and PEU were the determining factors of BI. The total effect of ATU was 0.793, followed by SE, with a total effect of 0.554. As a result, the intentions of teachers to learn to use AI-based applications in their teaching can be predicted by ATU, SE, PEU, PU and AN. Among them, teachers’ SE positively influenced teachers’ PEU and ATU towards adopting AI-based applications, and also influenced PU through PEU. In addition, the relationship between teachers’ SE and AN was negatively correlated, which indicated that enhancing teachers’ SE could reduce their AN towards using AI-based applications in their teaching. Accordingly, implications and suggestions for researchers and school teachers are provided.
Keywords:
Artificial intelligence, Higher education, Anxiety, Self-efficacy, Technology acceptance model
Cite as:Wang, Y., Liu, C., Tu, Y.-F. (2021). Factors Affecting the Adoption of AI-Based Applications in Higher Education: An Analysis of Teachers’ Perspectives Using Structural Equation Modeling. Educational Technology & Society, 24(3), 116–129. https://doi.org/10.30191/ETS.202107_24(3).0009
Chia-An Lee, Jian-Wei Tzeng, Nen-Fu Huang and Yu-Sheng Su
Chia-An Lee
Department of Computer Science, National Tsing Hua University, Taiwan // ckstar2001@gmail.com
Jian-Wei Tzeng
Center for Teaching and Learning Development, National Tsing Hua University, Taiwan // darkdreams0802@gmail.com
Nen-Fu Huang
Department of Computer Science, National Tsing Hua University, Taiwan // nfhuang@cs.nthu.edu.tw
Yu-Sheng Su
Department of Computer Science and Engineering, National Taiwan Ocean University, Taiwan // ntouaddisonsu@gmail.com
ABSTRACT:
Massive open online courses (MOOCs) provide numerous open-access learning resources and allow for self-directed learning. The application of big data and artificial intelligence (AI) in MOOCs help comprehend raw educational data and enrich the learning process for students and instructors. Thus, we created two deep neural network models. The first model predicts learning outcomes on the basis of learning behaviors observed when students watch videos. The second is a novel exercise-based model that predicts if a student will correctly answer examination questions on relevant concepts. The study data were collected from two courses conducted on the National Tsing Hua University’s MOOCs platform. The first model accurately evaluated student performance on the basis of their learning behaviors, and the second model efficiently predicted student performance according to how they answered the exercise questions. In conclusion, our AI system remedies the present-day inability of MOOCs to evaluate student performance. Instructors can use the systems to identify poor-performing students and offer them more assistance on a timely basis.
Keywords:
Learning analytics, Educational big data, Massive open online courses, Artificial intelligence
Cite as:Lee, C.-A., Tzeng, J.-W., Huang, N.-F., & Su, Y.-S. (2021). Prediction of Student Performance in Massive Open Online Courses Using Deep Learning System Based on Learning Behaviors. Educational Technology & Society, 24(3), 130–146. https://doi.org/10.30191/ETS.202107_24(3).0010
Automatic Generation of Cloze Items for Repeated Testing to Improve Reading Comprehension
Albert C. M. Yang, Irene Y. L. Chen, Brendan Flanagan and Hiroaki Ogata
Albert C. M. Yang
Graduate School of Informatics, Kyoto University, Japan // yang.ming.35e@st.kyoto-u.ac.jp
Irene Y. L. Chen
Department of Accounting, National Changhua University of Education, Taiwan // irene@cc.ncue.edu.tw
Brendan Flanagan
Academic Center for Computing and Media Studies, Kyoto University, Japan // flanagan.brendanjohn.4n@kyoto-u.ac.jp
Hiroaki Ogata
Academic Center for Computing and Media Studies, Kyoto University, Japan // hiroaki.ogata@gmail.com
ABSTRACT:
Reviewing learned knowledge is critical in the learning process. Testing the learning content instead of restudying, which is known as the testing effect, has been demonstrated to be an effective review strategy. However, education research recommends that instructors generate practice tests, but this burdens teachers and may also hinder teaching quality. To resolve this issue, the current study applied a modern artificial intelligence technique (BERT) to automate the generation of tests and evaluate the testing effect through e-books in a university lecture (N = 74). The last 5 minutes of each course session were utilized to review the taught content by having students either answer cloze item questions or restudy the summary of the core concepts covered in the lecture. A reading comprehension pretest was conducted before the experiment to ensure that the differences in prior knowledge were nonsignificant between groups, and a posttest was performed to examine the effectiveness of testing. In addition, we evaluated students’ reading skills and reading engagement through their ability to identify key concepts and their interaction with e-books, respectively. A positive effect was observed for students who engaged in cloze item practice before the end of each class. The results indicated that the repeated testing group exhibited significantly better reading skills and engaged more with e-books than the restudying group did. More importantly, compared with only restudying the key concepts, answering the cloze items questions significantly improved students’ reading comprehension. Our results suggest that machine-generated cloze testing may benefit learning in higher education.
Keywords:
Modern AI, Repeated testing, Testing effect, Test-enhanced learning
Cite as:Yang, A. C. M., Chen, I. Y. L., Flanagan, B., & Ogata, H. (2021). Automatic Generation of Cloze Items for Repeated Testing to Improve Reading Comprehension. Educational Technology & Society, 24(3), 147–158. https://doi.org/10.30191/ETS.202107_24(3).0011
Owen H. T. Lu, Anna Y. Q. Huang, Danny C. L. Tsai and Stephen J. H. Yang
Owen H. T. Lu
College of Computer Science, National Pingtung University, Taiwan // owen.lu.academic@gmail.com
Anna Y. Q. Huang
Department of Computer Science and Information Engineering, National Central University, Taiwan // anna.yuqing@gmail.com
Danny C. L. Tsai
Department of Computer Science and Information Engineering, National Central University, Taiwan // dan860202@gmail.com
Stephen J. H. Yang
Department of Computer Science and Information Engineering, National Central University, Taiwan // stephen.yang.ac@gmail.com
ABSTRACT:
Human-guided machine learning can improve computing intelligence, and it can accurately assist humans in various tasks. In education research, artificial intelligence (AI) is applicable in many situations, such as predicting students’ learning paths and strategies. In this study, we explore the benefits of repetitive practice of short-answer questions could enhance students’ long-term memory for subsequent improvements in learning performance. However, frequent authoring questions and grading requires teachers’ professionalism, experience, and considerable efforts. Therefore, this study using modern AI technologies, specifically natural language processing, to provide Automatic question generation (AQG) solution, a combined semantics-based and syntax-based question generation system: Hybrid automatic question generation (Hybrid-AQG) was proposed in this study. We assessed its functionality and student learning performance by asking 91 students to complete short-answer questions and then applied a process similar to the Turing test to evaluate the question and grading quality. The results demonstrated that modern AI technologies can generate highly realistic short-answer questions because: (1) Compared with the control group, the experimental group exhibited significantly better learning performance, implying that students acquired long-term memory of course knowledge through repetitive practice with machine-generated questioning. (2) The experimental group could better distinguish machine-generated and expert-authored questions. Nevertheless, both groups in distinguishing questions presented like guessing. (3) Machine grading was deficient in some respects; but the way students answer questions can be adapted for machine understanding through repetitive practice.
Keywords:
Automatic question generation, Learning performance, Artificial intelligence, Practice testing, Turing test
Cite as:Lu, O. H. T., Huang, A. Y. Q., Tsai, D. C. L., & Yang, S. J. H. (2021). Expert-Authored and Machine-Generated Short-Answer Questions for Assessing Students’ Learning Performance. Educational Technology & Society, 24(3), 159–173. https://doi.org/10.30191/ETS.202107_24(3).0012
Lanqin Zheng, Lu Zhong, Jiayu Niu, Miaolang Long and Jiayi Zhao
Lanqin Zheng
School of Educational Technology, Faculty of Education, Beijing Normal University, Beijing, China // bnuzhenglq@bnu.edu.cn
Lu Zhong
School of Educational Technology, Faculty of Education, Beijing Normal University, Beijing, China // bnuzhongl@mail.bnu.edu.cn
Jiayu Niu
School of Educational Technology, Faculty of Education, Beijing Normal University, Beijing, China // 201921010201@mail.bnu.edu.cn
Miaolang Long
School of Educational Technology, Faculty of Education, Beijing Normal University, Beijing, China // 202021010199@mail.bnu.edu.cn
Jiayi Zhao
School of Educational Technology, Faculty of Education, Beijing Normal University, Beijing, China // jiayizhao@mail.bnu.edu.cn
ABSTRACT:
In recent years, the rapid development of artificial intelligence has increased the power of personalized learning. This study aimed to provide personalized intervention for each group participating in computer-supported collaborative learning. The personalized intervention adopted a deep neural network model, Bidirectional Encoder Representations from Transformers (BERT), to automatically classify online discussion transcripts and provide classification results in real time. Personalized feedback and recommendations were automatically generated from the classification results. A quasi-experimental research design was adopted to examine the effects of the proposed personalized intervention approach on collaborative knowledge building, group performance, socially shared metacognitive regulation, and cognitive load. Sixty-six college students participated in this study and were randomly assigned to the experimental and control groups. For online collaborative learning, students in the experimental group adopted the personalized intervention approach, whereas those in the control group used the conventional approach. Both quantitative and qualitative research methods were adopted to analyze data. The results indicated significant differences in the level of collaborative knowledge building and group performance between the experimental and control groups. Furthermore, the experimental group demonstrated more socially shared metacognitive regulation than the control group. There was no significant difference in cognitive load between the experimental and control groups. The results obtained from interviews were consistent with the quantitative data. The main findings together with the implications for practitioners are discussed in depth.
Keywords:
Personalized intervention, Deep neural network, Collaborative learning, Knowledge building, Socially shared metacognitive regulation
Cite as:Zheng, L., Zhong, L., Niu, J., Long, M., & Zhao, J. (2021). Effects of Personalized Intervention on Collaborative Knowledge Building, Group Performance, Socially Shared Metacognitive Regulation, and Cognitive Load in Computer-Supported Collaborative Learning. Educational Technology & Society, 24(3), 174–193. https://doi.org/10.30191/ETS.202107_24(3).0013
Teachable Agent Improves Affect Regulation: Evidence from Betty’s Brain
Jian-Hua Han, Keith Shubeck, Geng-Hu Shi, Xiang-En Hu, Lei Yang, Li-Jia Wang, Wei Zhao, Qiang Jiang and Gautum Biswas
Jian-Hua Han
School of Information Science and Technology, Northeast Normal University, China // hanjh675@nenu.edu.cn
Keith Shubeck
Department of Psychology, The University of Memphis, USA // Institute for Intelligent Systems, The University of Memphis, USA // keithshubeck@gmail.com
Geng-Hu Shi
Department of Psychology, The University of Memphis, USA // Institute for Intelligent Systems, The University of Memphis, USA // genghushi@gmail.com
Xiang-En Hu
Department of Psychology, The University of Memphis, USA // Institute for Intelligent Systems, The University of Memphis, USA // School of Psychology, Central China Normal University, China // Electrical and Computer Engineering, The University of Memphis, USA // xiangenhu@gmail.com
Lei Yang
School of Psychology, Central China Normal University, China // yungly@mails.ccnu.edu.cn
Li-Jia Wang
Institute for Intelligent Systems, The University of Memphis, USA // Electrical and Computer Engineering, The University of Memphis, USA // wlj54188@gmail.com
Wei Zhao
School of Information Science and Technology, Northeast Normal University, China // zhaow577@nenu.edu.cn
Qiang Jiang
School of Information Science and Technology, Northeast Normal University, China // jiangqiang@nenu.edu.cn
Gautum Biswas
Institute for Software Integrated Systems, Vanderbilt University, USA // gautam.biswas@vanderbilt.edu
ABSTRACT:
Intelligent learning technologies are often applied within the educational industries. While these technologies can be used to create learning experiences tailored to an individual student, they cannot address students’ affect accurately and quickly during the learning process. This paper focuses on two core research questions. How do students regulate affect and what are the processes that affect regulation? First, this paper reviews the affect regulation methods and processes in an intelligent learning environment based on affective transition and affect compensation. This process, along with affect analysis, affect regulation, intelligent agents, and an intervention strategy can be used to analyze specific affect regulation methods and improve the affective regulation system. Seventy-two 7th grade students were randomly placed into an experimental condition that used Betty’s Brain, an intelligent tutoring system (ITS), or a classroom control. A lag sequence analysis and a multinomial processing tree analysis of video data captured at 25-minute intervals revealed significant differences in affect transitions frequencies between the two groups. Based on the results of the above analyses and after-class interviews, we found that Betty’s Brain was able to promote effective affect-regulation strategies to students in the domain of forest ecosystems.
Keywords:
Teachable agent, Affect, Regulation, Tutoring, Betty’s Brain
Cite as:Han, J.-H., Shubeck, K., Shi, G.-H., Hu, X.-E., Yang, L., Wang, L.-J., Zhao, W., Jiang, Q., & Biswas, G. (2021). Teachable Agent Improves Affect Regulation: Evidence from Betty’s Brain. Educational Technology & Society, 24(3), 194–209. https://doi.org/10.30191/ETS.202107_24(3).0014
Changqin Huang, Xuemei Wu, Xizhe Wang, Tao He, Fan Jiang and Jianhui Yu
Changqin Huang
Key Laboratory of Intelligent Education Technology and Application of Zhejiang Province, Zhejiang Normal University, Jinhua, China // School of Information Technology in Education, South China Normal University, Guangzhou, China // cqhuang@zju.edu.cn
Xuemei Wu
School of Information Technology in Education, South China Normal University, Guangzhou, China // wuxuemei@m.scnu.edu.cn
Xizhe Wang
Key Laboratory of Intelligent Education Technology and Application of Zhejiang Province, Zhejiang Normal University, Jinhua, China // xzwang@zjnu.edu.cn
Tao He
School of Information Technology in Education, South China Normal University, Guangzhou, China // tao.he2016@gmail.com
Fan Jiang
Key Laboratory of Intelligent Education Technology and Application of Zhejiang Province, Zhejiang Normal University, Jinhua, China // jiangfan1116@foxmail.com
Jianhui Yu
Key Laboratory of Intelligent Education Technology and Application of Zhejiang Province, Zhejiang Normal University, Jinhua, China // jianhuiyu@126.com
ABSTRACT:
Collaborative reflection (co-reflection) plays a vital role in collaborative knowledge construction and behavior shared regulation. Although the mixed effect of online co-reflection was reported in the literature, few studies have comprehensively examined both individual and group factors and their relationships that affect the co-reflection level. Therefore, this study explored the structural relationships between achievement goals (task-based, self-based, and other-based goals), online community identification, and co-reflection, which can consequently assist instructors in improving the related pedagogical strategies. To this end, 26813 posts on MOOC and college online learning platforms were gathered. Specifically, deep learning techniques were first used to train a classifier that classifies the large-scale co-reflection text automatically. The Bayesian method was then applied to disclose the structural relationships among achievement goals, community identification, and co-reflection. The results showed that the proposed classification algorithm achieved the best performance. Two best-fit models for characterizing the respective relationships between co-reflection and community identification as well as achievement goals were obtained using the Bayesian method. The results of the experiments on these two models demonstrated that both task-avoidance and other-avoidance goals were related directly to co-reflection, all task-approach, self-approach and other-approach goals were related indirectly to co-reflection, but self-avoidance goals had both a direct and an indirect relationship with co-reflection. The relationship between community identification and co-reflection was mediated by other-based goals. Some theoretical and practical implications were discussed for instructors and practitioners to build an online community.
Keywords:
Deep learning, Bayesian network, Achievement goals, Co-reflection, Community identification
Cite as:Huang, C. Q., Wu, X. M., Wang, X. Z., He, T., Jiang, F., & Yu, J. H. (2021). Exploring the Relationships between Achievement Goals, Community Identification and Online Collaborative Reflection: A Deep Learning and Bayesian Approach. Educational Technology & Society, 24(3), 210–223. https://doi.org/10.30191/ETS.202107_24(3).0015
Chun-Hung Lin, Chih-Chang Yu, Po-Kang Shih and Leon Yufeng Wu
Chun-Hung Lin
Center for Teacher Education, Chung Yuan Christian University, Taiwan // chlin@cycu.edu.tw
Chih-Chang Yu
Department of Information and Computer Engineering, Chung Yuan Christian University, Taiwan // ccyu@cycu.edu.tw
Po-Kang Shih
Center for General Education, Chung Yuan Christian University, Taiwan // sportgun@cycu.edu.tw
Leon Yufeng Wu
Graduate School of Education, Chung Yuan Christian University, Taiwan // leonwu@cycu.edu.tw
ABSTRACT:
This article describes STEM education with artificial intelligence (AI) learning, particularly for non-engineering undergraduate students. In the designed three-week learning activities, students were encouraged to put their ideas about AI into practice through two hands-on activities, utilizing a provided deep learning-based web service. This study designed pre-test and post-test surveys to investigate the performance of students in different aspects of AI. With 328 students involved in these learning activities, we discovered from the surveys that the proposed learning method can effectively improve AI literacy among non-engineering students. This study also found that students’ AI literacy correlated significantly with their awareness of AI ethical issues and that the STEM-based AI curriculum increased the awareness of AI ethical issues among low-AI-literate learners. This article discusses the association between learning activities and different aspects of AI learning. The proposed method can be used by teachers who want to introduce AI knowledge into general education courses.
Keywords:
Artificial intelligence, STEM education, General education, Non-engineering students, Artificial intelligence literacy
Cite as:Lin, C.-H., Yu, C.-C., Shih, P.-K. & Wu, L.-Y. (2021). STEM-based Artificial Intelligence Learning in General Education for Non-Engineering Undergraduate Students. Educational Technology & Society, 24(3), 224–237. https://doi.org/10.30191/ETS.202107_24(3).0016
Progress, Challenges and Countermeasures of Adaptive Learning: A Systematic Review
Fengying Li ,Yifeng He and Qingshui Xue
Fengying Li
School of Continuing Education, Shanghai Jiaotong University, Shanghai, China // fyli@sjtu.edu.cn
Yifeng He
Division for Development of Liberal Arts, Shanghai Jiaotong University, Shanghai, China // heyifeng0712@sjtu.edu.cn
Qingshui Xue
School of Computer Science and Information Engineering, Shanghai Institute of Technology, Shanghai, China // xue-qsh@sit.edu.cn
ABSTRACT:
With the deep application of artificial intelligence and big data in education, adaptive learning has become a new research hotspot in online education. Based on the systematic review of the connotation and research progress of adaptive learning, a new definition of adaptive learning is given. By literature analysis, this paper points out the challenges faced by adaptive learning research, such as the lack of cognition of brain and technology, the bottleneck of the model of emotion domain, the separation of education and technology, the security of data management and the risk of privacy leakage. These challenges can be summarized into two aspects: one is mechanical issues, the other is safety issues. Different from traditional research perspectives, the paper opens a new research window, and puts forward countermeasures from the perspectives of cognitive principles, zone of proximal development theory in technology, breakthrough in the emotional domain model, learning data management and privacy security. In view of the centralization of learning data management nowadays, the concept of code chain and the decentralized management mode based on code chain are proposed. Different from the traditional adaptive learning recommendation technology, a new adaptive learning pulling model is proposed.
Keywords:
Adaptive learning, Learning recommendation, Learning pulling, Code chain technology, Data security
Cite as:Li, F., H., Y., & X, Q. (2021). Progress, Challenges and Countermeasures of Adaptive Learning: A Systematic Review. Educational Technology & Society, 24(3), 238–255. https://doi.org/10.30191/ETS.202107_24(3).0018
Chuang-Kai Chiu and Judy C. R. Tseng
Chuang-Kai Chiu
College of Teacher Education, Wenzhou University, China // 20170006@wzu.edu.cn
Judy C. R. Tseng
Department of Computer Science and Information Engineering, Chung Hua University, Taiwan // judycrt@chu.edu.tw
ABSTRACT:
Awareness of students’ learning status, and maintaining students’ focus and attention during class are important issues in classroom management. Several observation instruments have been designed for human observers to document students’ engagement in class, but the processes are time-consuming and laborious. Recently, with the development of artificial intelligent technologies, artificial intelligence in education (AIED) has become an important research topic. Several studies have applied image recognition technologies to determine students’ learning status. However, little research has employed both sensor technology and image recognition technology in learning status analysis. Moreover, it remains unknown if learning status analysis is accurate enough to substitute for human observers. Furthermore, no feedback has been provided individually to students to manage their learning status by maintaining their attention in class. In this paper, a learning status management system in an intelligent classroom is proposed. Several types of information about students were detected and collected by both sensor technology and image recognition technology, and a Bayesian classification network was employed to inference the students’ learning status. Moreover, the system includes a feedback mechanism, which not only provides the results of the just-in-time learning status analysis to teachers, but also notifies students who are detected as being unfocused in class. Two experiments were conducted to verify the accuracy and effectiveness of the proposed system. Results showed that the learning status analysis highly corresponded to the observation of human beings, and the students were more attentive in class.
Keywords:
Classroom management, Intelligent classroom, Learning status analysis, Bayesian classification network
Cite as:Chiu, C.-K., & Tseng, J. C. R. (2021). A Bayesian Classification Network-based Learning Status Management System in an Intelligent Classroom. Educational Technology & Society, 24(3), 256–267. https://doi.org/10.30191/ETS.202107_24(3).0019
Starting from Volume 17 Issue 4, all published articles of the journal of Educational Technology & Society are available under Creative Commons CC-BY-ND-NC 3.0 license.