IMPACT OF INFORMATION COMMUNICATION TECHNOLOGY ON EDUCATION (IICTE): EVIDENCE FROM TWO FIELD EXPERIMENTS

Abstract

The advance and ubiquitous use of Information and Communication Technology (ICT) have changed how humans learn and reform the education sector. Although related topics have been studied in other disciplines (e.g., behavioral science, economics, psychology, etc.), IS researchers have paid less attention to the impacts of information communication technology on education (IICTE). Recently, education in the post-pandemic world calls for further investigation on this topic since most of the traditional on-site teaching around the world have moved online. The proposed two studies aim to contribute to the IS and the economics research on the role of technology in education and the underlying mechanisms of how ICT affects learning through a series of field experiments and data mining methods. The first study examines in-class mobile device use effects on students’ learning performance via a field experiment. It explores students’ attention allocation at an individual level with live video feed data. We collaborated with a vocational school in China to examine the effect of using smartphones in the classroom on students’ academic performance. We randomly allocated students taking one lecture in Chinese verbal into three experimental conditions: (i) smartphone banned; (ii) smartphone allowed and used at will by students, and (iii) smartphone allowed, used at will by students and relied upon by teachers to assist instruction. We measure the performance gain of students by the change in the scores they obtained in identical tests taken at the beginning and the end of the lecture. We find that allowing students to use smartphones during the lecture at will reduced performance by 12% (6.3 points on a 100-point scale) compared to when students could not take the smartphones into the classroom. However, allowing smartphones into the classroom and asking teachers to actively use them to assist instruction increased their performance by 20% (10.6 points). These results are driven mainly by already strong students and students in IT-related majors. To unravel the underlying mechanisms that drive the observed effects, we use video feeds collected during our experiment, allowing us to code the time students spent learning versus being distracted, with or without their smartphones. We observed that students spent a similar amount of time learning versus being distracted across all three experimental conditions. Thus, the time students allocate to learning in each condition does not predict performance. Instead, what matters for their performance is the relative time they spent learning versus being distracted when using their smartphones. We show that the increase in performance when smartphones are used to assist instruction comes from students spending a larger percentage of the time learning during the lecture. Our findings contribute to the literature on technology-assisted learning and offer practical and policy implications that teachers and schools can follow to cautiously allow smartphones in the classroom to improve student success. The second study investigates the effects of different Internet access policies on student performance via a field experiment and examines the underlying mechanisms of its impact by mining students’ online and offline behaviors. While universities invest a considerable amount to keep up with the increasing demand for Internet connectivity on campus, sufficient doubt exists on the overall efficacy of information communication technologies (ICTs) in enhancing learning. Therefore, it is essential to understand how the Internet is used on campus and whether educational institutions can design their ICT policies to improve education. To answer this question, we seek to investigate the effects of different Internet policies on educational outcomes (i.e., grades, other evaluation results, etc.) by conducting a randomized field experiment at a national public university in China. Specifically, we randomly assigned students to five experimental conditions for a whole semester: low bandwidth and limited data, low bandwidth with unlimited data, high bandwidth with limited data, high bandwidth with unlimited data, and high-quality access (high bandwidth without data limit) yet limited data to entertainment. We then collect and compare the educational outcomes and each student’s online and offline behaviors across all five conditions. With our unique context and micro-level data, we investigate the overall effect of different policies as well as the dynamics of students’ online and offline learning behaviors (i.e., online learning time, online-offline behavior change, etc.) to understand the underlying mechanisms (i.e., online/offline learning patterns on performance). Our study is the first to investigate the effect of ICT policy design on educational outcomes using a randomized controlled trial (RCT). We also offer practical guidelines to policymakers and educational institutions on optimizing campus Internet access to help improve students’ learning with the proper use of ICT. Ultimately, studies in this dissertation attempt to explore how ICT could boost learning and thus extend the boundary of IS research to the education sector. Results demonstrated in the dissertation offer clear and straightforward evidence for educators, parents, and students to make their own ICT use policies.