Database of comparison studies: Computer-assisted vs. classroom second/foreign language instruction

Overview
This database contains references to empirical second and foreign language studies comparing the effectiveness of computer-assisted pedagogy with other modes of instruction. Computer technology in these studies ranges from basic computer applications and computer-assisted language learning (CALL) programs to the Internet and course management systems. Comparisons are made between use of these technologies and face-to-face classroom teaching that does not involve any technology. This database was compiled to help CALL researchers efficiently identify relevant studies from a variety of sources including journals, reports, and unpublished doctoral dissertations.

Searching
The database can be searched using drop-down menus in some of the categories or using a user-supplied key word search in others. The complete list of studies in the database can be found in this pdf document.

Source of References
The studies in this database were obtained by a computer search of three electronic databases and hand search of six journals. The search covered the period from early 1970s to December 2006 and included studies that examined second and foreign language learners, non-native speakers of a language, who were given both traditional and some type of computer instruction (CALL as an add on course component, CALL as experiment, stand alone CALL course, or blended instruction).

The electronic databases, Linguistics and Language Behavior Abstracts (LLBA), Education Resources Information Center (ERIC), and Dissertation Abstracts (DA), abstract most of the relevant journals in language teaching and computer-assisted learning. The following terms in various combinations were used in the search: computer assisted language learning, computer assisted instruction, computer assisted learning, computer based instruction, computer instruction, traditional instruction, second language, foreign language, differ*, compar*, PLATO, and TICCIT. The database search produced around seventy references.

A more detailed manual search of the following journals was conducted: Computer Assisted Language Learning (CALL), System, CALICO Journal, ReCALL, Language Learning and Technology (LLT), and TESOL Quarterly. This search of the journals revealed some twenty articles other than those found through the database search because some of the journals were not abstracted (for example LLT) and some comparison studies did not contain the key words used in the search.

Contents
The database contains the following categories (defined as shown) and descriptors:

Category Definition Descriptors
Citation full source of the reference  
Primary skill skill the study focuses on reading, writing, vocabulary, communication, grammar, pronunciation, integrated skills, other skills
Secondary skill any additional language skills translation, learner strategies, vocabulary communication, reading, grammar
Language(s) taught second or foreign language taught in the study ESL, EFL, Spanish, French, German, Chinese, Russian, Japanese, Korean, Indonesian
Participants’ language level proficiency level
beginner, intermediate, advanced,varied
Number of participants total number of participants in the study  
Participants’ native language participants’ native language Spanish, English, Chinese, German, Japanese, Korean, Arabic, Afrikaans, Danish, Portuguese, Thai, varied
Setting setting where the study takes place kindergarten, primary, secondary, college, private language school, adult literacy center
Technology used computer technology employed CALL program, computer application, CMC, web, course management system, online course, simulation
Technology details name and short description of technology used  
Variable(s) dependent and independent variables
 
Description of groups number of groups/courses and their names  
Type of CALL aspect type of CALL aspect based on its length and integration into the language course stand alone CALL course, CALL as an add on component, CALL as experiment, blended learning
Length of CALL aspect duration of CALL aspect in hours, days, weeks, semesters  
Assignment assignment of participants random, non random, paired
Results overall results of the study significant difference, no significant difference, difference, no difference, mixed results
Results details short description of results  
Pedagogy details about the CALL pedagogy used in the study  
SLA second language acquisition aspect of the study (input, output, feedback, interaction, type of task, accuracy, focus on form)  

Research Synthesis
Based on the references in the database, a short synthesis of the comparison studies addressing seven skill/knowledge areas was written and it can be found here.

Author
This database was compiled by Maja Grgurovic, a doctoral student in the Applied Linguistics and Technology Program at Iowa State University. Although the best was done to include all sources, some may have been unintentionally missed. The author would encourage suggestions for addition of studies and comments at

Page last updated May 21, 2007