Assessment Literacy: A Study of EFL Teachers’ Assessment Knowledge, Perspectives, and Classroom Behaviors
Author
Al Bahlani, Sara MohammedIssue Date
2019Keywords
Assessment LiteracyESL/ EFL Assessment
Langauge Assessment
Language Assessment practices
Teacher Perceptions
Teacher Training on Assessment
Advisor
Ecke, Peter
Metadata
Show full item recordPublisher
The University of Arizona.Rights
Copyright © is held by the author. Digital access to this material is made possible by the University Libraries, University of Arizona. Further transmission, reproduction, presentation (such as public display or performance) of protected items is prohibited except with permission of the author.Embargo
Release after 12/01/2019Abstract
Teacher assessment literacy is essential to the success of teaching (T. H. Wang et al., 2008), the quality of student learning (DeLuca, Klinger, Searle, & Shulha, 2010; Mertler, 2004; White, 2009) and student learning motivation (Alkharusi, 2013; Dorman & Knightley, 2006). However, studies have consistently shown inadequate levels of assessment literacy for both pre-service and in-service teachers in language teaching and general education (Alkharusi, 2011; Malone, 2013; Mertler & Campbel1, 2005; Plake & Impara, 1992). This dissertation research aims to understand the current state of EFL teacher assessment literacy in six colleges of applied sciences in Oman by investigating teacher self-perceived language assessment literacy (competence and frequency of practice) as well as assessment knowledge and practice in the classroom. Its theoretical framework are Brookhart’s (2011) contemporary conceptualizations of formative assessment, Eyal’s (2012) discussion of digital assessment literacy as an important component in measuring teacher assessment literacy and Alkharusi’s (2009; 2010) methodological approach to investigating assessment literacy. This study implements a mixed-method approach using a triangulation of five data sources including self-assessment surveys, a language assessment knowledge test, an assessment evaluation task, classroom observations with a focus on teacher-produced assessment tasks, and teacher interviews. Multivariate analyses were used to examine relations between assessment literacy and participant background characteristics, such as gender, academic preparation, teaching experience, experience as coordinators, pre-service training, and in-service training. Research findings point to strengths and weaknesses in EFL teacher assessment literacy as well as matches and mismatches between teachers’ self-perceived assessment literacy and demonstrated assessment knowledge. Overall EFL teachers view themselves as moderately competent in language assessment. The variable with the strongest effect on teacher’s assessment literacy was pre-service training in assessment. The study discusses implications of research findings and offers suggestions for EFL teacher preparation programs, teaching institutions, and future research.Type
textElectronic Dissertation
Degree Name
Ph.D.Degree Level
doctoralDegree Program
Graduate CollegeSecond Language Acquisition & Teaching
Degree Grantor
University of ArizonaCollections
Related items
Showing items related by title, author, creator and subject.
-
American Indian Transportation Committee Field Assessment of Cultural Sites Regarding the U.S. Department of Energy Pre-Approval Draft Environmental Assessment of Intermodal Transportation of Low-Level Radioactive Waste to the Nevada Test Site.Arnold, Richard; Booth, Elliot; Cornelius, Betty; Eddy, Larry; Hooper, Milton; Howard, Ted; Myers, Calvin; Moose, Gaylene; Stoffle, Richard, W.; Toupal, Rebecca; et al. (Bureau of Applied Research in Anthropology, University of Arizona, 1999-02-08)
-
DECISION SUPPORT FOR RAPID ASSESSMENT OF TRUTH AND DECEPTION USING AUTOMATED ASSESSMENT TECHNOLOGIES AND KIOSK-BASED EMBODIED CONVERSATIONAL AGENTSNunamaker, Jr., Jay F.; Patton, Mark; Nunamaker, Jr., Jay F.; Burgoon, Judee K.; Zeng, Daniel; Koput, Ken (The University of Arizona., 2009)A pressing need exists for effective decision support systems to facilitate the rapid and accurate screening of large volumes of people. Millions of travelers transit through international borders and secure areas on an annual basis. Humans are exceptionally poor at detecting lying and deception and perform, on average, no better than chance. This research study focuses on the development, design and implementation of a Kiosk for Rapid Assessment of Deception (K-RAD) that integrates questioning with response processing and deception detection. An exploratory pilot study (N=68) and a primary study (N=225) were executed.The K-RAD was designed to have a three-dimensional figure, an "Embodied Conversational Agent" (ECA), deliver the questions through speech. This delivery mechanism was chosen because human subjects have been shown in the past to react emotionally to ECAs during conversational interactions, and emotional arousal is one of the cues to deception. Responses were analyzed for deception cues, focusing on kinesic, linguistic, and vocalic characteristics that can be captured for automated processing and which would be unique to this setting.The results show unique subject behaviors. Subjects exhibited minimal movement and had very little tendency to change posture. Some subjects (6%) referred to the ECA as an authority figure, using "sir" when responding. Subjects positioned themselves at varying distances from the ECA, with significant gender differences. Post-experiment surveys indicated a gender difference in overall stress, with female subjects reporting significantly higher levels, independent of the experimental condition.Postural-based logistic regression created significant classification models for the pilot (59.1% classification accuracy) and primary (57.2% & 62.8% classification accuracies) studies. Movement analysis had varying and conflicting results. A robust deception index with a 68.1% classification accuracy was achievable in the pilot study based on high-frequency movement and arm placement. Primary study deception indices were not significant.The results include a comprehensive set of observations and lessons learned regarding kiosk design, deception technologies, detection effectiveness, and future considerations to take into account when creating a next-generation K-RAD system. Many challenges remain, but the concept is functional, promising, and could revolutionize security screening and deception detection in a variety of settings.
-
Assessing Efficacy of NanoCeram Filters For Virus Concentration From Water: Risk Assessment for Listeria and Salmonella in FoodGerba, Charles P.; Pepper, Ian L.; Soto Beltran, Johana Marcela; Reynolds, Kelly A.; Bright, Kelly B.; Chaidez Quiroz, Cristobal; Gerba, Charles P.; Pepper, Ian L. (The University of Arizona., 2011)Water quality, and therefore human health, may be significantly affected by the presence of pathogenic enteric microorganisms derived for improper disposal of wastewater to aquatic environments. Detection of waterborne viruses is complex due to the difficulties in concentrating the sample and then in detecting the virus by cell culture or molecular techniques. Methods used to concentrate enteric viruses from water have remained largely unchanged for nearly 30 years. The U.S. Environmental Protection Agency requires the use of 1MDS electropositive filters for concentrating enteric viruses from water; however, these filters are expensive for routine viral monitoring. The NanoCeram® filter, an electropositive cartridge filter, has been proposed as a new alternative for large volumes of water. The objective of the study was: to evaluate the effectiveness of NanoCeram® filters for the concentration of poliovirus-1 from wastewater samples and compare to 1MDS cartridge filters. This study suggested that NanoCeram® filters are a viable alternative to the use of 1MDS filters for viral monitoring in surface waters and wastewaters. L. monocytogenes outbreaks with Latin-style soft cheese have been well-documented; however, more information to characterize the human health risk associated with the consumption of queso fresco (QF) using unpasteurized milk is needed. The objectives of the study were: i) to evaluate the prevalence of Listeria, Escherichia coli, Salmonella and fecal coliforms in QF obtained from markets in the northwestern state of Sinaloa, Mexico, and ii) to address the human health impact associated with the consumption of QF contaminated with L. monocytogenes using quantitative microbial risk assessment (QMRA). The study suggested that QF produced in Culiacan, Sinaloa, Mexico have microbial loads above the maximum values recommended by the Official Mexican Regulations; and QMRA can be used to interpret microbial contamination data for impacts on public health.