Assessment Literacy: A Study of EFL Teachers’ Assessment Knowledge, Perspectives, and Classroom Behaviors
AuthorAl Bahlani, Sara Mohammed
ESL/ EFL Assessment
Language Assessment practices
Teacher Training on Assessment
MetadataShow full item record
PublisherThe University of Arizona.
RightsCopyright © is held by the author. Digital access to this material is made possible by the University Libraries, University of Arizona. Further transmission, reproduction, presentation (such as public display or performance) of protected items is prohibited except with permission of the author.
EmbargoRelease after 12/01/2019
AbstractTeacher assessment literacy is essential to the success of teaching (T. H. Wang et al., 2008), the quality of student learning (DeLuca, Klinger, Searle, & Shulha, 2010; Mertler, 2004; White, 2009) and student learning motivation (Alkharusi, 2013; Dorman & Knightley, 2006). However, studies have consistently shown inadequate levels of assessment literacy for both pre-service and in-service teachers in language teaching and general education (Alkharusi, 2011; Malone, 2013; Mertler & Campbel1, 2005; Plake & Impara, 1992). This dissertation research aims to understand the current state of EFL teacher assessment literacy in six colleges of applied sciences in Oman by investigating teacher self-perceived language assessment literacy (competence and frequency of practice) as well as assessment knowledge and practice in the classroom. Its theoretical framework are Brookhart’s (2011) contemporary conceptualizations of formative assessment, Eyal’s (2012) discussion of digital assessment literacy as an important component in measuring teacher assessment literacy and Alkharusi’s (2009; 2010) methodological approach to investigating assessment literacy. This study implements a mixed-method approach using a triangulation of five data sources including self-assessment surveys, a language assessment knowledge test, an assessment evaluation task, classroom observations with a focus on teacher-produced assessment tasks, and teacher interviews. Multivariate analyses were used to examine relations between assessment literacy and participant background characteristics, such as gender, academic preparation, teaching experience, experience as coordinators, pre-service training, and in-service training. Research findings point to strengths and weaknesses in EFL teacher assessment literacy as well as matches and mismatches between teachers’ self-perceived assessment literacy and demonstrated assessment knowledge. Overall EFL teachers view themselves as moderately competent in language assessment. The variable with the strongest effect on teacher’s assessment literacy was pre-service training in assessment. The study discusses implications of research findings and offers suggestions for EFL teacher preparation programs, teaching institutions, and future research.
Degree ProgramGraduate College
Second Language Acquisition & Teaching
Degree GrantorUniversity of Arizona
Showing items related by title, author, creator and subject.
American Indian Transportation Committee Field Assessment of Cultural Sites Regarding the U.S. Department of Energy Pre-Approval Draft Environmental Assessment of Intermodal Transportation of Low-Level Radioactive Waste to the Nevada Test Site.Arnold, Richard; Booth, Elliot; Cornelius, Betty; Eddy, Larry; Hooper, Milton; Howard, Ted; Myers, Calvin; Moose, Gaylene; Stoffle, Richard, W.; Toupal, Rebecca; et al. (Bureau of Applied Research in Anthropology, University of Arizona, 1999-02-08)
DECISION SUPPORT FOR RAPID ASSESSMENT OF TRUTH AND DECEPTION USING AUTOMATED ASSESSMENT TECHNOLOGIES AND KIOSK-BASED EMBODIED CONVERSATIONAL AGENTSNunamaker, Jr., Jay F.; Patton, Mark; Nunamaker, Jr., Jay F.; Burgoon, Judee K.; Zeng, Daniel; Koput, Ken (The University of Arizona., 2009)A pressing need exists for effective decision support systems to facilitate the rapid and accurate screening of large volumes of people. Millions of travelers transit through international borders and secure areas on an annual basis. Humans are exceptionally poor at detecting lying and deception and perform, on average, no better than chance. This research study focuses on the development, design and implementation of a Kiosk for Rapid Assessment of Deception (K-RAD) that integrates questioning with response processing and deception detection. An exploratory pilot study (N=68) and a primary study (N=225) were executed.The K-RAD was designed to have a three-dimensional figure, an "Embodied Conversational Agent" (ECA), deliver the questions through speech. This delivery mechanism was chosen because human subjects have been shown in the past to react emotionally to ECAs during conversational interactions, and emotional arousal is one of the cues to deception. Responses were analyzed for deception cues, focusing on kinesic, linguistic, and vocalic characteristics that can be captured for automated processing and which would be unique to this setting.The results show unique subject behaviors. Subjects exhibited minimal movement and had very little tendency to change posture. Some subjects (6%) referred to the ECA as an authority figure, using "sir" when responding. Subjects positioned themselves at varying distances from the ECA, with significant gender differences. Post-experiment surveys indicated a gender difference in overall stress, with female subjects reporting significantly higher levels, independent of the experimental condition.Postural-based logistic regression created significant classification models for the pilot (59.1% classification accuracy) and primary (57.2% & 62.8% classification accuracies) studies. Movement analysis had varying and conflicting results. A robust deception index with a 68.1% classification accuracy was achievable in the pilot study based on high-frequency movement and arm placement. Primary study deception indices were not significant.The results include a comprehensive set of observations and lessons learned regarding kiosk design, deception technologies, detection effectiveness, and future considerations to take into account when creating a next-generation K-RAD system. Many challenges remain, but the concept is functional, promising, and could revolutionize security screening and deception detection in a variety of settings.
Occupational Stress Risk Assessment: Assessing the Impact of Health Promotion Lifestyle and Perceived Nature Contact on Nursing Health and WellnessReynolds, Kelly; Scanlon, Molly Marion; Reynolds, Kelly; Lutz, Eric; Carmona, Richard; Hsu, Chiu-Hsieh (Paul) (The University of Arizona., 2016)The purpose of the study was to perform a quantitative occupational stress risk assessment (OSRA) to evaluate the impact of health promotion (HP) lifestyle and perceived nature contact on the consequences of perceived stress from exposure to nursing stress risk factors. Perceived stress is defined as the employee’s personal interpretation of his or her work circumstance and any discrepancy between workplace demands (stressors) and individual capacities (resources). Registered nurses (RNs) in patient care settings are prone to high levels of perceived stress, which can cause errors in clinical care giving. High perceived stress is a consequence of risk factors from a nurse’s daily work routine including: workload, death and dying, inadequate preparation for role, staff support, uncertainty concerning treatment, communication with physicians, and communication with other nurses. Mitigating perceived stress improves nursing job performance, job satisfaction, and overall employee health, while reducing mental fatigue, absenteeism, and burnout. Methods performed included: Aim 1) a systematic literature and meta-analysis to establish benchmarks for perceived stress in nursing professionals for comparison of United States (US) and International healthcare settings; Aim 2) a cross-sectional study using a 125-item survey instrument administered online to an RN study population to evaluate relationships between perceived stress, HP lifestyle, and perceived nature contact; and Aim 3) a quantitative OSRA to rank nursing stress risk factors and examine differences by gender, ethnicity, and race. Results were: Aim 1) Perceived Stress Scale 14-item (PSS14) value for International nursing studies was 25.41 (95% CI 21.1 to 29.7), while US PSS14 nursing studies yielded a value of 23.8 (95% CI 19.8 to 27.7). Aim 2) the present study found Southern California RNs (n=161) had the same perceived stress (m = 22.8, 7.06 SD, p=0.082) as other US nursing professionals. RN perceived stress scores were negatively correlated (p<0.001) to HP lifestyle. HP lifestyle was positively correlated (p<0.001) to perceived nature contact. Aim 3) the OSRA model using HP lifestyle for coping exhibited the highest strength (92%) and reliability (90%); this model established RNs' risk factor rankings (RFRs) from high to low as: 1) communication with physicians, 2) workload, 3) uncertainty concerning treatment, 4) death and dying, 5) inadequate preparation for role, 6) communication with other nurses, and 7) staff support. High nursing RFRs were the same by gender. Differences were found with Hispanic RNs who ranked communication with other nurses as RFR 3 compared to non-Hispanic RNs at RFR 7. Also, non-white RNs ranked inadequate preparation for role as RFR 2 compared to white RNs at RFR 5. Although present study results focused on a single health provider RN population using self-reported survey instruments, the OSRA process can be applied to any occupational setting. This study supports introducing a quantitative OSRA process initiated in Europe to US worksites to identify and rank occupational stress risk factors for strategic prioritization and alignment with interventional resources. With continuous replication of OSRA within and between work-sectors, this process could elucidate US industry health and safety best practices. The present study focused on nurses as a first-test-case high-stress occupation. More OSRA nursing studies are recommended across a wider US geographic area to create normative values of comparison including stratum for gender, ethnicity, and race. Intervention, intervention effectiveness, and organizational change studies are needed to mitigate high nursing stress risk factors emanating from healthcare organizational challenges and to emphasize implications for improved patient care outcomes.