This section is structured according to the five overarching themes categorised from the findings. As the core of washback research (Messick, 1996), causality related to teachers’ perspectives are examined.
Teachers’ perspectives about the constructs tested in the CPEFE
This part focused on the first research question, namely teachers’ views on the constructs tested in the CPEFE and its influence on the teaching focus and test preparation.
1. Teachers’ general views on the CPEFE
When asking their views on the CPEFE, all participants distinguish its advantages and weaknesses. In terms of the pros, the teachers regarded the CPEFE as a formative and diagnostic test, showing students’ mastery of English knowledge taught in the classroom. As Teacher A described:
“The test is a comprehensive evaluation, from which I have a clear view on students' English knowledge learned in this semester.”
From the description above, Teacher A believed that the CPEFE provides a comprehensive understanding of students’ learning condition, laying a foundation for more effective teaching review and planning. This view represents the main aim of the CPEFE (MOE, 2022), namely to check students’ performance and gather learning and teaching feedback, showing the correspondence between tests, stakeholders and curriculum aims. In contrast, if the elements discussed above lack alignment, negative washback effects will occur (Pan & Newfileds, 2012). However, as for the cons of the CPEFE, the teachers’ views varied. They considered this issue from both micro and macro levels, which aligns with Andrews, Fullilove and Wong’s (2002) classification logic of washback. At the micro level, believing that the paper-and-pencil test type is too rigorous for the pupils. As Teacher C commented:
“The exam content is rigid and monotonous. This paper test only focuses on discrete linguistic knowledge, therefore restricting students and affecting their confidence.”
Her critique shows that the test design and test content were not quite reasonable. If students at different levels use the same exam paper, their learning motivation and confidence can be adversely affected. Additionally, merely concentrating on linguistic knowledge, the test under-represents test takers’ other skills, such as logical thinking, critical thinking and creativity. In the macro context, two teachers considered the test’s negative washback on students’ all-round development. As Teacher E stated the following:
“Too much emphasis on scores limits students’ all-round development.”
Possibly, her belief is driven by educational policies from MOE, reflecting a shift of educational concepts from focusing on scores to pupils’ comprehensive development. As the two teachers had many years of teaching experience, they may have experienced the change of China’s educational policies and have a broader insight into the CPEFE.
2. The CPEFE’s emphasis on receptive abilities
According to the interviews, all teachers pointed out that the CPEFE prioritized receptive skills, especially reading skills. This finding aligns with the results of Akpinar and Cakildere’s (2013) study, and the emphasis on receptive constructs was attributed to students' ongoing knowledge accumulation. As Teacher D suggested the following:
“Pupils are accumulating knowledge since their language ability is still inadequate for output”.
Furthermore, reading can better reflect students’ integrated language ability because vocabulary, grammar, semantic knowledge, and discourse were more systematically tested in reading than in discrete listening items. As Teacher D stated the following:
“Students are still input-oriented, and comprehensive ability can be better reflected by reading.”
3. Teaching focus
Trying to teach all four skills to cultivate students’ comprehensive abilities, most teachers still prefer to spend more time on teaching reading (Zhan and Andres, 2014). As Teacher B commented the following:
“The test is designed based on textbooks focusing on receptive skills, so I still focus on teaching reading, ensuring my students get higher grades.”
The teacher mentioned the cause of this phenomenon, pointing out that students’ grades and teaching materials drove her to focus on reading skills. Unlike other teachers, Teacher A’s teaching focus was not influenced by the construct emphasised in the test. He stated the following:
“I pay attention to all aspects of ability training because with full practice, students will have no problem in passing the exam.”
The statement above mentioned the fundamental role of cultivating students’ comprehensive abilities. Language skills are interrelated, so the improvement of reading skills can lead to the promotion of other skills. The difference between the statements could be the result of diverse teaching backgrounds (Watanabe, 2004), resulting in Teacher A’s unfamiliarity with the test; therefore, the importance of the test might be underestimated.
4. Test preparation
Although Cheng (2004) found that teachers devote little preparation for tests, in the present study, it is surprising that large percentage of teachers give a systematic test preparation class before the exam. In this way, they can identify students’ weakness and ask pupils to pay attention. This action may help students avoid previous mistakes and achieve higher grades. As teacher E stated the following:
“Before the final exam, special review time will be set up to complete, evaluate and analyse papers in order to find the weak points.”
However, Teacher D asserted:
“During revision, I usually spend less time on deliberate exam preparation.”
She deemed that students’ overall language skills, which are directly related to grades, are more necessary, so she paid more attention to them. Nevertheless, she still spent time on test preparation due to the importance of the CPEFE, a reference for the matriculation of secondary schools.
Teaching content and methods
This Section investigated the second research question, the washback effect of the CPEFE on teaching content and methods.
Textbooks and supplementary materials
1. Completely following textbooks without supplementation
Surprisingly, Teacher A’s teaching content was less affected by the test since he completely followed the textbooks without adding any supplementary content. The reason could be that the young teacher lacked experience in arranging teaching content and selecting suitable teaching materials for a large class with students at diverse English levels (Watanabe, 2004). Therefore, he chose to completely follow the textbooks without self-selection. As teacher A stated:
“I can't even finish the textbook that is prescribed by the Educational Bureau. Besides, 55 students in my class have different English levels, so it is difficult to choose a material to suit everyone.”
The comment above showed that other than the teacher’s personal factors, such as experience and unfamiliarity, some external factors, including policies, class size and students’ diverse language levels can also affect teachers’ choice of teaching materials. Additionally, the lack of training also negatively affect teachers in evaluating and choosing appropriate materials. With less extended content, the teaching and learning process are tedious, therefore negatively affecting students’ learning interests, classroom atmosphere and teaching quality.
2. Focusing on textbooks with test-unrelated supplementary materials
Aligning with Qi’s (2004) finding, the present research reveals that Teacher C’s teaching content was not confined by the test since teaching basic linguistic knowledge was still emphasised. Focusing on textbooks, she was willing to add some test-unrelated materials. She commented:
“I find some textbook-related content as supplement. Truly, I don't like asking pupils to do test exercises in my class.”
Her choice of adding text-related knowledge is a significant way to help pupils broaden their horizons and better understand the texts, although they may lack the chance to know more about the test. Furthermore, Teacher C adopted picture books and multimedia materials, such as songs and videos, in her classes. As she said:
“I usually choose some novel videos, songs and picture books in my class to attract students.”
Those multi-media and authentic materials effectively simulate students’ interests and learning motivation (Wu, 2013), which play a significant role in primary English teaching, especially improving teaching quality. As she asserted the following:
“After students enhance their interest in learning, they will listen carefully to what I taught, therefore facilitating the improvement of my teaching quality.”
3. Teaching with textbooks and test-related supplementary materials
Nevertheless, partly affected by the CPEFE, the rest of the three teachers’ teaching was based on textbooks but allowed flexibility, including adding exam-related supplementary materials. The existence of washback effect on their teaching content is due to the importance of the test and the defects of the textbooks. As teacher E said:
“The Educational Bureau will evaluate teachers’ teaching quality according to students’ average test performance, the weather vane of exam adjustment .”
Her view showed that students’ performance in the test was a crucial basis of test design modification and could reflect teaching quality, which may influence teachers’ reputation and school ranking. Therefore, Teacher D and Teacher B added the importance of the CPEFE and test exercises:
“Since the final examination results of grade 6 will be used as a reference for junior high school matriculation, I arrange more test-related test exercises.”
They captured the close relationship of students’ performance on the CPEFE and junior high school matriculation, which reflects the huge washback effects made by the high-stake test. Teachers E added the following:
“I usually add some texts to enhance the practice of vocabularies and grammar tested in the exam, therefore improving pupils’ familiarization with the test.”
When choosing the supplementary materials, she considered their relationship with the exam, difficulty and suitability to young learners. Teaching test-related knowledge can enhance pupils’ familiarity with the test items and tasks, thereby promoting their test grades and teachers’ reputation.
Figure 4 summarises research findings above, reflecting the interrelation of the CPEFE, teaching content and teaching products. The blue arrows indicate the correlations. Teachers have diverse views on reading skill emphasised in CPEFE, which respectively influences teachers to focus on receptive skills. Then, teachers adopt test-oriented materials, test-unrelated materials or even without supplementary materials in classes. However, in the yellow dotted boxes, it seems that only test-oriented materials reflected the knowledge tested, and are likely to be directly affected by the CPEFE, showing the alignment of curriculum and the test. Therefore, test-related materials bring both positive and negative washback effects, which shown as the products, including test grades and teachers’ reputation that can be diagnosed by the test and reversely affect the design of the test.
Teaching methods: turning from traditional methods to CLT
In the interviews, all five participants declared that their teaching methods were affected by the CPEFE. The data showed that most teachers were shifting their teaching methods towards CLT, although the CPEFE influenced them to retain some traditional teaching methods.
1. Traditional test-oriented teaching method
Traditional cramming methods were still used in the classes. As teacher E commented:
“Our school is still traditional, focusing more on teachers speaking, students listening, and overloaded test exercises practising.”
Her view was supported by Teacher C who said the following:
“This test compels me to pay more attention to students' recitation of vocabulary, understanding of sentence and grammar, and translation.”
Focusing on recitation, discrete words, and grammatical knowledge and translation (Larsen-Freeman, 2011), GTM can improve students’ test grades and language accuracy in the short term. Nevertheless, it may negatively impact language fluency, flexible language use, students’ learning initiative, and logic/critical thinking ability (Deng, 2023).
2. Communicative Language Teaching (CLT) approach
Compared to test-oriented teaching methods, teachers also used some flexible, practical, and interactive methods of the CLT approach. Caring about pupils’ age and learning habit, teachers showed their reluctance of leveraging exam-oriented teaching method and the desire to use varied methods (Cheng, 2004), indicating a turn from a traditional grammar translation method to CLT. As Teacher A said the following:
“Considering the age of pupils, I cannot fully use test-oriented teaching methods but some richer or more interesting approaches instead.”
Unlike adults who care more about the knowledge itself, pupils may take the funny side of the content and ways of teaching seriously. They could be more willing to learn new knowledge with shifting and attractive teaching methods. An increased sense of engagement may appear if they actively take part in the teaching instead of listening to the teachers all the time.
Group work, including group discussion, was a teaching strategy used by most of the teachers to stimulate students’ enthusiasm for learning English through interaction with classmates, therefore promoting communication ability, language fluency, and accuracy (Harmer, 2007; Richards & Rodgers, 2014). It seemed that pupils can learn more and better when learning in groups than when learning by themselves because synergy emerges in shared learning. As teacher D claimed:
“I also arrange group discussions and role play to stimulate students’ initiative for independent learning. By sharing ideas, pupils could learn more and find problems in their own ideas, that is, 1 + 1 > 2.”
Teacher C supported her view by saying the following:
“After group practicing and mutual learning, their pronunciation, intonation, fluency or accuracy is improved.”
Asking questions, encouraging problem solving, and conducting guided teaching were other methods teachers used in classes. As Teacher D stated the following:
“Sometimes I ask questions. When students are in trouble, I encourage them to solve problems step by step. I like guiding them instead of helping them directly.”
The teachers were like guides and students were active participants, forming a learner-centred class phenomenon (Brown, 2001). Asking questions gradually cultivated students’ logical thinking and critical thinking ability. Furthermore, encouraging pupils to independently solve problems with scaffolding can promote their enthusiasm, pragmatic ability and independent learning ability, which could benefit their future learning.
Additionally, regularly giving feedback was popular in primary English teaching classes. As Teacher D asserted:
“Every month we need to give feedback on students’ reading assignments under the school’s supervision. Every day we will give feedback on homework.”
Giving feedback was a beneficial method of revision. When young learners got their homework feedback, they can notice their weakness and then try to avoid them, therefore gradually improving their overall language ability. Considering the young learners’ age, situational teaching strategies, such as teaching with games and role play, were used by three teachers to create a leisure learning environment, release learning stress, attract students, stimulate active learning and improve their confidence, sense of collectivity and learning motivation (Richards, 2005). Therefore, teaching quality could be improved. As Teacher A said the following:
“I am more inclined to play games to arouse students' enthusiasm, make them more attentive to lectures, enhance their sense of collective identity, and the classroom atmosphere will get better.”
However, two teachers felt that for sixth-grade pupils who need systematic language teaching to carry out logical operations (Painter, 2017), games were too easy and time-consuming.
Figure 5 highlights findings about teaching methods, showing the washback effect of the CPEFE on teaching methods, which appeared to be partly affected by the CPEFE and the CLT approach. Shown in the yellow dotted boxes, traditional grammar translation methods (GTM) has direct washback effects. The harness of GTM was directly affected by the test and reflected the aim of the test, namely, to diagnose what students have learned in the classes based on their grades, showing the alignment of teaching methods and the test. Therefore, GTM brought both positive and negative washback effects. However, the CLT approach were not affected by the CPEFE but still used in the classes due to political, individual and contextual factors.
Figure 6 summarises the result of the whole research, reflecting that the CPEFE influenced teachers and partly affected teaching processes. The emphasis of reading skills in the CPEFE affected teachers’ teaching focus and the time spent on test preparation. Furthermore, the CPEFE partly influenced teaching content and teaching methods. On the one hand, as shown in the yellow dotted box, the test encouraged test-oriented teaching materials and methods, producing both positive and negative washback effects. The teaching products, including students’ mastery of language knowledge, were diagnosed by the CPEFE and affect the test’s adjustment. On the other hand, teachers were not constrained by the test and catch the importance of the CLT approach, aiming to cultivate pupils’ overall language ability through long-term comprehensive language teaching. This summarised framework drew upon and complemented Bailey’s (1996) washback mechanism through merging the classification of washback, namely positive and negative washback (Messick, 1998) into it, therefore making the mechanism more practical and contextual (Xu & Liu, 2018).