Testing reading comprehension in English as a foreign language - Английский язык - Дипломные работы

Testing reading comprehension in English as a foreign language

Загружено в:

26.09.2019

Скачано:

0

Размер:

246 KB

On the theme : Testing reading comprehension in English as a foreign language. 1

Contents. Introduction………………………………………………………………….3. Chapter I. Understanding reading comprehension as a foreign language. 1.1 Receptive skills in the English language……………………………….8 1.2 Reading models and variables………………………………………….18 Chapter II. Testing reading comprehension in all levels. 2.1 Reading tasks in different CEFR levels…………………………………..28 2.2 Assessment criteria in reading activities………………………………….41 Conclusion. …………………………………………………………………….59 Bibliography …………………………………………………………………….61. 2

Introduction The actuality of the theme. Reading is an important skill for English language learners in today’s world; it supports the development of overall proficiency and provides access to crucial information at work and in studying process. With English being the dominant language of the Internet, international business, and academia, beginning and advanced students alike face pressures to develop their second language reading abilities. There are many scholars’ point of views on teaching reading and its affect in learning the second language. As well as teaching, testing reading is also important issue in learning or teaching foreign languages. Under the guidance of the President Shavkat Mirziyoyev, special attention is paid to the formation of harmoniously developed, highly educated, modern thinking generation, able to take responsibility for the fate of the Homeland. Therefore , the task of education, the task of rising up a new generation who is capable of national renaissance will remain the prerogative of the state and constitute a priority. At present great importance is attached to the study and teaching of foreign languages. As a proof of this was a new decree PD-2909 about the education in higher educational establishments 1 . “Knowing a language is wealth. The person who knows the language will be aware of the world. Our great ancestors were like this, this we have in our blood. We have to show this to our youth.” 2 The investigation of the problem. This problem was investigated by many scientists and the most useful of these linguistical ly oriented approaches to discourse have been developed by scholars such as Beaugrande and Dressier, Halliday and Hasan, Grimes many other scholars. The investigation is very significant because we would like to define the discourse and elements of discourse 1. The resolution No 2909 of the President of Uzbekistan “ On Measures for Further Development of the Higher Education System" dated from April 20, 2017 2. Mirziyoyev Sh.. From speech at Ibrat school, Namangan, April, 2018 3

The aim of the theme is to study thoroughly and t o reveal the to give about receptive skills of the target language and to make conclusions about the reading tasks of CEFR and what are the criteria of this document for reading. The object of the qualification paper is to study, analyze and most importantly investigate the process of testing reading and find reading tasks according to the different levels . The subject of the theme is to study of methods and techniques that are used in assessing reading tasks which are considered to be necessary for the qualification. The tasks of this qualification paper. To achieve the tasks which were put in forward we tried: 1) to collect materials related to the theme; 2 ) to select necessary theoretical literature; 3) to analyze the tasks according to different levels; 4) to make necessary conclusions; The methods of this qualification paper used in this qualification paper are assessing, evaluating and which are the main methods of paper. Methodological basis of this qualification paper. The Law of the Republic of Uzbekistan " On Education", "National Program of Training Cadres", 1875- Presidential Decree "On Measures to Further Improvement of Foreign Languages Teaching System", the First President Islam Karimov's and current President Shavkat Mirziyoyev’s works on education of young generation, scientific and theoretical literature related to the theme. The novelty of this qualification paper is that we have shown some reading tasks according CEFR and showed how to use them during the classes in different levels and we assume that this theme is new to clarify some ways that are implemented in the learning process and everyday life . The theoretical value of this qualification paper is that the theoretical position of the paper can be used in lectures on “Methodology”, “Reading” “Integrating skills in teaching foreign languages ”, and so on. 4

The practical value of this qualification paper This paper can be used as fundamental information for research works related to methodology. In addition, it includes a lot of materials which can be fruitful for self – studying for learners who are learning the English language. Furthermore , it can be used as a source of materials which provides wide information about the given theme. This research paper serves as an accurate guideline in control works for some subjects. The content and the structure of the qualification paper Introduction, main part, which includes two chapters, where each chapter consists of the two paragraphs, conclusion and bibliography. Introduction gives a brief list of the content of the research. Moreover it states the tasks, the actuality, and novelty, theoretical and practical value of the work. Chapter I entitled “ Understanding reading comprehension as a foreign language . ” and includes two paragraphs: In the first paragraph information is given about receptive skills in the English language. One of the receptive skills is reading. Below we would like to show characteristics of teaching reading to the learners. To get maximum benefit from their reading, students need to be involved in both extensive and intensive reading. Whereas with the former a teacher encourages students to choose for themselves what they read and to do so for pleasure and general language improvement, the latter is often teacher chosen and directed, and is designed to enable students to develop specific receptive skills. A key feature in the successful teaching of receptive skills concerns the choice of comprehension tasks. Sometimes such tasks appear to be testing the students rather than helping them to understand. Although reading and listening are perfectly proper mediums for language and skill testing, nevertheless, if we are trying to encourage students to improve their receptive skills, testing them will not be an appropriate way of accomplishing this. Second paragraph gives information about r eading models and variables. According to Stanovich’s model, reading involves a number of processes. Readers 5

who are weak in one process will rely on other processes to compensate for the weaker one. For example, a poor reader who is slow and inaccurate at word identification but knows a lot about the text subject will overcome his or her weakness by relying on his or her knowledge. Thus, the Stanovich model is interactive in the sense that any process, regardless of its position, may communicate with any other process in order to achieve comprehension. “However, the evidence that such compensation does in fact occur is controversial” The second chapter is called “Testing reading comprehension in all levels”. It has two paragraphs; first paragraph describes the nature of reading comprehension make it a challenging one. It is named as reading tasks in different CEFR levels. In this paragraph different methods of teaching and testing reading are described. Multiple choice is the most common method of testing language skills, and it is used in parts of some international language tests. The multiple- choice method is popular because it is objectively scored, fast and economical which make it possible to include more items in the same period of time and hence may increase test reliability and validity. Moreover, the multiple-choice method does not require other language skills such as writing. True/false judgements. In this format, the child reads or listens to a passage and is then presented with a number of statements, each of which is true or false with respect to the text. The second paragraph I will discuss some issues and considerations in language testing especially validity and reliability and test specifications . Reading assessments are used for many purposes, but all appropriate uses begin from an understanding of the reading construct, an awareness of the development of reading abilities, and an effort to reflect the construct in assessment tasks. The complexity of the construct of reading, as well as its development, also reveals the potential complexity of reading assessment. Assessment of reading proficiency is important as a way to understand students’ overall reading abilities based on some assumed construct of reading and to determine if students are appropriately prepared for further learning and educational advancement. 6

Conclusion deals with the theoretical and practical result of the research. Bibliography gives the list of used literature. 7

CHAPTER I. UNDERSTANDING READING COMPREHENSION AS A FOREIGN LANGUAGE. 1.1. Receptive skills in the English language Receptive skills are the ways in which people extract meaning from the discourse they see or hear. There are generalities about this kind of processing which apply to both reading and listening, but there are also significant differences between reading and listening processes too, and in the ways we can teach these skills in the classroom. When we read a story or a newspaper, listen to the news, or take part in conversation we employ our previous knowledge as we approach the process of comprehension, and we deploy a range of receptive skills; which ones we use will be determined by our reading or listening purpose. Each of us carries in our heads mental representations of typical situations that we come across. When we are stimulated by particular words, discourse patterns, or contexts, such schematic knowledge is activated and we are able to recognize what we see or hear because it fits into patterns that we already know. As Chris Tribble points out 1 , we recognize a letter of rejection or a letter offering a job within the first couple of lines. When we read a sign on the motorway our motives are different from when we read a detective novel; when we take an audiotape guide round a museum we have a different purpose in mind from when we listen to a stranger giving us directions on a street corner. We can divide reasons for reading and listening into two broad categories: instrumental and pleasurable. Instrumental reading and listening can be pleasurable too; reading history textbooks or going to history lectures or any other subject we are studying or which interests us may be done for fun as well as for some utilitarian purpose. There is a great deal of ‘crossover' between the two categories. But a consideration of the two types does at least 1 3 Tribble, C 1997 Writing Oxford University Press Tribble, C and Jones, G 1997 Concordances on the classroom Athelstan Publications p 125 8

allow us to consider different receptive skill styles, and helps us to ensure that we do not ignore genres which students need to be able to handle. The teaching and learning of receptive skills presents a number of particular problems which will need to be addressed. These are to do with language, topic, the tasks students are asked to perform, and the expectations they have of reading and listening. First we would like to stop on language. In the case of written text some researchers 4 look at word and sentence-length, on the premise that texts with longer sentences and longer words will be more difficult to understand than those with shorter ones. Others, however, claim that the critical issue is quite simply the number of unfamiliar words which the text contains. If readers and listeners do not know half the words in a text, they will have great difficulty in understanding the text as a whole. To be successful they have to recognize a high proportion of the vocabulary without consciously thinking about it . It is clear that both sentence length and the percentage of unknown words both play their part in a text’s comprehensibility. When students who are engaged in listening encounter unknown lexis it can be ‘like a dropped barrier causing them to stop and think about the meaning of a word and thus making them miss the next part of the speech’. Unlike reading, there may be no opportunity to go back and listen to the lexis again. Comprehension is gradually degraded, therefore, and unless the listener is able to latch on to a new element to help them back into the flow of what is being said the danger is that they will lose heart and gradually disengage from the receptive task since it is just too difficult. We can try and get students to read or listen to such texts, but the only effect this will probably have is to de-motivate them. Apart from the obvious point that the more language we expose students to the more they will learn, there are specific ways of addressing the problem of language difficulty: pre-teaching vocabulary, using extensive reading/listening, and considering alternatives to 4. Geva, E. (1983). Facilitating reading comprehension through flowcharting. Reading Research Quarterly, 18, 384-405. 9

authentic language. Pre-teaching vocabulary: one way of helping students is to pre- teach vocabulary that is in the reading or listening text. This removes at least some of the barriers to understanding which they are likely to encounter. However, if we want to give students practice in what it is like to tackle authentic reading and listening texts for general understanding then getting past words they do not understand is one of the skills they need to develop. By giving them some or all of those words we deny them that chance. An appropriate compromise is to use some possibly unknown words from a reading or listening text as part of our procedure to create interest and activate the students’ schemata, since the words may suggest topic, genre, or construction - or all three. The students can first research the meanings of words and phrases and then predict what a text with such words is likely to be about. Many receptive skill activities prove less successful than anticipated because the topic is not appropriate or because students are not familiar with the genre they are dealing with. If students are not interested in a topic, or if they are unfamiliar with the text genre we are asking them to work on, they may be reluctant to engage fully the activity. To resolve such problems we need to think about how we choose and use topics, and how we approach different reading and speaking genres. we should try and choose topics which our students will be interested in. We can find this out by questionnaires, interviews, or by the reactions of students in both current and previous classes to various activities and topics we have used. For this reason we need to include a variety of topics across a series of lessons so that all our students' interests will be catered for in the end. We can get students engaged by talking about the topic, by showing a picture for prediction, by asking them to guess what they are going to see or hear on the basis of a few words or phrases from the text, or by having them look at headlines or captions before they read the whole thing. Perhaps we will show them a picture of someone famous and get them to say if they know anything about that person before they read a text about them or hear them talking. A key feature in the successful teaching of receptive skills concerns the choice of comprehension tasks. Sometimes such tasks 10

appear to be testing the students rather than helping them to understand. Although reading and listening are perfectly proper mediums for language and skill testing, nevertheless, if we are trying to encourage students to improve their receptive skills, testing them will not be an appropriate way of accomplishing this. Sometimes texts and the tasks which accompany them are far too easy or far too difficult. In order to resolve these problems we need to use comprehension tasks which promote understanding and we need to match text and task appropriately. One of the receptive skills is reading. Below we would like to show characteristics of teaching reading to the learners. To get maximum benefit from their reading, students need to be involved in both extensive and intensive reading. Whereas with the former a teacher encourages students to choose for themselves what they read and to do so for pleasure and general language improvement, the latter is often teacher chosen and directed, and is designed to enable students to develop specific receptive skills. Extensive reading materials; one of the fundamental conditions of a successful extensive reading programme is that students should be reading material which they can understand. If they are struggling to understand every word, they can hardly be reading for pleasure - the main goal of this activity. Extensive reading tasks: because students should be allowed to choose their own reading texts, following their own likes and interests, they will not all be reading the same texts at once. For this reason - and because we want to prompt students to keep reading - we should encourage them to report back on their reading in a number of ways. In order to get students to read enthusiastically in class, we need to work to create interest in the topic and tasks. However, there are further roles we need to adopt when asking students to read intensively. We need to tell students exactly what their reading purpose is, and give them clear instructions about how to achieve it, and how long they have to do this. when we ask students to read on their own we need to give them space to do so. While students are reading we can observe their progress since this will give us valuable information about how well they are doing individually and collectively. When our students have completed 11

the task, we can lead a feedback session to check that they have completed the task successfully. We may start by having them compare their answers in pairs and then ask for answers from the class in general or from pairs in particular. Students often appreciate giving paired answers like this since, by sharing their knowledge, they are also sharing their responsibility for the answers. When we ask students to give answers we should always ask them to say where in the text they found the information for their answers. This provokes a detailed study of the text which will help them the next time they come to a similar reading passage. It also tells us exactly what comprehension problems they have if and when they get answers wrong. Another receptive skill is listening. There are many ways of teaching listening to our learners. Students can improve their listening skills - and gain valuable language input - through a combination of extensive and intensive listening material and procedures. Listening of both kinds is especially important since it provides the perfect opportunity to hear voices other than the teacher’s, enables students to acquire good speaking habits as a result of the spoken English they absorb, and helps to improve their own pronunciation. Extensive listening will usually take place outside the classroom, in the students’ home, car, or on personal stereos as they travel from one place to another. The motivational power of such an activity increases dramatically when students make their own choices about what they are going to listen to. The keenest students will want to listen to English tapes outside the classroom anyway, and will need little encouragement to do so. Many others, however, will profit from having the teacher give them reasons to make use of the resources available. We need to explain the benefits of listening extensively, and come to some kind of agreement about how much and what kind of listening they should do. We can recommend certain tapes, and get other students to talk about the ones which they have enjoyed the most. Many teachers use taped materials, and increasingly material on disk, when they want their students to practise listening skills. This has a number of advantages and disadvantages: Advantages: taped material allows students to hear 12

a variety of different voices apart from just their own teacher’s. It gives them an opportunity to ‘meet1 a range of different characters, especially where real people are talking. But even when tapes contain written dialogues or extracts from plays, they offer a wide variety of situations and voices. Taped material is extremely portable and readily available. Tapes are extremely cheap, and machines to play them are relatively inexpensive. For all these reasons most course books include tapes, and many teachers rely on tapes to provide a significant source of language input. Disadvantages can be seen as following: in big classrooms with poor acoustics, the audibility of taped and disk material often gives cause for concern. It is often difficult to ensure that all students in a room can hear equally well. Another problem with classroom tapes is that everyone has to listen at the same speed, a speed dictated by the tape, not by the listeners. A popular way of ensuring genuine communication is live listening where the teacher and/or visitors to the class talk to the students. 5 This has obvious advantages since students can interrupt speakers and ask for clarification. Live listening can take the following forms: Reading aloud: an enjoyable activity, when done with conviction and style, is the teacher reading aloud to a class. Story-telling: teachers are ideally placed to tell stories which, in turn, provide excellent listening material. At any stage of the story, the students can be asked to predict what is coming next, or be asked to describe people in the story or pass comment on it in some other way. Interviews: one of the most motivating listening activities is the live interview, especially where students themselves dream up the questions. Live listening is not a substitute for audiotapes or disks - either in the classroom, language laboratory, or self-access centre - but it does offer an extra dimension to the listening experience over a series of lessons. As with all activities, for listening we need 5. Hamdan, J., & Diab, T. (1997). Using L1 in testing reading comprehension in English. Journal of the Educational Research Centre, Qatar University p 1-19 13

to be active in creating student engagement through the way we set up tasks. We need to build up students’ confidence by helping them listen better rather than by testing their listening abilities. Listening can occur at a number of points in a teaching sequence. Sometimes it forms the jumping-off point for the activities which follow. Sometimes it may be the first stage of a ‘listening and acting out’ sequence where students role-play the situation they have heard on the tape. Sometimes live listening may be a prelude to a piece of writing which is the main focus of a lesson. Other lessons, however, have listening training as their central focus. Most listening sequences involve a mixture of language skills - though one, in particular, is often the main focus of the sequence. Frequently students listen for gist on first hearing before moving on to different task skills; at other times they may listen for specific information straight away. In general we should aim to use listening material for as many purposes as possible - both for practising a variety of skills and as source material for other activities - before students finally become tired with it. For example: A popular technique for having students understand the gist of a story— but which also incorporates prediction and the creation of expectations - involves the students in listening so that they can put pictures in the order in which they hear them. They are given a chance, in pairs or groups, to say what they think is happening in each picture. The teacher will not confirm or deny their predictions. Students are then told that they are going to listen to a tape and that they should put the pictures in the correct chronological order which is not the same as the order of what they hear. This is what is on the track: Anna: Good morning Stuart. What time do you call this? Stuart: Oh dear. Yes, sorry I'm late. Anna: Well? What happened to you? Stuart: I woke up late. I'm afraid. I didn't hear the alarm. Anna: Were you out late last night? Stuart: Yes. I'm afraid I was. Anna: So what happened? 14

Stuart: Well, when I saw the time I jumped out of bed, had a quick shower, and ran out of the house. But then, when I got to the car I realized I'd forgotten my keys. Anna: Oh really! Stuart: But the door to my house was shut. Anna: What did you do? Stuart: I ran round to the garden at the back and climbed in through the window. Anna: And? Stuart: Well someone saw me and called the police. Anna: What happened then? Stuart: Well, I told them it was my house and at first they wouldn't believe me. It took a long time! Anna: I can imagine. Stuart: And you see that's why I'm Late! The students check their answers with each other and then, if necessary, listen again to ensure that they have the sequence correct. Music is a powerful stimulus for student engagement precisely because it speaks / directly to our emotions while still allowing us to use our brains to analyze it and its - effects if we so wish. A piece of music can change the atmosphere in a classroom or prepare students for a new activity. It can amuse and entertain, and it can make a satisfactory connection between the world of leisure and the world of learning. Because the appreciation of music is not a complex skill, and because many different patterns of music from a variety of cultures have become popular all over the globe through satellite television and the Internet, most students have little trouble perceiving clear changes of mood and style. In class, therefore, we can play film music and get students to say what kind of film they think it comes from. We can get them to listen to music which describes people and say what kind of people they are. They can write stories based on the mood of the music they hear, or listen to more than one piece of music and discuss with each other what mood the music describes, what ‘colour’ it is, where they would like to hear it, and who with. One of the most useful kinds of text for students to work with is song 15

lyrics, especially where the song in question is one which the students are very keen on. However, songs can present a problem, particularly with teenage students, precisely because it is often difficult to know exactly which songs the students like at a particular time and which songs, very popular last week, have suddenly gone out of favour! There are two ways of dealing with this problem: the first is to have students bring their own favourite songs to class. If they do this, however, the teacher may want to have time a day or two to listen to the song and try and understand the lyrics. Some of the songs may deal with issues and language which the teacher is not keen to work with. Another solution is to use older songs, and to ask students whether they think they still have merit - whether they like them, despite their antiquity. Teachers can then choose songs which they like, or which are appropriate in terms of topic and subject matter, and which they themselves think pass the test of time. The following example takes a song released in the 2000s. Students are told that they are going to hear the singer Celine Dion perform her track Titanic’. Do any of them know it? What do they think it is going to be about? They are then given the following worksheet and told that when they listen to the song, all they have to do is put the verses in the correct order - even if they do not understand all of the words. Students compare their answers and the teacher checks that they have the verses in the right place. They can now listen to the song again, and this time they should read each verse as it is sung. At the end of this procedure the teacher asks them what the song is about, and what the tone of it is, to elicit the information that it is about things always turning out the opposite to what you want. It is half bitter, half jokey. The teacher can then take the students through the lyrics, explaining phrases they did not understand, asking questions to check their comprehension of various words and expressions e.g. It figures, sneaking up on you, everything blows up in your face. Although this kind of text study is somewhat cumbersome, a detailed look at song lyrics, if the students are 16

interested in them, will really help some of them to remember some of the expressions, especially when they are combined with catchy music. There are many other ways of using songs lyrics, of course. Teachers can give students lyrics with various words blanked out; the teacher can give students a list of words and ask them to listen to the song to see which of the words are used. The teacher can ask students to put lines in order, or complete half-finished lines. Or the teacher can simply have students listen to a song and say what they think the title might be - or say where they would most like to hear it. Receptive Skills also known as ‘Passive Skills’, are often contrasted with productive skills. 6 When learning a new language learners tend to develop their receptive skills first and then acquire productive capability . It’s a complex relationship between the two as they all play a supporting role with developing other skills. For example, reading skills can be a supporting factor to the development of writing, whereas listening can improve speaking fluency. Developing receptive skills can be particularly challenging especially when communicating with a fluent or native speaker . Although starting a conversation may be done with relative ease, maintaining one poses greater challenges. Most likely learners may not recognize features of connected speech or idiomatic language which may lead to an unsuccessful interaction. Similarly with reading, if the language or grammar is too complicated it makes the text unintelligible. The key difference between listening and reading is that when learners listen to information, they have much less support than when they are working with the written word on the page. Listening requires ‘real-time’ processing of language, and once the message has finished, there is no easy way to go back and check for meaning, as there is during reading. The best way to improve receptive skills is from exposure whether from an enjoyable authentic text or a quality ESL text book. For example, television, music, books and magazines are great ways to build vocabulary while incidentally 6. Huang, S. H. (2005). Assessing the relationship between referential understanding and academic reading comprehension among EFL college students. p276 17

promoting learner autonomy. Coursebooks can provide a basic scaffold and are adapted for an ESL learner, whereas authentic materials provide exposure to real language use. However, authentic materials can demotivate learners if the materials aren’t appropriately graded or applicable to their interests. It’s an important consideration to choose material which isn’t too difficult or easy, and also which relates culturally, so adaptation is an important consideration for teachers. Equally important are effectively staging a reading or listening lesson to maximize output. 1.2. Reading models and variables In the cultural system we live in, we are almost unaware of the fact that we learn to copy behavioural models because of their ingenuity, attractiveness, moral quality or some other positive aspect of these models. They may have a significant influence on one's behaviour when dealing with everyday situations, at least in the short term, irrespective of the extent to which they are followed through, or whether they are rejected and substituted for alternative models. In much the same way, science produces and uses models in order to provide a framework within which research problems can be solved. For this reason, linguistic research tends to build models so that one may deal with, represent, define and justify, in other words, study linguistic data in various circumstances. In linguistics, a model is a systematic and operative way of explaining certain aspects of language to show its structure or function. Models provide samples of language which represent its basic structure in order to understand it better 7 . To make this organized and interrelated simplification, a knowledge of the elements of the structure is necessary as well as the position that the simplification occupies in the body of the theory, description or explanation, extracting and formalising the áreas _______ 7. Aebersold, J. A. & Field, M. L. (1997). From reader to reading teacher: Issues and strategies for second language classrooms. New York: Cambridge University Press. p 37 18

which are subject to analysis. In the field of linguistics, there are various meanings of the term 'model', although they have many points in common. These are: paradigmatic or investigative, theoretical or interpreting a theory, hypothetical or representing well-established hypotheses, descriptive, general framework or following the criteria of another science, and macromodel or equivalent to the epistemological system. The concept of reading has changed with time as the nature of education has evolved. Nowadays a typical reader would be someone able to process a written text in silence to obtain, use and analyse information or to entertain themselves. However, few adults at that time were able to read, and, for that matter, recite aloud, and among them, only a small proportion was able to understand a non familiar written extract 8 . Take, for instance, the familiar scene of taking part in church mass by reading aloud or reciting by heart, in Latin, without being able to understand most of the written texts. Consequently, my view is that if the reading model does scientifically exist, it will also have evolved in order to adapt itself to the prototypical reader of the time. There is no agreed definition of reading comprehension. Smith affirms that “there is no point in looking for a single definition of reading…. We should not expect that a single definition for reading will be found, let alone one that throws light on its mystery” 9 . In the same vein, Grabe believes that “simple definitions typically misrepresent complex cognitive process such as reading” 10 . Alderson writes that “an overview of the study of the nature of reading is impossible” , and Shohamy argues that reading comprehension “in a second language is even more of a puzzle because it involves unknown aspects from first and second language” 11 . It is important to trace the historical development of reading comprehension models, which will help in understanding the reading process in a better and deeper 8. Alderson, J. C. (1984). Reading in a foreign language: A reading problem or a language problem? In J.C. Alderson & A.H. Urquhart (Eds.), Reading in a foreign language (pp.1-27). New York: Longman. 9. Smith, F. (1985). Reading. Cambridge: Cambridge University Press. (p. 100) 10. Grabe, W. (1991). Current development in second language reading research. TESOL Quarterly, 25,3, (p. 378) 11. Shohamy, E. (1984). Does the testing method make a difference? The case of reading comprehension. Language Testing, 1,2, 14 8 19

way. However, it is also important to recognize that “the notion that there can be a single model for reading across tasks, genre, and purpose is doubtful”. According to Pearson and Stephens , reading was seen in the mid- 1960s as a perceptual process: first readers decode letters in a printed text into sounds, then they listen to these sounds and understand the words. In fact, reading was seen as a similar skill to listening: the eye works only as a decoder of the written text, and comprehension happens by listening. This view of reading made it a prerequisite for teachers to teach phonetics to their students if they wanted them to understand what they read. A well-known example of such theories is Gough’s bottom-up theory , where reading is seen as a linear process in which letters are identified one by one and then converted to sounds; each letter is held in the memory until the next letter is identified; when words are recognized, they, too, are held in the memory until the meaning of the sentence and eventually the paragraph is understood; the reader is seen as a passive decoder. Comprehension happens when phonemic processing is rapid and efficient, however, there is no need for or effect of prior knowledge. Readers are expected to read all words in the text in order to achieve comprehension. “I see no reason, then, to reject the assumption that we do read letter by letter. In fact, the weight of the evidence persuades me that we do serially from left to right” 12 . Another example of bottom-up theory is La Berge and Samuels’ model in which comprehension is based upon word identification, and the notion of “automaticity” in word identification is introduced. In this model, it is important to master the skill of decoding through practice to the degree that it happens automatically. Usually, beginning readers pay more attention when faced with a new or difficult word in the text, which might affect their comprehension. La Berge and Samuels claim that it is only possible to pay attention to one thing at a time, however it is possible to process several things at the same time if they are ______ 12. Gough, P. (1982). One second of reading. In Kavanagh, J., Mattingly, I. (Eds.), Language by ear and by eye: The relationships between speech and reading pp. 331-335. Cambridge: MIT Press. p45 20

done automatically with no attention needed. Therefore, when text decoding is efficient and automatic, attention will be directed towards comprehension. According to Samuels and Kamil , such linear models have a serious deficiency because they “pass information along in one direction only and do not permit the information contained in a higher stage to influence the processing of a lower stage” 13 . Moreover, according to Stanovich, a serious deficiency of the bottom up theory is the lack of feedback “ in that no mechanism is provided to allow for processing stages which occur later in the system to influence processing which occurs earlier in the system” Furthermore, such models do not explain why the reading process is not affected by context or prior knowledge. In addition to these shortcomings, the bottom up theory “lacks flexibility. The reader has no choice of operations or strategies to deploy in different reading tasks”. 14 Despite all the criticism it received, the bottom-up theory was an important step in understanding the process of reading comprehension. It inspired other researchers to do more work, which enriched the field of reading in general. The following theory, top- down, may offer a better explanation of the reading process and how comprehension is achieved. As we have seen, bottom-up models start with the printed text and then move up to derive meaning. Top-down models, as we will see, start with higher levels of cognitive processes by making predictions and assumptions and then trying to confirm or reject them by working down to the printed text. Top-down models benefited a lot from the work of Smith and Goodman, who emphasized the role of the reader as an essential participant in the reading comprehension process 15 . 13. Samuels, S.J., & Kamil, M. (1988). Models of the reading process. In Carrell, P., Devine, J., & Eskey, D. (Eds.), Interactive approaches to second language reading. New York: Cambridge University Press (pp.22- 36) 14. Mitchell, D.C., (1982). The process of reading: A cognitive analysis of fluent reading and learning to read. New York: John Wiley & Sons. p. 133-134. 15. Alderson, J. C. & Lukmani, Y. (1989). Cognition and reading: cognitive levels as embodied in test questions. Reading in a Foreign Language p , 253-70. 21

The model that best represents the top down theory is Goodman’s psycholinguistic model of reading . He believes that reading is meaning oriented: readers bring their knowledge and experience when they read. They sample, select from the text and make assumptions and predictions based on cues from letters, words, and syntax, and while they read they accept or reject their predictions by using their knowledge and experience that they had from the beginning. Goodman argues that: Reading is a selective process. It involves partial use of available minimal language cues selected from perceptual input on the basis of the reader’s expectation. As this partial information is processed, tentative decisions are madeto be confirmed, rejected, or refined as reading processes. 16 Goodman does not see readers as passive decoders of letters and words but as active constructors of comprehension . Thus, comprehension in reading is a continuous and active process from the very beginning until the end. As Goodman stated, “Reading is a psycholinguistic guessing game. It involves an interaction between thought and language” 17 . Comprehension does not come from accurate perception and identification of all letters and words as in the bottom up theory, but from the ability to choose the cues essential to making the right guesses. Readers use only some of the text cues to predict, which explains the errors children make when they read aloud and replace some words with different ones that do not change the grammar of the sentence . Goodman’s model has received some criticism. For example, according to Mitchell the model does not give enough details about the reading process. Also, most of Goodman’s work was with children, who have different reading strategies from adults. Mitchell believes that the model is inadequate and does not describe fluent reading. According to Samuels and Kamil, one of the shortcomings of the top down model is that “for many texts, the reader has little knowledge of the topic _______ 16. Goodman, K. S. (1976). Reading: A psycholinguistic guessing game. In Ruddell, R., Ruddell, M., Singer, H. (Eds.), Theoretical models and processes of reading. Newark: International Reading Association. pp. 497-508 17. the same ., p. 108 22

and cannot generate predictions” 18 . Therefore, if beginners are presented with a new subject in which their knowledge is limited, then how can they compensate from bottom-up ability, since it is itself is weak and incomplete. Another shortcoming, according to Samuels and Kamil, is that the amount of time needed to make predictions, even for the skilled reader, is more than the time needed to decode and identify words. In other words, it is easier and more efficient for a skilled reader to identify all the words than to make predictions and then confirm or reject them. Consequently, the top-down model fails to describe skilled reading behaviour. Bottom-up and top-down theories are almost the opposite of each other, and seem mutually exclusive, but neither of them can fully explain the reading process. Nevertheless, both have some valid insights. In an attempt to build on these insights, a new theory was developed to explain the process of reading comprehension in a better and deeper way. This new theory was called ‘interactive’. Both bottom-up and top-down models are essential in understanding reading comprehension. However, the interaction between the two models is complicated and unclear. The interaction differs according to the text, reader, and purpose. Interactive models attempt to combine valid insights of both bottom-up and top-down. However, they differ in their degree of focus on process or product respectively. The term ‘interactive’ is used to represent different views. According to Grabe, some writers use it to refer to an interaction between the reader and the text, while others refer to the interaction among different reading skills. Bottom up and top down theories in a new model. In his interactive compensatory model, Stanovich argued that interactive models of reading appear to provide a more accurate conceptualization of reading performances than do strictly top down or bottom up models. When combined with an assumption of compensatory processing that a deficit in any particular process will result in a greater reliance _________ 18. Samuels, S.J., & Kamil, M. (1988). Models of the reading process. In Carrell, P., Devine, J., & Eskey, D. (Eds.), Interactive approaches to second language reading New York: Cambridge University Press. p 32. 23

on other knowledge sources, regardless of their level in the processing hierarchy, Stanovich was one of the researchers who succeeded in combining both interactive models provide a better account of the existing data on the use of orthographic structure and sentence context by good and poor readers. According to Stanovich’s model, reading involves a number of processes. Readers who are weak in one process will rely on other processes to compensate for the weaker one. For example, a poor reader who is slow and inaccurate at word identification that is bottom up but knows a lot about the text subject will overcome his or her weakness by relying on his or her knowledge that is top down. Thus, the Stanovich model is interactive in the sense that any process, regardless of its position, may communicate with any other process in order to achieve comprehension. “However, the evidence that such compensation does in fact occur is controversial” 19 . Another interactive reading model was proposed by Just and Carpenter. They focused on eye-fixation, which is considered a major difference between reading and listening, because the reader controls the amount and speed of input when reading a text. They also claim that the reader reads almost every single word in the text, which is different from Goodman’s view that the reader samples the text to make the right guesses. 20 This interactive model is based on the interaction between the reader and the author. “The thoughtful reader is the reader who reads as if she were a writer composing a text for another reader who lives within her” 21 . Therefore, when writing, authors assume that readers will compose meaning from the text, and at the same time, readers read the text with the expectation that it has enough clues and information to convey the author’s intended message. Alderson argues that reading comprehension is a complex cognitive process ______ 19. Alderson, J. C. (2000). Assessing Reading. Cambridge: Cambridge University Press. p 19 20. Just, M.A., & Carpenter, P.A. (1980). A theory of reading: From eye fixations to comprehension. Psychological Review, 87, p. 329 - 330 . 21. Pearson, P. D. & Tierney, R. (1984). On becoming a thoughtful reader: Learning to read like a writer. In A.C. Purves, & O. Niles (Eds.), Becoming readers in a complex society Chicago: University of Chicago Press. p.144. 24

that might be affected by different variables. Based on their source, these variables can be divided into two main groups. The first group of variables are related to the reader, while the second main group of variables are related to the text. For thepurpose of this review, I propose a third group of variables that is related to testing. The following is a brief overview of these three groups of variables that may have an effect on the reading process. I will start with the reader variables and their direct and indirect relation to reading comprehension. The reader plays an important role in the process of reading. He or she is no longer seen as a passive decoder of the written symbols, but as an active meaning- constructor in the reading process. The reader especially in the top-down approaches contributes more than do “the visual symbols on the page” 22 .However, readers differ in their level of contribution to the reading process because they “vary by shared background knowledge, language skills, strategies … and ‘other personal characteristics’” 23 . The following is the first reader variable. Carrell distinguishes between two types of schemata. According to her, one type of schema, or background knowledge, a reader brings to a text is a content schema , which is knowledge relative to the content domain of the text. Another type is a formal schema , or knowledge relative to the formal, rhetorical organizational structures of different types of texts . Alderson argues that content schemata can be divided into general knowledge and subject-matter knowledge. The general knowledge is not necessarily relevant to any particular text, while the subject-matter knowledge is directly related to the topic of the text. Formal schemata and subject-matter knowledge can interact: readers who are weak in one of them will rely on the other to compensate for their weaknesses. Furthermore, Alderson argues that “tests based on texts which are too specialised might test subject matter knowledge rather ____ 22. Grabe, W. (1991). Current development in second language reading research. TESOL Quarterly, p 37 7 23. Alderson, J. C. (2000). Assessing Reading. Cambridge: Cambridge University Press. p128 25

than reading ability” Several studies have found that the background knowledge of the text has a positive effect on levels of performance in reading comprehension tests. Test takers are generally found to perform better whenever they are introduced to subject areas with which they are familiar. According to Kitao , being either very familiar or completely unfamiliar with the text can adversely affect performance in a reading comprehension test. When test takers are very familiar with the text subject matter, then they may answer questions without comprehending the text. At the other extreme, fluent readers may not perform well if they have no background knowledge at all of the text. Knowledge of text structure is essential for reading comprehension. Identifying the organizational structures of texts promotes readers’ speed and accuracy in reading comprehension. Just as reader and text variables affect reading comprehension, testing variables represent an essential part in the reading process. In testing, it is very important to minimize the effect of these factors in order to maintain test validity and reliability. Identifying reading sub-skills is a major concern in second language reading research 24 . “It is commonplace in theories of reading to seek to identify skills which underly or contribute to the reading process”. According to Alderson and Lukmani , many lists of reading sub-skills have been assembled as a result of the work of researchers who have long tried to identify reading sub-skills by “giving subjects a series of passages and asking them questions intended to test different levels of understanding of the passages. The answers to these questions are then subjected to factor analysis, in order to see whether the different questions measure different ‘subskills’” 25 . These lists of sub-skills have been drawn up by both first and second language researchers based on the assumption that a number of different sub-skills are included in the reading comprehension process. 26 24. Hudson, T. (2007). Teaching second language reading. Oxford: Oxford University Press p 25. Alderson, J. C. & Lukmani, Y. (1989). Cognition and reading: cognitive levels as embodied in test questions. Reading in a Foreign Language 5 (2), 253. 26. The same ., p 201 26

Grabe stated that L2 students “needed to be taught strategies to read more efficiently e.g., guess from context, define expectations, make inferences about the text, skim ahead to fill in the context, etc.” 27 . According to Barnett , reading strategies are the comprehension processes which readers use to comprehend what they are reading. These processes may include skimming, scanning, guessing word meanings from context, etc. She argues that using efficient reading strategies will help L2 students to understand more than those who do not. In addition, these taxonomies of reading “have been widely used not only for reading syllabus design..., but also for the development of test specifications and items in EFL/ESL reading assessment” 28 The distinction between reading ‘skills’ and reading ‘strategies’ is not always clear, and they are sometimes used interchangeably. “It is not always easy to distinguish skills from strategies” 29 . According to Rupp, Ferne and Choi, ‘skills’ are unconscious automatic abilities that facilitate comprehension such as text decoding and the use of background knowledge, while ‘strategies’ are conscious techniques which are used intentionally for successful reading such as skimming and scanning. 30 . 27. Grabe, W. (1991). Current development in second language reading research. TESOL Quarterly, 25,3, 37 7 28. Lee, Y. (2004). Examining passage-related local item dependence (LID) and measurement construct using Q3 statistics in an EFL reading comprehension test. Language Testing, 21(1), 7 9 29. Hudson, T. (2007). Teaching second language reading. Oxford: Oxford University Press p 77 30. Rupp, A., Ferne, T., & Choi, H. (2006). How assessing reading comprehension with multiple-choice questions shapes the construct: A cognitive processing perspective. Language Testing, 23 p , 441-474. 27

CHAPTER II. TESTING READING COMPREHENSION IN ALL LEVELS 2.1. Reading tasks in different CEFR levels Although it seems that testing reading comprehension is an easy task to accomplish, nevertheless the complexity and ambiguity of the nature of reading comprehension make it a challenging one. Alderson argues, however, that one should develop reading comprehension tests even though one’s understanding of its nature is “faulty, partial and possibly never perfectible” 31 . The level of reading proficiency could be close to A2 as defined by the Council of Europe Common European Framework in their ‘Overall Reading Comprehension’ scale. Their level will be referred to in the study as ‘post- beginner’. The test included items that attempted to assess five reading comprehension sub- skills They are: 1. Scanning a text to locate specific information. 2. Skimming a text for the main idea. 3. Making inferences or drawing conclusions. 4. Identifying referents of pronouns. 5. Guessing the meaning of unknown words from context. There are different methods of teaching and testing reading. Multiple choice is the most common method of testing language skills, and it is used in parts of some international language tests such as IELTS and TOEFL. The multiple-choice method is popular because it is objectively scored, fast and economical which make it possible to include more items in the same period of time and hence may increase test reliability and validity. Moreover, the multiple-choice method does not require other language skills such as writing. A test taker may be a fluent reader and at the same time a bad writer, which might prevent him/her from performing well in the reading comprehension test. Multiple choice. In multiple 31. Alderson, J. C. (2000). Assessing Reading. Cambridge: Cambridge University Press.p 2 28

choice tests, the child has to select one response of a choice of three or four that they think corresponds to the correct answer. This type of task is somewhat more sensitive than yes/no questions because there are more response options but less sensitive than open-ended questions. It is also subject to the same criticism as true/ false judgements, in that answers to questions will necessarily be provided as one response option, so that children who do not, for example, naturally make inferences while reading might, nevertheless, recognize an inference option as the correct response. Although, as with true/false questions, the child does not need to construct a verbal response, the processing demands of multiple-choice tests can be quite complex since the child has to read and compare the different response options before choosing an answer. One diagnostic advantage of multiple-choice tests is that they can be constructed so that the wrong responses are wrong in consistent and interesting ways. So, for example, in the case of an inference question, the wrong choices could be a different, but inappropriate, inference, and a literal response. Of course, children might make random choices, leading to errors on such tasks. But, if they consistently choose one type of response over other types of wrong response, this could be taken as an indication that they are too much tied to the literal meaning of the text. True/false judgements. In this format, the child reads or listens to a passage and is then presented with a number of statements, each of which is true or false with respect to the text. The child simply has to make a true/false (or yes/no) judgement about each. This task obviously does not require a complex verbal response from the child and it is also suitable for use in groups or whole classes. But a major disadvantage is that if more subtle aspects of comprehension are being assessed, then the inferences themselves will be spelled out in the response options. Thus, it will not be clear whether a child gets such a response correct because they are able to make the inference, or because when they see the inference spelled out for them, they realize that is a good option. Cloze tasks. In cloze tasks, single words are omitted and have to be filled in by the 29

reader, usually from a choice of 3–5 words. The missing words can be deleted from a passage or from isolated sentences, but for the purposes of testing comprehension of text, a passage should be used. Such tests, like true/false and multiple-choice tests, have the advantage that they can be administered to children in groups. In the original cloze procedure, every fifth or seventh word is omitted, and readers are requested to guess the missing words. The idea is that the cloze procedure assesses the fit between the text and the reader – and provides results that can be compared across texts and readers. Texts with difficult to guess words are in general more difficult than other texts in many ways at all levels. However, the original cloze procedure was heavily criticized for not being specifically sensitive to aspects of text difficulty above the sentence level. Open-ended questions. Asking open-ended questions is probably the most sensitive way of assessing comprehension, since the child’s response is not cued by the various response options. The child simply has to answer a series of questions after reading or listening to a passage of text. Thus, the child can be prompted by the tester to elaborate on a response. Another advantage is that the child’s errors might provide useful insights into his or her problems with comprehension. Like the multiple-choice format discussed above, open-ended questions can be used to reveal systematic processing errors in children’s thinking about text, and can be analyzed to determine the source of such errors. The children had to learn this knowledge base before reading a set of stories. So, for instance, the children were taught that on this imaginary planet, the covers of books were made of popcorn. They then had to use this information in order to understand the stories and answer questions about them. In one story, this sequence occurs: “After all this hard work Dack and Tane wanted a snack. They tore the covers off their storybooks and ate them.” The inference question relating to this part of the text was: “What did Dack and Tane snack on?” The answer expected would be “book covers made of popcorn” or just “popcorn”. Many of the children with neurological disorders and also a control group of children of normal neurological status, but with comprehension difficulties, had problems answering such inference questions. 30

However, difficulties of the two groups of children seemed to have different sources: the problems of the children with neurological difficulties seemed to stem from their difficulties in retrieving the knowledge-based and text-based information that was fundamental to the inference, whereas the group without neurological disorders was more likely to be able to retrieve the relevant information of both sorts, but to have problems integrating the information to answer the inference question. An obvious disadvantage of open-ended questions is that at least younger children need to be tested individually, though older children might be able to write their responses. Another disadvantage is that the quality of children’s responses is likely to be limited by their general expressive language skills, so it could be argued that some children might know the correct answers, but might have insufficient ability to formulate their responses fully. Short-answer. The answer is usually very short and it is objectively scored. Hughes pointed out that short-answer items have some advantages over multiple choice questions and vice versa. Short-answer items are easer to construct, but they take more time to mark. Moreover, cheating and guessing are less likely to happen with short-answer items. Below I would like to give some examples of reading tasks according to CEFR. Tick (/) the correct column. New Boy Worried Girl both Neither 1 is happy 2 is hungry 3 has a computer 4 has no furniture 5 comes from Scotland 6 is starting a new job 7 had a meal at Big Joe's made a sandwich 9 found a sandwich 10 hasn't talked to anybody 31First reading

for some time 11 felt better after the talk B1 Level illiam Shakespeare was born in Stratford-upon-Avon in 1564. His mother was called Mary Arden. She came from a rich family. His father, John, was a businessman who sold gloves, wool and meat. William went to Stratford Grammar School where he learned a little Latin and Greek. He married Anne Hathaway in 1582. She was eight years older than him. They had three children, Susannah, bom in 1 583. and the twins Judith and Harnnet, born in 1585. There are no descendants of the Shakespeare family alive today. It is possible that in 1587 William Shakespeare joined a group of travelling actors and left Stratford because he was in trouble for stealing a deer but nobody is sure if this is true or if the date is correct. By 1592 he was definitely an actor and playwright in London. In 1599 the Globe Theatre opened in London and most of his 36 or 37 plays were performed there. Nobody is sure exactly how many plays Shakespeare wrote.W The Globe was made of wood. It was round. There was no roof, so if it rained the audience and the actors got wet. The audience stood on three sides of the stage. They were not quiet, as theatre audiences are today. They made a lot of noise, and sometimes they had sword fights. They also ate oranges because of the bad smell everywhere. Shakespeare wrote three kinds of play: comedies, tragedies and histories. The comedies had happy endings, the tragedies had sad endings (like Hamlet) and the histories told the story of the past, either in England (like Henry V) or in ancient Rome (like Julius Caesar). Although there were other successful playwrights at the time -especially Christopher Marlowe -Shakespeare was recognized in his own lifetime as one of the finest playwrights of his time. By 1597 he was rich enough to buy New Place, the finest house in Stratford. In 1613 the Globe burned down during a performance of Shakespeare's Henry VIII. The following year Shakespeare retired and went back to New Place in 32

Stratford. In 1616 he died of a fever and he is buried in Holy Trinity Church, Stratford. In his will he left his wife his second-best bed. This may mean that he did not love his wife very much but it may also mean that he was trying to avoid paying death duties. First reading. Are these events in Shakespeare's life definite (write D) or possible (write Р )? 1. Shakespeare was born in Stratford-upon-Avon.____________ 2. Shakespeare stole a deer in Stratford.____________________ 3. Shakespeare left Stratford in 1587._____________________ 4. By 1592 Shakespeare was writing plays in London.________ 5. Shakespeare wrote 36 plays. ___________________________ 6. Shakespeare wrote three kinds of play.__________________ 7. Shakespeare was recognized as one of the finest playwrights of his time during his life. _____________________________________ 8. Shakespeare bought New Place in 1597.______________________ 9. Shakespeare died in 1616.__________________________________ 10. Shakespeare left his wife his second-best bed because he did not want to pay death duties. __________ ____________________________________ Task for B1 level students. F o r m a l l e t t e r Dear Sir or Madam, Return of Citroen ZX P18S OAS aired 30 June 2001 I was both distressed and angry to receive your letter dated 6 July. I cannot believe that, as you say, you are threatening to charge us for collecting the car we hired from you, which is now in London. And you are also threatening to sue us for loss of earnings on the car while it is in London and until it is returned. Of course the car should have been returned on 5 July. But my boyfriend and I were mugged in London. We were both hit in the face and everything we had on us was stolen, including the keys to the hire car. This happened on 1 July in London and we phoned your office from the police station and told you. 33

Unfortunately we did not take the name of the person we spoke to, but it was a female with a Liverpool accent. As we told this person on the phone, the police refused to break open the hire car for us. They are not allowed to do that. So Z could not get at my handbag or our luggage. We were penniless in London and my boyfriend needed hospital treatment for what those thugs did to him. it was only because I know people i n London and I was able to borrow money that we could get back to Edinburgh at a"1. On the phone we asked you to collect the car for us to drive back to Edinburgh and give us back my handbag and all our luggage. Will you please do this? As I have explained, we have no way of doing it ourselves. And please write again withdrawing a l l your threats. I think my boyfriend and I have been through enough, don't you? Yours faithfully, Shiona First reading. Put these events in the order that they happened. 1. The police refused to break into the hired car. _ 2. Shiona phoned the car hire company and told them what had happened. 3. The car keys were stolen. 4. Shiona and her boyfriend received a letter from the car hire company. ___ 5. Shiona and her boyfriend hired a car. 6. Shiona and her boyfriend returned to Edinburgh without the car. Second reading. Match the two halves of these sentences. The car hire company is threatening to charge for collecting the car The car hire company is threatening to sue for loss of earnings Shiona and her boyfriend could not get their luggage out of the 34

Shiona and her boyfriend could not return the car on time The letter from the car hire company was a surprise to Shiona because the police refused to break it open. because the keys were stolen when they were mugged Task 1 for B2 level students. Before the development of movable metal type in the mid-15th century and for some time thereafter, news was disseminated by word of mouth, by written letters, or by public notices. Not until 1609 were the earliest known newspapers published. The word news was not coined until a century later. By 1645 Stockholm had a court paper, which is still published. Early newspapers were small in size, usually consisting of only one page. They had neither headlines nor advertising and looked more like newsletters than today's broadsheet papers with their bold headlines and numerous pictures. The first daily newspaper in the United States, the Pennsylvania Evening Post and Daily Advertiser, had begun daily publication in 1783 in Philadelphia. By 1800, 20 daily papers were in operation, and the number continued to increase in the first three decades of the 19th century as the Industrial Revolution spread, spawning a new working class in the nation's growing cities. In the United Kingdom there are 11 national and about 90 regional daily newspapers with a total daily circulation of almost 20 million copies. The paper with the largest circulation is the Sunday tabloid News of the World, which sells more than five million copies a week. Of the dailies, The Sun is the sales leader, selling around 4 million copies. In the United States, about 1,700 daily newspapers print a total of 63 million copies, and almost every copy is read by at least two people. Some 6,800 weekly newspapers are also published, with a combined circulation of approximately 40 million. In the United States, the Wall Street Journal has the largest circulation, with about 1.9 million copies sold daily. Newspaper publishers are now experimenting with the use of computers and television to transmit news, advertising, and other information directly into homes. Some people believe that the newspaper of the future will not be printed but will 35

be an electronic information service instantly available in every home. Many publishers already include an on-line version of their newspaper on the Internet, which can be accessed by anybody with a personal computer and a modem. Questions: 1) Where was the first American daily newspaper published? [ Philadelphia ] 2) The pronoun “They” in line (6) refers to ……………. [ early newspapers ] 3) The word “spawning” in line (11) is closest in meaning to ……………. [ creating / making / starting ] 4) Write a title for this passage. [ Newspapers / News / History of Newspapers / Newspapers Development ] 5) What is the total number of daily and weekly newspapers in America? [ 8500 ] 6) How did people know news before 1609? [ word of mouth, written letters, public notices ] 7) What does the third paragraph mainly discuss? [ new trends ] 8) How many copies are circulated of American and British daily newspapers? [ 83 millions ] 9) The pronoun “their” in line (7) refers to ……………. [ today’s newspapers / broadsheet papers ] 10) The word “disseminated” in line (2) is closest in meaning to ……………. [ spread / known / delivered ] Task 2. Throughout the world, at least half a million people are killed and about 15 million injured on the roads each year. Casualty rates vary widely. They depend on population and traffic density and the extent to which preventive and remedial measures have been applied. Typically, more deaths occur on rural roads, where speeds are higher than in urban areas, but serious injuries involving a stay in hospital are at least twice as numerous on the urban roads, where traffic faces more conflicts, especially at junctions. 36

Research studies have shown that human factors contribute to 95 per cent of accidents, road factors to about one quarter, and vehicle factors to fewer than five per cent. The main human errors are: going too fast for the conditions; failing to give way at junctions; following too closely; overtaking improperly; and misperceiving or misjudging the road situation ahead. Road deficiencies that are main contributory factors are: poor design of layout and control at junctions; inadequate signing, road marking, and lighting; slippery roads; and obstructions on the road, such as parked vehicles. The main vehicle factors are defects in tyres, brakes, and lights, arising from poor maintenance of the vehicle. Extensive remedial measures aimed at improving road safety have been developed in the fields of engineering, education, and enforcement—the “three Es”. They address both primary safety (reduction of accidents) and secondary safety (alleviation of injury). Research has played a major part in testing and evaluating measures to ensure that resources are most effectively used in practice. The most dramatic effects have followed the use of seat belts and child restraints in cars. Use of seat belts reduces the risk of death or serious injury by about 45 per cent. Publicity has played a major part in increasing wearing rates, but for full effect it needs to be backed by legislation. Legislation for compulsory wearing was first introduced in the State of Victoria, Australia in 1971. Other protective measures that are gaining support are the wearing of helmets by cyclists (again led by the example of Victoria), and the use of crash protection barriers on the central reserve of high-speed motorways. Questions: 1) What does the second paragraph mainly discuss? a. Reasons of Accidents b. New Safety Studies c. Human Errors in Driving d. Road Construction Problems 2) How many people are killed because of car accidents during the last two years? a. .5 million 37

b. 1 million c. 1.5 million d. 15 million 3) The pronoun “They” in line (2) refers to: a. population b. people c. roads d. rates 4) The word “remedial” in line (3) is closest in meaning to: a. radical b. new c. corrective d. accurate 5) What is “secondary safety”? a. reduction of accidents b. alleviation of injury c. the “three Es” d. none of the above 6) Which of the following would be the best title for this passage? a. Traffic Laws b. Road Design c. Road Safety d. Careless Drivers 7) Why there are fewer death rates on urban areas? a. drivers do not drive fast b. drivers are more cautious c. drivers know their way d. drivers are much older 8) Australia was the first country in: a. building safe roads 38

b. protecting pedestrians c. legislating seat belt laws d. reducing highway speed limit 9) The pronoun “it” in line (24) refers to: a. publicity b. legislation c. death d. injury 10) The word “barriers” in line (28) could be replaced by: a. sides b. rules c. signs d. fences Reading tasks for C1 levels. N e w s p a p e r s t o r y p e o p l e Newspaper story 1 Businessman gave waitress $10,000 tip -it's like a fairy story. British businessman Gordon Williams had a big surprise for a waitress at a bar in New York City. At the end of the evening he left her a tip of $10,000. The waitress, Gloria Latrobc, was working at Top Club near Times Square in the centre of New York for a few weeks only. She is studying psychology at New York University. Miss Latrobe said, 'Gordon spent the evening at the club with some friends. It was his last night in New York. We talked a lot. He's interested in psychology, too. He gave me the money to pay for my last year of college.' And what did she do when she got the tip? Miss Latrobe laughed. T called the manager.' The manager of Top Club, Peter Hay, said 'Of course, we thought it was a mistake and the guy wanted to give a $10 tip. We asked him to sign a paper, promising to pay $10,000. He did that/ 'I'm really happy,' said Miss Latrobe. 'It's like a fairy tale, when a prince walks into your life.' 39

Newspaper story 2 Businessman Gordon 'Williams, who gave a waitress in New York a $ 10,000 tip, docs not have $10,000 in his account. His bank will not pay the cheque. T just want this to go away,' says unhappy Gordon Williams. 'My wife wants to know why I did it. Well, I don't remember doing it at all. The bar has a paper that I signed, so it must be true, but 1 don't remember doing it.' Unfortunately for Mr Williams, who has two children, the scory will not go away yet. Gloria Latrobc has been on coast-to-coast television in the US, telfing the story again and again. The day after she got the tip, Miss Latrobe described Mr Wdliams as 'a very nice English gentleman.' Even now she says, T hope his family isn't angry with him.' But there is a happy ending to the story after alt. Top Club in New York were so pleased that the clubs name was in every newspaper in Britain and the United States that they have given Gloria Latrobe the $10,000 to pay for her last year at NY. First reading. Tick ( ✓ ) the person or people who .. . Gordon Gloria Peter Hay/ Williams Latrobe Top Club 1 gave a big tip 2 worked at a club for a few weeks 3 is a student 4 worked at a club all the time 5 are interested in psychology 6 called the manager 7 signed a paper 8. doesn't remember giving a big tip 9 has two children 10 wants it all to go away 11 was on television 12 paid $10,000 40

2.2. Assessment criteria in reading activities The previous chapter discussed reading models and the main variables that might have an effect on reading comprehension and assessment. These variables differ in the way and degree they affect the test taker. Test developers and users usually pay special attention to these variables in order to reduce their effect on the level of performance and therefore increase test validity and reliability. Here, I will discuss some issues and considerations in language testing especially validity and reliability and test specifications . An understanding of the principles and uses of assessment is essential for all teachers, and in particular for teachers of reading. 32 Reading assessment has great power to inform researchers, teachers, administrators, and policy makers. ________ 32. Snow, Griffin, & Burns, Reading 2005: CUPp 179 Assessment practices can significantly benefit the learning environment or they can inflict great harm. Reading assessment, therefore, needs to be treated with great care, attention, and respect. Teachers, especially, have a responsibility to understand the uses and the impacts of reading assessment and be mindful of the consequences of assessment. Reading assessments are used for many purposes, but all appropriate uses begin from an understanding of the reading construct, an awareness of the development of reading abilities, and an effort to reflect the construct in assessment tasks. The complexity of the construct of reading, as well as its development, also reveals the potential complexity of reading assessment. These assessment options are equally applicable in both L1 and L2 contexts, though important L2 test and assessment practices are noted where relevant. No effort at comprehensiveness is intended for assessment practices and descriptions. A 41

number of very good books provide detailed descriptions and discussions of the many options noted for assessment practices. 33 The third section considers a number of innovations and challenges for reading assessment. Reading assessments are meant to provide feedback on the skills, processes, and knowledge resources that represent reading abilities, though it is important to note that different assessment practices may assume different theories of reading and reading development. Assessment in general can be categorized in a number of ways, and all assessment frameworks serve important purposes. Commonly, assessment has been categorized in terms of a) norm-reference and criterion reference testing; b) formative and summative assessment; c) formal and informal (or alternative) assessment; and d) proficiency, achievement, placement, and diagnostic assessment. For the purposes of , reading assessment is organized and described in terms of five basic assessment purposes listed below. Five purposes for reading assessment 1. Reading-proficiency assessment (standardized testing) 33. Alderson, J. C. 2000. Assessing Reading. Cambridge: Cambridge University Press . p 34 2. Assessment of classroom learning 3. Assessment for learning (supporting student learning is the purpose) 4. Assessment of curricular effectiveness 5. Assessment for research purposes There is an inevitable overlap among specific test uses across these categories, but these categories, nonetheless, serve as a useful framework for organizing reading assessment. Reading-proficiency assessment Assessment of reading proficiency is important as a way to understand students’ overall reading abilities based on some assumed construct of reading and to determine if students are appropriately prepared for further learning and educational advancement. Commonly, this type of assessment is referred to as standardized testing , although local groups and researchers also develop 42

proficiency tests of different types. In most respects, proficiency assessment represents high-stakes testing because decisions are often made about students’ future educational goals and opportunities. Alternatively, this type of assessment may lead to special education or reading-disability designations – labels that, once applied, are hard to remove from a student’s record. Reading-proficiency assessment is also sometimes used for student placement, for policy decisions, for curriculum changes, or for program, teacher, or institutional evaluations. Assessment of classroom learning Assessment of reading improvement in classroom settings involves the measurement of skills and knowledge gained over a period of time and is commonly referred to as summative or achievement testing . Sometimes, proficiency assessments are used to measure student progress from year to year as in a final exam, but this type of reading assessment does not capture ongoing student gains made in reading skills in the classroom. Year-end testing actually measures growth in proficiency from year to year rather than measuring gains in reading abilities based on what was taught in class . Much more commonly, assessment of classroom learning uses tasks that reflect the material taught in class and the skills practiced. Typically, the teacher, teacher groups, or curriculum groups or textbook-materials writers develop these tests, and they are responsible for deciding what represents a measure of success, as well as what steps to take as a result of assessment outcomes. Teachers have multiple opportunities to assess student learning at several points in any semester using common techniques for example, end-of unit tests, quizzes of various types, post-reading comprehension questions, and etc., but some classroom assessment alternatives are less obvious. Informal and alternative assessment options are central for the effective assessment of learning i.e, student observations, self-reporting measures, progress charts, engagement and group work, group outcomes assessment, interviews, and they usually provide converging evidence over time for the appropriate summative assessment at the end of the school year. Assessment of learning can be either 43

normative (how students compare to each other) or criterion-based (how well students perform on curriculum standards and established learning goals). These two testing purposes should lead to somewhat different tests and different scoring. To give the simplest example, normative testing would discourage every student from receiving an “5,” but criterion-based tests may include all students receiving an “5.” Assessment for learning Assessment for learning involves a type of reading assessment that is not commonly discussed and is somewhat innovative in discussions of L2 assessment. This assessment purpose is intended to support and promote student learning, in this case, the improvement of reading abilities. Performance evaluation or a record of outcomes is not the goal; instead, the goal is to provide immediate feedback on tasks and to teach students to engage in more effective learning. In many respects, this approach appears to overlap with the assessment of classroom learning, but this is true only with respect to many of the reading tasks performed, not to the follow-up feedback and interaction between the teacher and the students. Assessment for learning engages students in their own learning and responds to indicators of misunderstanding or weak performances with ongoing remediation and fine-tuning of instruction. There are two general types of “assessment for learning” practices: One involves the use of recognizable classroom assessment activities to provide helpful feedback for learning; the second involves specific assessment for learning practices to support students directly in their day-to-day learning. Assessment of curricular effectiveness Assessment of curricular effectiveness and program evaluation is not specific to reading but is relevant for the development and / or review of reading curricula. Assessment outcomes that apply to curricular effectiveness include standardized testing, cumulative records over years that indicate gains or losses in student outcomes, interviews with teachers, students, and school administrators on summative test performance, feedback from institutions that receive graduates 44

from the program or school, and innovative assessments that highlight specific school or program goals as an example can be , project work, motivation, extensive reading, writing skills, or collaboration and group work. Evaluations of curricular success and teacher effectiveness represent different types of evaluation goals and extend beyond the immediate goals of student assessment, but they are important considerations for any large-scale assessment of reading curricula as well as programmatic needs analysis. Assessment for research purposes Assessment for research purposes is a topic that is not generally addressed in assessment chapters, but it is one that is very important for reading research results as well as for their implications for reading instruction. Research studies sometimes use standardized assessment instruments to measure student levels or student instructional outcomes. In other studies, however, researchers develop their own reading-assessment measures for a variety of reasons. Regardless of reason, research-developed measures need to conform to expected requirements for any appropriate and fair assessment practice. The measures, first and foremost, need to be valid; that is, reliable, construct-relevant, useful, fair, and responsible. Reading research can have a powerful impact on teaching and on students’ learning experiences. Assessment measures are a part of all of these research conclusions and they need to be trustworthy. Given that students are likely to perform somewhat differently even across different standardized measures, it is important to ensure that tests are developed and used appropriately. The value of multiple measures in any research context must also be stressed. As the above framework indicates, reading-assessment practices much like all educational assessment can cover a wide range of purposes and uses, and each purpose or use includes a number of specific tasks and measurement options. In the section to follow, a subset of these tasks and practices is described. Moreover, the discussion will be limited primarily to L2 reading-assessment contexts. Most, if not all, of the activities outlined are equally applicable to L1 contexts, though not necessarily with the same assessment tools and resources. 45

Any single technique for assessment will necessarily be limited in the picture it can provide. . . .We should always be aware that the techniques we use will be imperfect, and therefore we should always seek to use multiple methods and techniques, and we should be modest in the claims we make. In this description of L2 assessment practices, for ease of explanation, we link reading- proficiency assessment with standardized testing and assessment of learning primarily with classroom-based measures. There is certainly an amount of overlap between standardized and classroom settings, and some of these instances are noted, but this simplification eliminates the need to detail all crossover points. Standardized assessment makes a serious effort to capture crucial aspects of the component abilities of comprehension. There are some m ajor component abilities for reading comprehension: 1. Fluency and reading speed 2. Automaticity and rapid word recognition 3. Search processes 4. Vocabulary knowledge 5. Morphological knowledge 6. Syntactic knowledge 7. Text-structure awareness and discourse organization 8. Main-ideas comprehension 9. Recall of relevant details 10. Inferences about text information 11. Strategic-processing abilities 12. Summarization abilities 13. Synthesis skills 14. Evaluation and critical reading Among the challenges to consider for reading assessment is how such an array of component abilities can best be captured within the operational constraints of standardized testing, what new assessment tasks might be developed, and what component abilities might best be assessed indirectly. While it is possible to 46

outline the many component abilities of reading comprehension, it is less straightforward to capture all of these abilities in reading-assessment tasks. Standardized assessment practices are far more constrained by concerns of validity, reliability, time, cost, usability, and consequence than classroom assessment practices. These concerns limit the types of reading-assessment tasks that can be used. Also, the context for standardized assessment precludes any strong assumption of a match to authentic reading in the “real world.” When students read a text as part of standardized assessment, they know that they are reading for an assessment purpose. Nonetheless, more realistic texts, tasks, and contexts are helpful as long as they do not pretend to be authentic “real-world” reading tasks. A further complication for standardized reading assessment is that different tasks and task types are appropriate at different proficiency levels. How reading- assessment tasks and task types should change with growing L2 proficiency is an area that has not been intensively investigated although it is logically assumed, and appropriately so, in many standardized multilevel assessment batteries. Commonly, assessment practices tend to focus on specific target populations within a more restricted proficiency range, and tasks may not be valid for populations at much lower or higher proficiencies. Having a theory of reading development as one of the validity supports for assessment practices might provide a more complete understanding of L2 reading abilities, their expected patterns of growth, and rationales for using different types of assessment tasks at differing proficiency levels. Until fairly recently, standardized L2 reading assessment had not been overly concerned with the development of reading assessment in terms of an evidence-based construct of reading abilities tied to the group of students being assessed. However, there are now a number of examples of major standardized assessments being developed from an initial set of claims about the nature of L2 reading ability and a set of tasks that would measure the relevant component skills. It is important to look at the types of tasks developed for standardized reading tests, consider how these major tests incorporate and reflect the reading 47

construct, and how they engage L2 learners in fair and appropriate assessment tasks. The primary purpose of assessment tasks is to collect information to make inferences about students’ reading abilities. Different reading tasks should help provide information about many component reading abilities as well as reading comprehension more generally. Reading assessment tasks come in many recognizable forms in standardized assessment as well as a few uncommon options. The most major task options used in standardized reading assessments. Standardized reading assessment task formats 1. Cloze 2. Gap-filling formats (rational cloze formats) 3. C-tests (retain initial letters of words removed) 4. Cloze elide (remove extra word) 5. Text segment ordering 6. Text gap 7. Choosing from a “heading bank” for identified paragraphs 8. Multiple-choice 9. Sentence completion 10. Matching (and multiple matching) techniques 11. Classification into groups 12. Dichotomous items (T / F / not stated, Y / N) 13. Editing 14. Short answer 15. Free recall 16. Summary (1 sentence, 2 sentences, 5–6 sentences) 17. Information transfer (graphs, tables, flow charts, outlines, maps) 18. Project performance 19. Skimming 20. Scanning Many of these task formats are well-known and widely used in standardized 48

tests. I will comment selectively on a number of them, and identify formats that are less common but that do appear in standardized assessments. Cloze assessments with random word deletions (every sixth word, or every seventh word) are not automatically valid assessments of reading abilities, particularly when students are expected to write in the missing words. Such tests become production measures and are not appropriate for L2 reading assessment. Much more useful options are gap-filling measures rational cloze formats that target specific words purposefully e.g, prepositions, verbs rather than delete every seventh word. However, even with gap-filling formats, a reading measure should not ask students to fill in words as a production task that they do not know or have not already seen from reading a text beforehand unlike short-answer formats in which students have read a non mutilated text beforehand. C-tests are variants of cloze formats, but rather than deleting whole words, the initial letter or syllable of a targeted word remains, and students use this clue, along with the sentence context, to determine the missing word. This option is less of a production task. Cloze elide, in which “extra” words are meant to be struck out, have the advantage of not requiring any production. In both cases, however, it is not easy to make persuasive construct-validity arguments for these formats. Text-segment ordering and text-gap formats involve the moving around of whole sentences or paragraphs, or the selection of the right space in the text to supply a sentence or paragraph. Text-gap formats can be tricky when multiple gaps are created and a list of sentences or paragraphs is provided to insert in the correct spaces. These formats amount to a type of multiple matching task. Choosing from a heading bank to label identified paragraphs is a similar type of task. The strength of these types of tasks is that they call on knowledge of discourse signals and discourse structuring to be answered successfully. They require several comprehension skills for appropriate task completion. A number of task formats above are relatively uncommon. Free-recall formats simply ask test takers to make a list of ideas they remember from a text they have just read. These responses are matched up against a list established by the test maker. Summary formats can be 49

straightforward though difficult to score. Alternative summary formats can include, for example, choosing the best from among three summary options and identifying the weaknesses of unacceptable options. Information-transfer formats, especially visual representations of text information, have powerful construct-validity support. However, they can be difficult to score and can have very high item interdependence. Project- performance evaluation is a newer task format that evaluates test takers as they read texts and then perform in groups to carry out a larger project. It is an interesting option, but is problematic on several validity grounds. Skimming and scanning tasks are well-known to teachers but are not common as standardized reading assessment tasks. Classroom-based assessment practices A first concern for classroom teachers is collecting and using reading assessment information to shape instruction and learning. . . . A robust classroom assessment program continually provides detailed information about students’ current competencies and next steps. Inevitably in contexts where informal teacher- or classroom-based techniques are used or advocated, little reference is made to their validity, accuracy, or reliability, and much more is made of their “usefulness” and “completeness.” 34 Classroom assessment allows for a much wider range of tasks and student observations. Testing formats in classroom contexts can include all of the assessment formats identified for standardized assessment. Classroom reading assessments can also make use of informal reading inventories or miscue analysis reading aloud one-on-one with an evaluator who notes errors on a record sheet and then determines what progress a student has made or what instructional support is needed by the student. 35 A number of other informal, or alternative, assessment types are also well recognized and commonly used in classroom contexts. Almost any language task that is a useful teaching task can be used as an assessment task. What might be lost in the way of relatively weak validity or consistency for any given reading task or measurement in the 50

classroom setting is, in principle, countered by the continual nature of assessment practices of all types in this context. Several types of informal assessment options are available to teachers, including the following: 1. Observations 2. Self-reporting measures 3. Progress charts 4. Performance inventories 5. Participation and engagement records 6. Portfolios Four ways to test inference making The text Hanna had so many green tomatoes in her garden. They would not be ripe before the frost set in. She wondered whether she could make a kind of jam. She decided to go and buy some nice jars. 34. Afflerbach, 2007 From reader to reading teacher: Issues and strategies for second language classrooms. New York: Cambridge University Press. p 268 35. Alderson, 2000, Assessing Reading. Cambridge: Cambridge University Press pp 268–69 Four formats to test inference making 1 Open-ended question What did Hanna need the nice jars for? 2 Multiple-choice format What did Hanna need the nice jars for? a) To make her kitchen look nicer b) To make jam c) For her tomato jam 3 True/false “Hanna decided to buy jars for her tomato jam.” True or false? 4 Cloze task ….. She wondered whether she could make a kind of jam. She decided to go and buy some nice ______ (a)jars b) jam c)money). 51

The words to choose from are a: story appropriate/ b: sentence appropriate /c: semantically inappropriate. Each general type of informal assessment category can be carried out by means of several specific tasks and in different formats. Regardless of informal assessment formats used, teachers and administrators have a responsibility to focus on appropriate tasks and interpretations of task outcomes so that students are not evaluated unfairly. The list above identifies a large number of informal assessment options that can be used in ongoing classroom reading-skills assessment. The items in this list are grouped according to the six major informal assessment types noted above. Many of the assessment options noted below are fairly simple and straightforward for teachers to use as means to gather important information about students’ reading abilities. A key issue for informal reading assessment includes the need for multiple assessment formats for any decisions about student abilities or student progress. In addition, informal formats should be operationalized in ways that provide more reading. Informal assessment formats 1. Have students read aloud in class and evaluate their reading. 2. Keep a record of student responses to questions in class after a reading. 3. Keep notes on student participation in class discussions on a reading. 4. Observe what reading material is read during free reading . 5. Observe how much time students spend on tasks during free reading. 6. Have students do paired readings and observe. 7. Observe students reading with an audiotape or listen to an audiotaped reading. 8. Have students list strategies they have used while reading. 9. Have students list words they want to know after reading and why. 10. Have students keep diaries or reading journals. 11. Have students write simple book reports. 12. Have students recommend books. 13. Ask students about their reasons for choosing certain answers in reading 52

tasks and activities. 14. Ask students about their reading progress. 15. Ask students about their goals for reading with various texts and tasks. 16. Keep charts of student readings. 17. Keep charts of student reading-rate growth. 18. Record how far a student reads on an extended reading task. 19. Have a student read and then have a discussion on the text (one-on-one). 20. Have a student read aloud for the teacher / tester and make notes, or use a checklist or note miscues on the text (one-on-one). 21. Have students do think-alouds while reading (one-on-one). 22. Have students enact a scene / episode / event from a text. 23. Note the uses of texts in a multistep project and discuss. 24. Have students fill out simple questionnaires of interests and engagement levels in various tasks. 25. Create student portfolios of reading activities or progress indicators. Objective assessment than after-the-fact judgment or overall subjective assessment. Informal assessment can be made more objective when a teacher knows that certain assessment information will be used for grading, ranking, placement, or advancement. Observations can be carried out on a regular schedule with certain tasks and activities. Notes should be recorded consistently after specific tasks, and comments on student performances can be recorded at breaks in classes or at the end of the day. Records for assessment purposes should be kept consistently and carefully. Portfolios and projects can be constructed with clear goals in mind and assessed according to a pre-established set of grading criteria; the grading criteria need to be applied consistently to all students. The goal is not to formalize informal assessment, but to remember to evaluate a wider range of student performances, thereby making informal assessment more effective and fairer to students. When using various and multiple student performances to inform assessment, decide on a grading or commenting plan before evaluating students. Assessments involving students reading in class, participating in discussions, 53

contributing to a project, reporting on a book they read, or performing in a scripted project such as a theater reading, a news report, etc. should include multiple assessment points e.g., observe each student every 15 minutes, note performance of multiple steps in a performance. Reviews of student reading records, reading and fluency charts, and reading portfolios should include notes and comments on students’ activities at multiple points in the school semester. Otherwise, it is often the case that the most recent one or two recollections dominate the assessment. Self-assessment by students is an important component of informal assessment and there are multiple options that teachers can explore. Self-assessments can require students to a) chart their progress on various skills; b) note what they are reading and why; c) explain their goals for reading and their reading choices; d) list reading strategies that they use or want to use; and e) assess their own evolving reading portfolios according to a few simple criteria. Through self-assessment, students develop greater self- awareness that feeds into assessment for learning when their self-assessments are reviewed, discussed, and reflected on. In fact, informal assessment practices, when objectivized in some way so that students participate in the assessment, can promote assessment for learning on a continual basis. Assessment for learning is an approach that is well-suited to reading instruction. In its simplest form, the teacher gathers feedback on student performance for example, on reading-related activities on a continual basis and engages students in improving their learning based on teacher responses. Teachers learn to respond to student signals of non-comprehension through teacher observations, outcomes of students’ weak performance, or specific feedback mechanisms that students can use. In many cases, the techniques used can be associated with effective comprehension strategies instruction, though these strategy uses are in response to formative assessment activities. The 15 ideas and techniques for assessment for learning outlined above apply to any learning and assessment context, but it should be evident that these techniques are ideally suited to reading tasks and reading comprehension development. These 15 examples of 54

engaging in assessment for learning represent only a subset of what teachers and students can do together to enhance learning through ongoing assessment feedback. In addition, many, if not most, of the informal assessment practices noted in the previous section as well as standard assessment formats create outstanding opportunities for teachers to engage students and groups of students in feedback. When implementing assessment for learning, the first step is to agree upon feedback mechanisms from students to teachers that allow students to signal difficulties that they are having. Responses from teachers should a) address skills needed to improve learning; b) encourage greater student awareness of what successful outcomes would look like; and c) provide opportunities to help students become more successful. Assessment for learning techniques 1. Teachers wait for 3–5 seconds after asking a question, without answering the question when students are silent, or without switching to a strong student for the answer. 2. Teachers ask students to generate good questions about reading texts that could be included on a test of some sort. Students learn how to formulate good questions about the texts they read, and their questions then appear on quizzes and comprehension checks. 3. Teachers move from more traditional question-and-answer sequences about reading passages to questions that begin a discussion with students about their understanding of the text. 4. Teachers withhold grades on student work until students respond to comments on their assignments e.g., multiple text syntheses, filled-in graphic organizers. In many cases, teachers do not provide grades at all, only comments. 5. Teachers deal with wrong answers or performance difficulties in ways that engage students in finding good answers and achieving task success. Teachers provide feedback to encourage student learning. 6. Teachers engage in “why” questions and “why” follow-up questions to generate discussions about an answer. 55

7. Students engage in self-assessment, monitoring their comprehension and their levels of success in carrying out during-reading and post-reading activities. 8. Students work in groups to answer questions and are given time to work out answers together. 9. Students set learning goals at the outset of instruction. 10. Students assess the work of other students, usually through comments rather than specific grades. 11. Students select a peer who will answer a question, for example, by drawing a student’s name from a hat. 12. Students learn to monitor their non-comprehension of a text or task and signal for assistance when they have difficulty. 13. Students review their own learning effectiveness. 14. Students redo their answers on a reading task or a quiz, often with peer support. 15. Students use “traffic-light” discs green on one side, red on the other to silently signal to the teacher that they are doing well or having trouble when working on their own or in groups. to be encouraged to see assessment for learning practices in a positive light. Placement and diagnostic assessment practices Most of the assessment formats provide the foundation for placement and diagnostic assessment. The key point about assessments for placement and diagnostic purposes is that they are usually more locally driven: The class, program, and institute have specific needs for placement and for the diagnosis of students’ strengths and weaknesses. It is true that standardized tests are commonly used for placement purposes such as , GORT [Gray Oral Reading Test] or TOWRE [Test of Word Reading Efficiency] for young L1 students; TOEFL or IELTS for L2 students), but programs and institutions often require additional assessment information and give follow-up assessments of crucial language skills, including reading skills. Locally based placement tests often also focus on specific skills that a program feels are important and need to be assessed. For reading, these 56

skills might include comprehension of academic material, discourse awareness for reading difficult texts, and writing from text resources. At more basic levels of L2 reading ability, students can be assessed and placed according to vocabulary knowledge, oral passage reading, grammar knowledge, and basic comprehension. Diagnostic assessment can be used for placement purposes, although the goals for placement and diagnosis should be distinct. Diagnostic assessment should present a battery of skills to students on a given ability level that may cause difficulties or alternatively should already be well-learned by students. Results should indicate the need for specific teaching practices and possible tutorial work that is designed specifically to address the weaknesses of each student. In many cases, diagnostic assessments lead to a plan for individualized work in addition to more generalized coursework for the whole class. Diagnostic assessments can focus on pseudo-word reading, vocabulary knowledge, sight-word reading for common words, analysis of complex syntactic structures, the ability to make reasonable inferences, and the ability to summarize main ideas, for example. All assessments have consequences. In a classroom setting, students may feel that they did not perform well. Teachers may be disappointed in a specific performance by a student and let it show even if no grade is involved. Informal assessments may inadvertently be made based on one or two salient experiences rather than a fair accumulation of evidence over time and across tasks. 57

CONCLUSION In this graduating paper, I have attempted to analyze the quantitative data of the present study which seeks to examine the effect of testing reading comprehension in English (L2) for university and secondary school students by using both multiple-choice and short answer questions. Besides the two main variables, the language of questions and the testing method, there were other variables which were included, namely: gender and five sub-skills of reading comprehension. Unlike Shohamy who found that “the testing methods – and language of questions – can make a difference in the assessment of the trait and can affect the scores that students obtain on reading comprehension tests” 36 , the results of the four main t-test studies in the present research show that there are no significant differences in the performance of both university and secondary school students in both multiple-choice and short answer questions. The fact that students did not benefit from the use of L1 in the questions and answers might indicate that 58

they had problems with understanding the passage itself. In other words, if the students were able to understand the passage, they would have been able to answer the questions regardless of their language, whether it is Uzbek or English. This underlines the importance of teaching students the strategies and sub-skills of reading comprehension to enable them to understand and deal with different types of texts and questions. Reading is a complex cognitive skill that can be affected by various text, reader, and test variables. A considerable amount of research has been devoted to examining these variables. This study is part of the effort to understanding some aspects of reading comprehension and its assessment. Assessment is sometimes treated as a bad word. But all of us engage in assessment all the time, both in our daily lives and in the classroom. We assess the value of most daily activities we engage in and most purchases we make. We assess our friends, our work, our leisure activities, and what we eat. We assess 36. Shohamy, E. (1984). Does the testing method make a difference? The case of reading comprehension. Language Testing, 1,2, 147-170 students’ homework, their group work, their responses to pre-, during-, and post- reading activities, and their level of engagement in class. Assessments also provide information for continuous learning. It should not be surprising, then, that assessments are essential to learning institutions, teachers, and students. Honest, fair, and appropriate assessments are needed by students if they are to learn most effectively. In closing this graduating paper about testing reading, we should conclude that it is important to emphasize that all formats need to go through a careful validation process that includes a theoretical justification, a feasibility study, a piloting study for reliability and item performance, and a fairness review. 59

Bibliography 1. Mirziyoyev Sh. The resolution No 2909 of the President of Uzbekistan “ On Measures for Further Development of the Higher Education System" dated from April 20, 2017 2. Mirziyoyev Sh.. From speech at Ibrat school, Namangan, April, 2018 3. Aebersold, J. A. & Field, M. L. From reader to reading teacher: Issues and strategies for second language classrooms. New York: Cambridge University Press. (1997).P 37 4. Alderson, J. C. Reading in a foreign language: A reading problem or a language problem? In J.C. Alderson & A.H. Urquhart (Eds.), Reading in a foreign language (1984). (pp.1-27). New York: Longman. 5. Alderson, J. C. & Lukmani, Y. Cognition and reading: cognitive levels as embodied in test questions. Reading in a Foreign Language 5 (2), (1989). 253-70. 60

6. Alderson, J. C. Assessing Reading. Cambridge: Cambridge University Press. (2000).p 19 7. Afflerbach, From reader to reading teacher: Issues and strategies for second language classrooms. New York: Cambridge University Press 2007. p 268 8. Geva, E.. Facilitating reading comprehension through flowcharting. Reading Research Quarterly, 18, (1983) 384-405. 9. Grabe, W.. Current development in second language reading research. TESOL Quarterly, 25,3, (1991) (p. 378) 10. Gough, P.. One second of reading. In Kavanagh, J., Mattingly, I. (Eds.), Language by ear and by eye: The relationships between speech and reading (1982). Cambridge: MIT Press. pp. 331-335 11. Goodman, K. S. Reading: A psycholinguistic guessing game. In Ruddell, R., Ruddell, M., Singer, H. (Eds.), Theoretical models and processes of reading Newark: International Reading Association. (1976). (pp. 497-508). 12. Hamdan, J., & Diab, T.. Using L1 in testing reading comprehension in English. Journal of the Educational Research Centre, Qatar University(1997) 6,12, 1-19 13. Huang, S. H. Assessing the relationship between referential understanding and academic reading comprehension among EFL college students. (2005). p276 14. Hudson, T. Teaching second language reading. Oxford: Oxford University Press(2007). p 56 15. Just, M.A., & Carpenter, P.A.. A theory of reading: From eye fixations to comprehension. Psychological Review, 87 (1980) , p. 329 - 330 . 16. Lee, Y.. Examining passage-related local item dependence (LID) and measurement construct using Q3 statistics in an EFL reading comprehension test. Language Testing, 21(1), (2004) p 7 9 17. Mitchell, D.C., The process of reading: A cognitive analysis of fluent reading and learning to read. New York: John Wiley & Sons. (1982). p. 133- 134. 61

18. Pearson, P. D. & Tierney, R. On becoming a thoughtful reader: Learning to read like a writer. In A.C. Purves, & O. Niles (Eds.), Becoming readers in a complex society Chicago: University of Chicago Press. (1984). p.144. 19. Rupp, A., Ferne, T., & Choi, H. How assessing reading comprehension with multiple-choice questions shapes the construct: A cognitive processing perspective. Language Testing, 23 (4), (2006)p . 441-474. 20. Samuels, S.J., & Kamil, M. Models of the reading process. In Carrell, P., Devine, J., & Eskey, D. (Eds.), Interactive approaches to second language reading New York: Cambridge University Press (1988). (pp.22-36). 21. Smith, F. Reading. Cambridge: Cambridge University Press. (1985). (p. 100) 22. Shohamy, E.. Does the testing method make a difference? The case of reading comprehension. Language Testing, 1,2, 1984 p 14 8 23. Snow, Griffin, & Burns, Reading 2005 p179 CUP 24. Tribble, C Writing Oxford University Press Tribble, C and Jones, G 1997 Concordances on the classroom, 1997 p 43 25. Tierney, R., & Cunningham, J.. Research on teaching reading comprehension. In Pearson, P., Barr, R., Kamil, M., and Mosenthal, P. (Eds.), Handbook of reading research New York: Longman. (1984)pp. 609- 655). 26. Urquhart, S. & C. Weir Reading in a Second Language: Process, Product and Practice. London: Addison Wesley Longman Ltd. (1998). P 125 27. Wolf, F., Gibson, E. & Desmet, T.. Coherence and pronoun resolution. Language and Cognitive Processes, 19(6), (2004) p 665-675. 28. Yano, Y., Long, M. H., & Ross, S. The effects of simplified and elaborated texts on foreign language reading comprehension. Language Learning, 44(2), (1994) p . 189-219. 29. Zhang, L. J., & Anual, S. B.. The role of vocabulary in reading comprehension: The case of secondary school students learning English in Singapore. RELC Journal, 39(1) (2008) , p 51-76. 62

30. Zwaan, R. A. & Brown, C. M.. The influence of language proficiency and comprehension skill on situation-model construction. Discourse Process 21, (1996) p 289-327. Internet sources 1. https://study.com/.../what-is-a-reading-model-definition-over ... 2. https://www.slideshare.net/JenniferOcampo/models-of-reading 3. www.readingrockets.org 4. https://busyteacher.org/4035-how-to-teach-a-perfect-reading . 5. https://www.understood.org/.../11-methods-for-teaching-rea d.. 6. https://agendaweb.org/reading-exercises 7. http://esl-bits.net/interact/sets/cloze1/cloze-1.htm 8. https://elt-resourceful.com/tag/reading-tasks/ 9. https://www.ntid.rit.edu/sea/processes/comprehension/ 10. https://www.sedl.org/reading/framework/assessment.html 11. https://www.britishcouncil.org/.../answer_key_assessing_read . 63

Похожие

Designing vocabulary tasks for beginners of English as a second language

Approaches to developing reading skills of learner 2

The selection and evaluation of words in teaching vocabulary to ESP students on the material of scale up

Developing reading comprehencion through defferent classroom technics for B1 level learners

Implementing effective techniques for developing efl learners’ listening skills