Sunday, February 24, 2013

THE RIGOROUS PROCEDURE OF DESIGNING AND SCORING TESTS

 When reflecting on the ways we as teachers have assessed students, we might remember our first experiences as assessors and the tasks we try to think about to fulfil the institution's policies about evaluation where we worked. It is so probable that we had made a lot of mistakes just because we thought that creating a test was only about thinking of the topics seen in class and asking students about them in order to get grades. Of course, that is one of the aims but then, when  time went by and we were gaining more experience we started to realize it was not that easy. I don't know if it only has happened to me, at least I can reflect on my own practices.


 As we observe guidelines explained by Genesee and Upshur we can confirm that the process of test design could be as rigurous as class preparation. In these few paragraphs, I'm gonna focus on just two aspects in the process of assembling and scoring tests.

 First of all, I want to talk about reliability in scoring. Casting my mind back, I remember that I used to work in place where testing was only required to do at the end of a term. No more tests results were taken into account to mesure students' performance. The course lasted 3 months and 8 units were included in such test. By coining what the authors introduced previously have stated, I can explain my reflection and questioning: Did just one test mesure what the students really knew? The fact of taking one test that mesured almost all what they have "learned", could influence their pshychological state? Could just one test assess 8 units at the same time? Those are the questions I asked myself and these are the answers I have now: It is undoubtedly necassary not to mesure students' performance with the results of a single test. It is likely to show inappropriate grades because aspects such as emotional states can influence their outcomes. Moreover, the amount of topics demands different opportunities of assessment. It is worth mentioning that these assessment practices have a relevant impact on the kind of teaching inside a classroom, an issue that is further this discussion.


The other aspect I want to mention is the importance of having analytical scoring procedures to assess open-ended questions. They are very useful and every place in charge of language teaching should have one to facilitate the scoring process and give it more reliability.

Again, I remember my practices and only in few times I have count on a list with specific criteria to measure Ss production. I have realized of its relevance and I have started to use it. It gives more rigurousity to my assessment.
We can see now how much effort a test could need though here we analized only two aspects. As long as time goes by and we acquire more knowledge on assessment, it is a must to start reflecting and making changes to improve our teaching-learning-assessment practices.

Sunday, February 10, 2013


Journals, questionnaires, and interviews: Types of needs analysis?




The importance of conducting a needs analysis is known by many teachers and student-teachers, who are interested in getting to meet the specific necessities of different classroom environments. When they are applied, teaching and learning processes are expected to change, improve, and go to the rightest direction for them to be effective. Through the following paragraphs, we will see some reasons why journals, questionnaires, and interviews can be taken as types of needs analysis that deliver more benefits than just getting answers though a survey.

Most of the times, when we think about needs analysis we relate the idea to a survey only, but as far as we examine the benefits of other alternatives such as journals and interviews, we realize that they are not just all about that. They are a deeper manner to conduct what is known by us as needs analysis because they are very focused on students’ perceptions, interests, and desires in educational settings.

Journals: as mentioned before, their main concern is to get to know students perceptions. Journals are written conversations between teachers and students in a relatively informal way where they talk about a classroom-related topic or another one that allows the teacher to get closer to the students’ thoughts. These pieces of writing receive feedback from the teacher and that leads to continue a conversation where more and more perceptions are delivered. Of course, the information influences                                                future teaching practices.

So far, we can see that in a general sense they are needs analyses but now, let us see other further benefits they bring to us as teachers:
  • They permit to train the students in the mechanics of writing as a genuine communication.
  • They increase closer communication with teachers and they provide more reliable data on their real needs.
  • They lead to an individualized teaching strategy on writing, where the teacher can give more specific feedback and observe progress.
  • They enhance students’ involvement in learning.

Questionnaires and interviews: their main purpose is to ask questions about a variety of issues that surround language teaching; there are many designs to get effective students’ answers to be able to actually guide our practice and make relevant decisions. As journals, in a general sense, they share the aims of a needs analysis but let us observe some further advantages:

  • In the case of interviews with students, not only do they provide answers to questions but also they lend themselves to train in the mechanics of speaking.
  • They promote the enhancement of fluency.
  • They allow the teachers to have a clearer panorama of the students’ progress on speaking skills.

After having realized of the benefits that journals and interviews offer, that apart from analyzing needs they promote the improvement of language skills, I think they are powerful tools inside our classrooms. I really would like to implement them and learn to adapt them to specific contexts. What about you? Can you see the negative part? I’m looking forward to knowing your minds.