A Glossary Isn’t Enough & Replacing Comprehension Qs with Reflection Qs

After looking at various first day/week/month materials for the beginning language learner, I was reminded that most resources include texts with way too many words, way too soon. A full glossary certainly helps, but isn’t enough. Words need to be recycled often—especially in the beginning—to have a chance of being acquired by all learners (not just the ones with an excellent memory). If your text doesn’t recycle its vocab, you should adapt it. Remember, for a text to be truly readable (i.e. without starting to become laborious), students must understand 98 words in a text with 100 different ones, 49 words in a text with 50, and pretty much every word in a text of 25 (Hsueh-Chao & Nation, 2000).

A full glossary is as close to cueing as we can get asynchronously, but we won’t know how students are using it. As part of evidence of engagement when reading a text, these Google Form reflection questions could shed light on that:

ex.

  1. How often did you look up meaning of words?
    – Hella
    – A lot
    – Sometimes
    – Not very much
  2. What was your experience of looking up words?
    – No problem at all
    (i.e. it helped you read, or you didn’t mind looking up words)
    – It was OK
    (i.e. a little annoying looking up words, but not too bad)
    – It started getting hard to read
    (i.e. looking up words started feeling like “work”)
    – I kept looking at almost every word, so “reading” was really hard to do
    (i.e. this was a bad reading experience)
  3. Would you like Mr P to give you easier & shorter texts to read?
    – Yes
    – No

The first two tell us a student’s threshold for “noise” (i.e. how much incomprehension in the input they can handle), but the last question is going to be extra important. If a lot of students opt for “yes,” we can put effort into making easier texts for all (e.g. an additional simplified tier). Alternatively, we could reach out to a few individuals with support.

Support vs. Individualized Feedback
I wrote about how individualized feedback, especially when required, is largely a waste of time. Don’t confuse providing additional input to a student with giving an individualized feedback for its own sake, about something that student completed (but doesn’t need any reply), or worse, on correct/incorrect responses. That kind of individualized feedback isn’t worth our time, and not even effective, pedagogically. When any reflection Q responses indicate comprehension, we don’t need comprehension Qs.

In fact, rather than spending time any time at all writing comprehension Qs, use data from the reflection Qs and spend time writing more comprehensible texts! That is, inasmuch as comprehension Qs are a student’s word on homework (i.e. remote learning), so are the reflections. It’s much more valuable to get a sense of how often a student is referring (i.e. signs of incomprehension) rather than percentage of X correct out of Y. Students are also more likely to report how often they used the glossary more accurately, which itself is all the comprehension data we need.

How Comprehensible Must Reading Be?

Marcos Benevides’ Slideshare PPT has been floating around for over a year now. It’s a powerful illustration of how unknown words affect reading fluency (speed + accuracy), especially for anyone who thinks students will be OK reading anything that’s less than 98% comprehensible.

Still, the syntactical clues in Marcos’ PPT helped native speakers. In order to simulate a student’s reading experience more accurately, I removed those clues. Here’s the result (download, here, for sharing):

Slide1Slide2Slide3Slide4Slide5