AY 375 - Fall 2017: Fifth Day Lesson Plan

Today we'll be continuing our discussion of how to write good free response questions and discuss how to approach a creating a rubric and grading.

1. Especially when writing free response questions, it can be useful to develop a grading rubric for each question as a way of ensuring that your questions are specific, clear, and not testing the same concept over and over again.

First have students discuss in pairs how section went (5 min).

Open the floor up for general questions and sharing about how sections are going. Some questions include:

• What did you do?
• How did you implement your activities?
• What worked?
• What didn't work?
• What would you do differently?
• How did you assess learning?
• Did you receive any unexpected questions/reactions/etc.?
• Did anything unexpected happen?
• What were you thinking about while you were running section? Any moments of panic?

The students should have prepared one multiple choice question and one free response question as last week's homework.

1. (10 min) Share your questions with a partner. Have them attempt to answer the questions or at least determine what concepts were being probed and what would have constituted as an “acceptable answer.” Once you have gone over all the questions, discuss in your small groups the goods and suggested improvements for the questions. Some questions to consider (perhaps project on the board):
   1. For both:
      • Is the wording clear?
      • What concepts are being tested?
   2. For the multiple choice:
      • Is there clearly only one correct answer?
      • Are there any obvious throw-away answers?
      • Are you able to rule out any response because of the wording alone (i.e., are there hints in the structure)?
   3. For the free response:
      • Does part B test the small conceptual/procedural knowledge as part A?
      • What if students cannot solve part A? What does that imply for part B?
      • What sort of responses might students give under the pressures of an exam setting?
2. (5-10 min) Come back as a class and discuss.
   • Did you learn anything surprising?
   • Is this easy? (Unfortunately, NO!)
   • What part of question writing did you find the most difficult?

• Activity in groups of 2. Each group receives the same free response question.
• Have each group develop a key and rubric for the question. (5 minutes)
• Give each group one student response to that question (three different responses, one for each group). Have each student grade the quiz based on that rubric individually. (5 minutes)
• Have students compare your grade with others in the group and discuss. (10 minutes)
• Discuss as a class and recap the main ideas of grading as a class. (10 min)
  • emphasize that reading some responses first is important.
  • discuss how to handle erroneous info.
  • The most important part of grading: Grade fairly and consistently for ALL students.
  • Try not to look at student names while grading anything.
  • Grade in blue or green. My (Aaron's) philosophy: Grade your own work in red, because you don't care about your own feelings. Grade other people's work in blue or green.
  • GRADE WHAT YOU TEACH AND TEACH WHAT YOU GRADE.

• Most questions should have 1 and only 1 correct answer (matching, fill in the blank, put in order, etc.).
• Paragraph or few sentence responses or plotting can be uglier.
• Try to give partial credit where you can. Always give points for correct steps even if the final answer's wrong. If they get the final answer but their steps or logic to get there is wrong, give them some points, but not too many.
• Obviously if they screw up part (a) by a factor of 2, but carry that extra factor through parts (b) through (f) and get everything else right (while including the factor of 2), they should only lose points on part (a). Also, stress this fact to your students so they don't get frustrated if they can't do (a), but the rest are doable (maybe even tell them to make up an answer to use for later parts, or in the question say 'use 5km for the rest of this question if you don't get part (a)').
• In longer answers, you should usually reward for correct information more than you punish for incorrect information. With that said, if they say something really wrong or even contradictory to the rest of their answer, they should be penalized a decent amount.
• Hopefully on your quizzes and exams you stress to students that they must write clearly and explain their steps and logic clearly. If you can't read their writing or understand what's going on, you should usually assume it's wrong.
• Be suspicious: If you see similar, very wrong answers, flag the tests and compare their answers to other questions. Hopefully you can look out for cheating while the quiz/exam is actually going on, but you won't be able to see everything.
• Talk (probably through e-mail) to students in your section(s) who performed very poorly (grades of less than 40% or 50%). They may be too shy to ask for help even if they know they need it!

• You'll grade these kinds of tests with your fellow GSIs.
• Have a few people people double-check the answer key Scantron for each version of the exam BEFORE you start running all the tests through the machine.
• Note any questions that are missed quite frequently. Reasons for this can include:
  • The question was poorly written or possibly too hard
  • The students just didn't know that material very well
  • There's an error on the answer key
  • Something went wrong with the machine or the answer key Scantron
• Note any one student who missed a TON.. Reasons:
  • They really just don't know what's going on
  • They marked the wrong test version (you might be able to re-run it through the machine with the correct answer key or their GSI or the Head GSI might have to grade it by hand)
  • They used some writing utensil that the machine doesn't like (their GSI or the Head GSI might have to grade it by hand)
  • Their test is too wrinkled or has coffee spilled on it or whatever (their GSI or the Head GSI might have to grade it by hand)
  • Use your judgment here; it's annoying to grade a Scantron by hand, but if they really just accidentally spilled something on it, then you should probably grade it by hand with no penalty. If they're dumb enough to mark the wrong test version, well, they might deserve some extra points off for that.
• It's a good idea to skim over each of your student's tests to see if there were any obvious bad erasure marks or anything like that which may have led to an answer being marked wrong unfairly. However, don't feel bad if you don't catch every one of these – your students will not miss any!!
• Like after quizzes, strongly consider talking to students in your section(s) who performed very poorly (grades of less than 40% or 50%).

• Usually not the GSI's responsibility to grade.
• Basically, all of the above rules apply.
• Cheating is certainly more of an issue since you can't watch everyone do their homework, so beware! As mentioned before, hopefully the graders will flag any possible cases of cheating and then you can take a closer look at the actual assignments and decide whether or not any academic dishonesty actually occurred.

• You should come up with some objective grade calculation (unless one is already provided to you by the prof and/or Head GSI).
• A grade for Discussion Section might include (ONLY if these aren't assigned grades on their own elsewhere in the course grading rubric):
  1. attendance in section
  2. participation in section (group work, coming up in front of the class, asking the GSI questions, worksheet diligence, etc.)
  3. in section quiz(zes)
  4. star party attendance
• Usually this isn't a huge part of the overall course grade, but it's sometimes a non-zero amount of points and you should be fair and consistent about assigning them.
• With that said, if someone really went above and beyond and worked really well in section, usually you have the authority (as long as it's cool with the prof and/or Head GSI) to give them a little something extra in their section grade (though you probably shouldn't give them over 100% of the section points).
• On the other end of things, sometimes students with borderline grades will try to wring a few extra section points out of you to push their grades up to the next letter.

• Usually GSIs don't have much control over this. However, GSIs occasionally help decide the course grading rubric before the semester starts.
• The course grading rubric should be well-defined and a (relatively) simple calculation.
• It should be spelled out in detail on the syllabus (which should be handed out or posted online at the very beginning of the semester).
• Converting numbers to actual letters is the hardest (and usually the most mysterious and opaque to students) part of this process.
• Finally, most profs/Head GSIs will let each GSI have a small amount of discretion in final letter grades (with pluses and minuses) for their students who are right near a letter grade cutoff.
  • Most profs/Head GSIs will try to choose the cutoffs such that no one is close to any of the boundaries.
  • However, this discretion is fairly common practice since the GSI should know the student (and their performance in the course) better than either the prof or Head GSI.
  • Thus the GSI can use the student's performance in their section to decide whether or not to bump them up above or below the cutoff.
  • With that said, unless the student was absolutely horrific in section, GSIs should probably never bump anyone down below a cutoff!

1. Continue to improve your two exam questions. Email me one of your two for further feedback.
2. In the next few weeks, try a new group work strategy or method of discussion in your sections or office hours. You'll report back to the class on how things went in a few weeks.
3. If you haven't done so already: peer visits. Meet up for discussion with both the person who visited you and the person you visited by 9/20. Bring a completed Peer Visitation Worksheet to class on 9/20.