Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revisionLast revisionBoth sides next revision | ||
astro300_f17:day4 [2017/08/31 19:27] – ccheng | astro300_f17:day4 [2017/09/06 19:14] – [Homework] ccheng | ||
---|---|---|---|
Line 1: | Line 1: | ||
- | ======AY 375 - Fall 2017: fourth Day Lesson Plan====== | ||
- | =====Preface===== | + | ======AY 375 - Fall 2016: Fourth Day Lesson Plan====== |
- | Today we' | + | =====General Takeaways===== |
+ | |||
+ | - Deeper conceptual knowledge CAN be probed with multiple choice | ||
+ | - Especially when writing | ||
+ | - When answering homework/ | ||
- | ====General Takeaways==== | ||
- | - Deeper conceptual knowledge CAN be probed with multiple choice questions, but writing effective questions takes time and practice. | ||
- | - Especially when writing free response questions, it can be useful to develop a grading rubric for each question as a way of ensuring that your questions are specific, clear, and not testing the same concept over and over again. | ||
- | |||
=====Section Recap (20 minutes)===== | =====Section Recap (20 minutes)===== | ||
- | First have students discuss in pairs how section | + | Remind them that this is something we intend to do every week and that everyone should come prepared to share about how their previous sections |
- | Open the floor up for general questions and sharing | + | Remind them what to think about for section recap: |
* What did you do? | * What did you do? | ||
* How did you implement your activities? | * How did you implement your activities? | ||
Line 25: | Line 24: | ||
* What were you thinking about while you were running section? Any moments of panic? | * What were you thinking about while you were running section? Any moments of panic? | ||
- | + | (20 minutes) Open the floor up for general questions | |
- | =====Administering Demos (15 min)===== | + | |
- | + | ||
- | Printable Version Here: [[astro300_f14: | + | |
- | + | ||
- | * Demo basics: | + | |
- | * Demos are a great addition to a standard/ | + | |
- | * Sometimes they actually do help elucidate concepts and students like doing " | + | |
- | * As always, | + | |
- | * In addition, on a given topic' | + | |
- | + | ||
- | * What makes a good demo? | + | |
- | * Illustrating difficult physical concept(s) | + | |
- | * Interactive: | + | |
- | * A springboard to new topics | + | |
- | * Straightforward: | + | |
- | * Demo actually illustrates concept in question | + | |
- | + | ||
- | * When demos go wrong: | + | |
- | * Demos **can and sometimes do** FAIL! | + | |
- | * Sometimes, especially in astronomy, they can confuse students more than help them or oversimplify a concept. | + | |
- | * Materials may be missing or broken, so CHECK IN ADVANCE! | + | |
- | + | ||
- | * Some of our favorite demos: | + | |
- | * Remind everyone that most are written | + | |
- | - Arc lamps: Put high voltage through tubes of gas and look through diffraction gratings to see spectral lines. | + | |
- | * Head GSIs will train GSIs, Ask Ay375 instructors if you need help. | + | |
- | * Students like this one | + | |
- | * Make sure the stuff is there if your section is early in the day. | + | |
- | * Test it yourself and make sure you can see lines so you can help your students better. | + | |
- | - Warping of Spacetime: A 2D analogy using stretchy black fabric and balls/ | + | |
- | - Celestial sphere, phases of the moon, seasons, orbits: Styrofoam balls, a lamp or flashlight, people getting up and moving around. | + | |
- | - Retrograde motion //(Discuss pitfalls)// | + | |
- | - Day & night on Earth (circle up around a lamp and groups of 3) | + | |
- | - Lunar phases (balls on a sticks around a lamp and groups of 3) | + | |
- | - Seasons (circle up around a lamp) | + | |
- | - Lunar rotation and orbit (//i.e.// tidal locking) (one person orbits another with the Moon's arms outstretched) | + | |
- | - Parallax with your finger (very simple, “close one eye then the other” kind of thing) | + | |
- | - Doppler shift of sound (whirling a buzzer on a string) | + | |
- | - Class H-R diagram | + | |
- | - Stating in words, stating in math, drawing, and acting out Kepler' | + | |
- | - Donut/bagel on a string (though I'm sure profs will do it in class) | + | |
- | - Jumping on a chair with balls being thrown (though I'm sure profs will do it in class) | + | |
- | - (Rayleigh) Scattering of Light: Fill a fish tank with water and a couple drops of milk and shine a flashlight through it to show scattering of blue light and transmission of red light. On the EBRB [[private: | + | |
- | - Planetary Nebulae (and Limb Brightening and Optical Depth): use a Hoberman sphere covered in Christmas lights to show how spherical radiating clouds can appear ring-like. | + | |
- | * Physics has some, but it's kind of a pain to check them out, but some are good for section and some are good for full lecture. | + | |
- | + | ||
===== Multiple Choice and Free Response Questions (40 min) ====== | ===== Multiple Choice and Free Response Questions (40 min) ====== | ||
+ | - (5 min) Come up with either a multiple choice or free response question for the class you're teaching for and write it down on a piece of paper. Also think about what learning objectives it tests and what level of learning it probes. | ||
+ | - (6 min) Trade your questions with a partner. Have them attempt to answer the questions or at least determine what learning objectives were being probed, what level of learning it targeted, and what would have constituted as an " | ||
+ | - For both: | ||
+ | * Is the wording clear? | ||
+ | * What concepts are being tested? | ||
+ | - For the multiple choice: | ||
+ | * Is there clearly only one correct answer? | ||
+ | * Are there any obvious throw-away answers? | ||
+ | * Are you able to rule out any response because of the wording alone (i.e., are there hints in the structure)? | ||
+ | - For the free response: | ||
+ | * Does part B test the small conceptual/ | ||
+ | * What if students cannot solve part A? What does that imply for part B? | ||
+ | * What sort of responses might students give under the pressures of an exam setting? | ||
+ | - (6 min) Come back as a class and discuss. | ||
+ | * Did you learn anything surprising? | ||
+ | * Is this easy? (Unfortunately, | ||
+ | * What part of question writing did you find the most difficult? | ||
+ | - (20 min) Go through question example slides as a class exercise. | ||
+ | * MC Summary | ||
+ | * Test what you teach and teach what you test! | ||
+ | * Write short, clear questions and solutions. | ||
+ | * All answers should be of a similar tone and length. | ||
+ | * Avoid throw-aways, | ||
+ | * Be sure to not suggestively word your responses. | ||
+ | * Exams should have a variety of difficult and easy questions. Some easier questions at the start of the exam can enhance motivation. | ||
+ | * FR Summary | ||
+ | * Test what you teach and teach what you test! | ||
+ | * Write clear prompts. Be explicit about what you want students to provide (no core dumps). | ||
+ | * Multiple parts should test multiple ideas, not the same idea again and again. | ||
+ | * Solutions should require novel ideas, not a summary of material in the prompt. | ||
+ | * Reminder about timing: always take your own quiz/ | ||
- | - (20-25 min) Go through question example slides as a class exercise. | ||
**Some notes on multiple choice questions: | **Some notes on multiple choice questions: | ||
- | Despite their outward appearance, these questions are actually inherently nonobjective. Grading an essay exam is subjective to the personal feelings of the grader, compared to running a Scantron through a machine. Grading written problems falls somewhere between the two. This is only partially correct, " | + | Despite their outward appearance, these questions are actually inherently nonobjective. Grading an essay exam is subjective to the personal feelings of the grader, compared to running a Scantron through a machine. Grading written problems falls somewhere between the two. This is only partially correct: " |
The ultimate goal of testing is to measure what the students actually understand, and the process of interpreting the meaning of a student' | The ultimate goal of testing is to measure what the students actually understand, and the process of interpreting the meaning of a student' | ||
Line 96: | Line 79: | ||
Is short, to the point, and clear. You might be tempted to elaborate on small points that are not the main conceptual item that is being tested, but care must be taken. For example, | Is short, to the point, and clear. You might be tempted to elaborate on small points that are not the main conceptual item that is being tested, but care must be taken. For example, | ||
- | >> You forget that the star Betelgeuse is a red giant (a very luminous star in the top right of the HR diagram with relatively low surface temperature) and apply the method of spectroscopic parallax---a comparison of the star's apparent magnitude, estimated from the HR diagram, and its absolute magnitude---to determine its distance from Earth, which can be considered the sam as its distance to the Sun because the Earth-Sun distance is negligible given the scales involved. The true distance from Earth to Betelgeuse is actually... | + | >> You forget that the star Betelgeuse is a red giant (a very luminous star in the top right of the HR diagram with relatively low surface temperature) and apply the method of spectroscopic parallax---a comparison of the star's apparent magnitude, estimated from the HR diagram, and its absolute magnitude---to determine its distance from Earth, which can be considered the same as its distance to the Sun because the Earth-Sun distance is negligible given the scales involved. The true distance from Earth to Betelgeuse is actually... |
In an attempt to be completely clear, the stem has become more difficult for most students to understand! | In an attempt to be completely clear, the stem has become more difficult for most students to understand! | ||
- | Over the years, students have learned that when novice faculty | + | Over the years, students have learned that when novice faculty |
== Concepts == | == Concepts == | ||
Line 130: | Line 113: | ||
* Test the material emphasized - Exams should reflect the fact that students should know the big concepts really well, as opposed to knowing a bunch of smaller concepts only peripherally. | * Test the material emphasized - Exams should reflect the fact that students should know the big concepts really well, as opposed to knowing a bunch of smaller concepts only peripherally. | ||
* Keep questions short and to the point - Students should spend the majority of their test time thinking and answering/ | * Keep questions short and to the point - Students should spend the majority of their test time thinking and answering/ | ||
- | * Edit questions for clarity - Clear questions tend to be shorter | + | * Edit questions for clarity - Clear questions tend to be shorter. If anything is ambiguous, it confuses and slows down students and makes it harder for you to grade it fairly. |
* Don't write a long test - Keep it concise, to the point, and clear! | * Don't write a long test - Keep it concise, to the point, and clear! | ||
* Quizzes vs. Homeworks | * Quizzes vs. Homeworks | ||
Line 199: | Line 182: | ||
| | ||
- | =====Homework===== | ||
- | - Peer visits are assigned. Meet up for discussion with both the person who visited you and the person you visited by 9/20. Bring a completed Peer Visitation Worksheet to class on 9/20. | + | =====Break (5 minutes)===== |
- | - Draft a full length quiz and detailed grading rubric for the quiz. Bring TWO copies to class next week. | + | |
+ | =====Rubrics and Grading (30 min)===== | ||
+ | |||
+ | ====Activity==== | ||
+ | |||
+ | * Activity in groups of 3. Each group receives the same free response question. | ||
+ | * (5 minutes) Have each group develop a key and rubric for the question. | ||
+ | * (5 minutes) Give each group one student response to that question (three different responses, one for each group). Have each student grade the quiz based on that rubric individually. | ||
+ | * (10 minutes) Have students compare your grade with others in the group and discuss. | ||
+ | * (10 minutes) Discuss as a class and recap the main ideas of grading as a class: | ||
+ | * Reading some responses first is important | ||
+ | * How to handle erroneous info | ||
+ | * The most important part of grading: **Grade fairly and consistently for ALL students**. | ||
+ | * Try not to look at student names while grading anything | ||
+ | * Grade in blue or green (not red!) | ||
+ | * GRADE WHAT YOU TEACH AND TEACH WHAT YOU GRADE | ||
+ | |||
+ | ==== Notes from Past Years==== | ||
+ | |||
+ | === Free-Response Quizzes and Exams=== | ||
+ | * Most questions should have 1 and only 1 correct answer (matching, fill in the blank, put in order, //etc.//). | ||
+ | * Paragraph or few sentence responses or plotting can be uglier. | ||
+ | * Try to give partial credit where you can. **Always** give points for correct steps even if the final answer' | ||
+ | * Obviously if they screw up part (a) by a factor of 2, but carry that extra factor through parts (b) through (f) and get everything else right (while including the factor of 2), they should **only** lose points on part (a). Also, stress this fact to your students so they don't get frustrated if they can't do (a), but the rest are doable (maybe even tell them to make up an answer to use for later parts, or in the question say 'use 5km for the rest of this question if you don't get part (a)'). | ||
+ | * In longer answers, you should usually reward for correct information more than you punish for incorrect information. | ||
+ | * Hopefully on your quizzes and exams you stress to students that they must write clearly and explain their steps and logic clearly. | ||
+ | * Be suspicious: If you see similar, very wrong answers, flag the tests and compare their answers to other questions. Hopefully you can look out for cheating while the quiz/exam is actually going on, but you won't be able to see everything. | ||
+ | * Talk (probably through e-mail) to students in your section(s) who performed very poorly (grades of less than 40% or 50%). They may be too shy to ask for help even if they know they need it! | ||
+ | |||
+ | |||
+ | |||
+ | =====Office Hours & Answering Questions (15 minutes - if there' | ||
+ | This is in particular relevant to the lab-based courses (Ay120, Python class) where most of the GSI interaction is in the form of office hours or emails to answer questions on assignments. These are also useful in TALC. | ||
+ | |||
+ | Group discussion - you've probably been doing this but making it more explicit: | ||
+ | * (5 min) General office hour/email experiences so far (if not yet discussed). | ||
+ | * Have there been people coming? | ||
+ | * What kind of questions have you been getting? | ||
+ | * How are you handling them? | ||
+ | * Specially for lab courses where the course is focused on implementation/ | ||
+ | * (5 min) When you get questions from students on homework questions, how do/should you handle them? | ||
+ | * General strategy: Identify where the confusion is and address it | ||
+ | * Identifying the confusion: ask them to explain the problem to you as best as they can and see where they run into trouble | ||
+ | * What kind of confusion is it: misunderstanding? | ||
+ | * Address the source of the confusion and have them attempt the problem again | ||
+ | * In general, we want to push the question back to them, but in a different/ | ||
+ | * e.g. How do I find the location of the star in my data? How would you answer that | ||
+ | * e.g. Where do you think it is? What did your brain just do to try to figure out where it is? How could I put that in mathematical/ | ||
+ | * Learning how to problem solve and get to the answer are skills we want to teach | ||
+ | * We don't want the reason they did something to be: "The GSI told me to do it this way" | ||
+ | * (3 min) Debugging (specific to lab/python) | ||
+ | * How to handle debugging issues? Ask for opinions | ||
+ | * When do you help them? | ||
+ | * Avoid spiral of debugging everyone' | ||
+ | * General rule for Astrolab: because the class does not explicitly prereq coding, especially at the beginning, help them debug but also use it to teach them how to debug (print statements, pdb, how to use IDEs, how to use Google) | ||
+ | * (2 min) When should you just give them the answer? | ||
+ | * Things that do not really contribute to the learning objectives | ||
+ | * Math errors: 1+1=3? (Exception: equations in wrong units) | ||
+ | * Coding API questions (how do I make an array in numpy, what is the argument to do...) | ||
+ | * Things that take a long time to figure out how to get, but don't have very much benefit to learning (examples?) | ||
+ | |||
+ | |||
+ | =====Homework===== | ||
+ | |||
+ | - Peer visits are assigned. Meet up for discussion with both the person who visited you and the person you visited by 9/20. Bring a completed {{: | ||
+ | - Draft a full length quiz and detailed grading rubric for the quiz. Bring TWO copies to class next week. |