The Science Learnification Weekly (April 18, 2011) – Homework Special EditionPosted: April 18, 2011
This is a collection of things that tickled my science education fancy in the last week or so. My internet was down for most of the week so this week it will all be on one topic, homework.
Cramster articles in The Physics Teacher
Over the past two months Michael Grams has published two articles on Cramster in the American Association of Physics Teachers publication The Physics Teacher. Cramster is a website where students can go to get poorly worked out solutions to textbook problems (more on this later) or get live help from “experts”. It has a tiered membership where people have some access for free but have to pay to have full access.
- Cramster: Friend or Foe (free article)? Grams discusses the website, and what some of his previous students and fellow educators think about it. He also sets up his experiment which is discussed in the second article.
- The Cramster Conclusion (not a free article): His research question is “Could giving students the answers to their assigned homework problems be an effective way of teaching them physics?” His students were provided with both a full membership to Cramster, and two days after homework assignments were given, the full textbook solutions to those problems. The homework was never collected nor graded, but an in-class quiz consisting of a numerical problem similar to one of the homework problems was given to follow-up on each assignment. He used common diagnostic conceptual surveys (Force Concept Inventory in his Mechanics sections and Conceptual Survey of Electricity and Magnetism in his Electricity and Magnetism sections), administered some exit surveys on their use of the solutions and had some follow-up student interviews. The most interesting findings (to my mind) were (1) that students greatly preferred the textbook solutions over the Cramster ones, and (2) the students with the best performance on the conceptual diagnostic surveys typically focused a lot of their attention on the “reasoning” part of the textbook solution when they used these solutions, where the students that did poorly on the conceptual diagnostic surveys completely ignored the “reasoning” parts of the solutions and just focused on the mechanical steps of the solution. The students found that the Cramster solutions often had errors, huge gaps in logic, and lacked any sort of reasoning steps, which is what made the textbook solutions their preference. This article really would have benefited from using graphs as its main method of communicating data instead of gigantic tables and endless numbers within the body of the article.
More challenges to standard assign and grade homework practices
- The Grading Dilemma: What’s Effort Worth? Shawn Cornally (Think Thank Thunk blog): “You can stop grading things. You can alleviate your students’ performance anxiety and points addiction by allowing them to engage with things purely for the fun of it. I’m so angry right now for how hippy-dippy this must be coming across.” Go read it.
- What does education research really tell us? Alfie Kohn (author of The Homework Myth and many other books) talks about three traditional teaching practices: behavior change through rewards, assigning homework, and teaching by telling, and discusses research which challenges common practices and/or findings from smaller previous studies. When looking at influence of homework on learning when factoring in other things such as instruction and motivation, researchers found “Homework no longer had any meaningful effect on achievement at all, even in high school.”
Randomized numbers in pencil and paper assignments (or quizzes/exams)
- DIY personalized, randomized assignments: Ed Hitchcock (TeachSciene.net blog) discusses how he uses some standard M$ office programs to make student assignments that have randomized numbers so none of the students have the exact same question, meaning that their discussions of homework can focus more on the process than only the solutions. This randomization is common for online homework software such as Mastering, WebAssign, LON-CAPA, etc, but it’s nice to see a quick way to take this into the pencil-and-paper question realm.