Sunday, September 28, 2014

This is my combined post for the two tasks for Week Two of the Instructional Design Essentials Course:


Procedures for Educative Assessment

1.     Forward-Looking Assessment
Formulate one or two ideas for forward-looking assessment. Identify a situation in which students are likely to use what they have learned, and try to replicate that situation with a question, problem, or issue.

Below, I’ve generated ideas for two learning activities. During these activities, students will identify sources that meet the information need described and turn in a worksheet describing what sources they found and why they found them to be appropriate for the proposed situation.

Learning Activity 1: Working alone, students can imagine that someone in their family has been diagnosed with a disease.  Ask the student to find three reliable sources of information on that disease to share with their relative so that they can ask their doctor the necessary questions for ongoing care.

Learning Activity 2: Working in pairs, ask students to imagine that they have begun working in the sales department at a local car dealership. Their boss has tasked with gathering information to help identify the towns in their area where people are most likely in the market for new automobiles.  Using some of the research tools learned in the “Business” section of their course, find three reliable sources that would help inform this report.

2.    Criteria & Standards
Select one of your main learning goals, and identify at least two criteria that would distinguish exceptional achievement from poor performance. Then write two or three levels of standards for each of these criteria.

One of the main learning goals for these learning activities is the ability to “Evaluate information and its sources critically.” For these activities, I would require students to explain their reasoning for selecting sources.  The AACU Information Literacy VALUE Rubric provides excellent criteria for poor to exceptional achievement (used below):

Poor / Fair: Shows an emerging awareness of present assumptions (sometimes labels assertions as assumptions). Begins to identify some contexts when presenting a position.

Questions some assumptions. Identifies several relevant contexts when presenting a position. May be more aware of others' assumptions than one's own (or vice versa).

Identifies own and others' assumptions and several relevant contexts when presenting a position.

Exceptional: Thoroughly (systematically and methodically) analyzes own and others' assumptions and carefully evaluates the relevance of contexts when presenting a position.

3.    Self-Assessment
What opportunities can you create for students to engage in self-assessment of their performance?

In order to allow students to self-assess their work, I will provide the rubric I will be using to give feedback on class activities and other class assignments to students along with the directions on how to complete the activity and assignment. From the Fink document, I really liked the ideas of having students suggest the kinds of feedback they’d like when turning in the assignment, as well as asking them to explain which portions of the task they found to be difficult / that they struggled with.

4. “FIDeLity” Feedback What procedures can you develop that will allow you to give students feedback that is:
·      Frequent
·      Immediate
·      Discriminating, i.e., based on clear criteria and standards
·      Lovingly delivered

This is tough, just from a time management perspective. I already indicated that I plan to share the rubric for activities and assignments with students before they are due, so that should address the “discriminating” element. The frequent and immediate are going to be difficult – I’m in the process of learning to use the rubric function in Blackboard, and I’ve heard from many people that this does indeed speed up the grading process, so I hope this will help! For the lovingly delivered component, I do try to keep my language positive (while using the feedback sandwich – always opening and closing with positive feedback, with the negative/constructive criticism in the middle). Honestly, I want to know if others have tricks for encouraging students to read the feedback – I always get the feeling (and sometimes the proof) that they don’t.

Situational Factors
Assuming you have done a careful, thorough job of reviewing the situational factors, how well are these factors reflected in the decisions you made about learning goals, feedback and assessment, learning activities? What potential conflicts can you identify that may cause problems? Are there any disconnects between your beliefs and values, the student characteristics, the specific or general context, or the nature of the subject in relation to the way you propose to run the course?

In reflecting on what I have written about so far for this class, I think the number one issue or problem that I may run into, in terms of the course and the student characteristics, is that most students already believe they are efficient researchers, and many come into the class with the attitude that it is a waste of time. With the “forward looking” assessment and learning activities I hope to show students that the skills they are learning and applying in the course will benefit them in both their personal and professional lives after they leave college.  In addition to providing many real world examples / activities, I plan to intersperse the class time with fun and humor – to not have everything they’re doing in class be serious (or “boring.”)

Learning Goals and Feedback & Assessment
Issues to address include: How well do your assessment procedures address the full range of learning goals? Is the feedback giving students information about all the learning goals? Do the learning goals include helping the students learn how to assess their own performance?

I will use and/or develop rubrics that relate to the student learning outcomes for the course and tie those to individual activities/ assignments so that students know what I am looking for and exactly how their work will be evaluated. Those rubrics will be shared with students in advance so they can check their own work prior to submitting it for grading.

Learning Goals and Teaching/Learning Activities
Do the learning activities effectively support all your learning goals? Are there extraneous activities that do not serve any major learning goal?

As I work further on mapping on my plans for activities and assignments throughout the course, I will be able to eliminate activities that are “extraneous” or don’t serve a major learning goal. For those activities I plan to include to increase the “fun” factor in class, I will make sure those activities are also tied to the main learning goals of the course.

4. Teaching/Learning Activities and Feedback & Assessment
How well does the feedback loop work to prepare students for understanding the criteria and standards that will be used to assess their performance? How well do the practice learning activities and the associated feedback opportunities prepare students for the eventual assessment activities?

Again, the sharing of the rubrics with students in advance and the application of the rubric feature in Blackboard will allow students to see exactly how their work was assessed within the parameters of the rubric. I think the suggestions in the Fink document to have students receive feedback on either a low-stakes assignment or a non-graded assignment prior to the first graded work would be helpful to demonstrate to students how grading/assessment will be performed in the course, so they can see the “rubric in action” if they haven’t already seen it in previous courses.

6 comments:

  1. Getting students to read feedback: great question. I know at least one teacher of writing who gives all his detailed feedback on drafts; students are then expected to incorporate that feedback into their final versions, and if they don't, it shows up in the grade (he also doesn't need to do extensive commentary on final drafts with this system). Not sure how portable that is to library instruction, but I thought I'd offer it in case it's useful!

    ReplyDelete
  2. Loved reading your post, Stephanie. I'm glad you pulled out Fink's suggestion of having students suggest their preferred feedback and having them reflect, it's something I would like to incorporate more myself. And as far as feedback, I can say from when I taught our credit course here, we could see from D2L usage stats that students definitely were not reading feedback and not incorporating the feedback into the next assignment. Sarah makes a great suggestion above, that sounds like an effective approach.

    ReplyDelete
  3. Regarding feedback to students, my dean has suggested that instructors focus on one area on a given assignment. As an example, if I want students to evaluate authority and relevance, I would review and assess their work on authority only. I believe her idea here is that (a) students are not overwhelmed by too much information and (b) students master the concepts one step at a time. I think there is something to this advice, but I have not found a way to implement this style of grading in my class yet.

    I like both of your ideas for forward-looking assessment. Looking up a disease could certainly be relevant to many students. In my post, I tried one disease (alcoholism), but now I am wondering whether a choice would help. The business project would be hard for me to teach, but after I read your previous posts, it makes sense that this idea would be interesting to your students.

    I enjoyed reading all of your posts! :-)

    ReplyDelete
  4. Enjoyed your posts for Week 2! Specific pieces that stood out to me: (1) the value of incorporating humor and fun into the learning process (I love that! - great reminder for us all); (2) the course I'm planning is a biomedical literature course, and I plan to do an activity similar to the one you described about finding reliable consumer health information; (3) I struggled in my own post this week to come up with standards/rubrics that provide concrete examples of poor/excellent performance, but seeing the ones you listed definitely helped spark some ideas there. Thanks for the thoughtful post!

    ReplyDelete
  5. Thanks everyone for your comments - really helpful suggestions! I like the ideas of being targeted in my feedback (and letting students know that ahead of time, so they know where to concentrate their efforts / what is important), and also to tie some part of the final project grade to the incorporation of feedback. I've tried that in the past (to some, but not total, success)... maybe the key is making it a bigger portion of the grade (ha)! :)

    ReplyDelete
  6. Hi Stephanie,
    Great post! I learned a lot out of it expecially as I am strugglign myself with grasping the assessment stuff a bit. I liked the real life examples a lot, however, I am not sure if you would get the buy-in from my students as they seem to go for concrete assignements for class and grades first. And yet, I like the two examples and I might pick them up (if you do nto mind for my class sessions).
    The AACU standards are a great point and I see more and more the importance of the rubrics for myself but also for pointing out for the students the clear expectations for them. If then, they do read the rubrics, I am not sure but when I present in class the rubric and my expecations fo rthe next assignment (with the back up of the faculty member who will grade the assignment), most of them will listen.
    With regard to giving feedback, linking it to a next assignment is great. I hda the chance to do a feedback talk to small groups of students (3-4). They had handed in an annotated bibliography and it worked well for some groups of students and for some it did not work out well. There were also instant peer feedback involved.
    Finally, the issue with the students that believe to know already everything, I try to pull them in by making them part of the 'teacher' group :) I ask them to show students where to find things or how to evaluate documents by adding things that they might have forgotten.
    So much for now - vielen Dank und Merci. Michael

    ReplyDelete