As you know, it’s Make Assessment Easy Month here at Oh No. In the Engineering Advising Center, we recently (last year) re-vamped our office assessment(s), and I’ve learned oodles in the process. Whether you’re creating an office-wide strategy, or a strategy to measure the success of a specific program owned by your office, these four steps (which I picked up from Nacada’s 2014 Assessment Institute) can help you get from nothing to a simple, focused, and effective strategy. Most of the links to which I’m referencing come from NACADA, though the concepts are applicable to more than just advising.
Step 1, Create Learning Outcomes: NACADA recommends that learning outcomes focus on what we want students to know, do, and value (see last paragraph in Concept of Academic Advising). It’s good to keep this list short. We have 8 outcomes we focus on in our office. The longer your list, the longer (and more boring) your report of results. If your colleagues fall asleep while you’re discussing the results, you may have too many outcomes.
Step 2, Opportunities for Students to Achieve Outcome: It’s good to have a plan for when (e.g., workshops, advising appointments, etc.) we want students to achieve our desired outcomes. This portion might include workshops, advising appointments, tutorials, etcetera. In most cases, this is what you’re already doing! Hopefully.
Step 3, By What Time Should Learning Occur? This step helps you indicate when you’d like students to achieve your outcomes. For example, if you’re a career services office and you want students to have created a resume, you probably want that to happen sometime before they’re job searching. We often use student academic years/terms for this. For the resume example, your deadline might be by the end of their first year*.
*Originally I put “junior year” here. Abby’s response gave me the sense that career services folks would riot in the streets if this didn’t happen until the junior year. My sincere apologies! Feel free to pretend this deadline is anytime you see fit…
Step 4, How Will You Know if the Outcome Has Been Met? We use this step to determine when we’re going to make a measurement. It helps to limit yourself to just a few surveys or queries a year — this keeps your process sustainable. Common times to collect data are at the end of orientation, fall, and spring term.
In the end, you will have a table, with the learning outcomes as rows and each step as a column.
This system works whether you’re creating an assessment for the entire office or if you’re just trying to assess one program. I’m using this process to assess our training and development of our orientation leaders this summer.
I hope you found this table useful. As you start to dive into the process of creating an assessment, you will come across questions that the table does not address (e.g., should we use surveys or focus groups or some combination of the two? Is our data valid? etc.). Just remember the KISS rule of thumb: Keep It Simple Steve. You may want to replace “Steve” with your name. The assessment does not have to be perfect. It should be simple enough for you (or someone else) to explain and follow through.