Education & TrainingFree
Course Update and Modernization Review
Send the current materials, the evaluation comments and the assessment data, and get the modules students dislike separated from the ones they are not learning.
Advice on updating an old course is advice about refreshing content. Replace the dated examples, swap the retired software, update the reading list, check the links. All of that is real work and none of it answers the question you actually have, which is where to spend the four days you have before term starts. Evaluations tell you what students disliked. Assessment data tells you what they did not learn. Those are different lists, and almost nobody puts them side by side.
BUS 342 Operations Analytics is an invented example: 142 students, eight modules, 96 evaluation responses. Rank the modules by how often students named them as unclear and Module 2 Queueing leads at 32.29 percent, Module 3 Inventory follows at 28.12 percent, Module 5 Linear Programming is third at 22.92 percent. Rank them by assessment mean instead and the order changes completely. Module 4 Forecasting is worst at 58.9 against a 72.7 course mean, then Module 2 at 61.4, then Module 6 Simulation at 66.8.
Module 4 is the finding. Nine students out of 96 mentioned it, which puts it fifth on the complaint list and nowhere near the top of anyone's rebuild plan. It also has the lowest assessment mean on the course, 13.8 points below average. Module 3, second on the complaint list, scores 79.6, which is 6.9 points above the mean. Students are telling you Inventory is hard and Forecasting is fine. The assessment says the reverse.
Four quadrants, and only one of them is urgent
Cross the two rankings and every module falls into one of four cells. High complaint and low score is agreement, and it is where the obvious work is: Modules 2 and 5. High complaint and high score usually means difficulty or workload rather than a teaching failure, which is a pacing fix, not a rebuild: Modules 3 and 8. Low complaint and high score is Modules 1 and 7, and the correct action there is to leave them alone.
The quadrant that matters is low complaint and low score. Modules 4 and 6 sit there, quiet and not landing, and quiet is exactly why they survive every revision cycle. There is a reason to expect it, too. In one study crowdsourcing learner ratings of educational resources, an unweighted average of subjective ratings predicted measured learning gains at a Pearson correlation of 0.38, with p equal to 0.14. A model correcting for each rater's own bias reached 0.78. Evaluation systems report the unweighted average.
Content currency is the third input and it is the cheapest to check. Of BUS 342's 34 external references, seven no longer resolve, which is 20.59 percent, and the lab still targets a software version retired in 2021. None of that is on either ranking, because a dead link does not generate a comment and does not lower a score. It is also the part of the review an accreditor will look for, since accreditation standards must set clear expectations for curricula.
How it works
Send the three inputs
Current materials, the evaluation data including free text, and assessment performance by module.
Rank it twice
Once by what students said, once by what they scored, with both rankings kept visible.
Cross the rankings
Four quadrants, so a loud module and a failing module stop being the same thing.
Price the changes
Each proposed change with an effort estimate against the performance gap it addresses.
What you get
- Modules ranked twice, once by evaluation comment frequency and once by assessment performance
- The two rankings crossed into four quadrants, with the quiet and underperforming modules named
- Free-text comments attributed to the module they are actually about, not to the course overall
- A currency check on references, links, software versions and data, with each dead item listed
- A change list ordered by effort against measured impact rather than by how loud the complaint was
- The evidence trail behind each proposed change, in the shape a programme review or accreditor asks for
Common questions
Why not just act on the student evaluations?
Because they measure experience rather than mastery, and the two diverge. On the worked example the second most complained-about module scores 6.9 points above the course mean and the lowest-scoring module is fifth on the complaint list. Acting on evaluations alone rebuilds the module that is working and leaves the one that is not.
What if we do not have per-module assessment data?
Item-level exam results work just as well, mapped back to the module each item targets. That mapping is the part worth doing carefully. Where only a single course grade exists, the review says the quadrant analysis could not be run rather than substituting evaluation sentiment for it.
Is a low evaluation response rate a problem?
It is a caveat, and it gets stated. BUS 342 had 96 responses from 142 students, so 67.61 percent, which is high for a voluntary evaluation and still not the cohort. The assessment side covers all 142, which is one more reason to weight it.
How do you tell a hard module from a badly taught one?
By where it lands. High complaint with high scores is a module students find demanding and are learning from, which is usually a workload or pacing question. The course schedule and workload planner is the tool for that, because it estimates student hours per module against the credit-hour expectation.
Does this rewrite the course for me?
No. It produces the evidence and an ordered change list, and you decide what to build. Where a module genuinely needs rebuilding from the outcome down, the course design pack is the structure for that work and learning outcome writing is where the outcome gets stated first.
What about materials I inherited rather than wrote?
Same analysis, different starting point, and usually a thinner materials record. Inherited course rebuild is the better entry point when you did not write the course. If the rebuild also moves the course online, the online course conversion pack converts each activity separately rather than by week.
Does the currency check cover accessibility?
Only as a flag. Dead links, retired software and superseded data are in scope; heading structure, alt text and caption quality are a separate pass. Course material accessibility review groups those findings by remediation type, which is a genuinely different piece of work from a content refresh.
Course Update and Modernization Review
Fill in the form and your workspace opens with the work already underway.