I've written before about mixing up dimensions. It seems to happen all the time. Here's an example from a nicely done learning outcomes site I came across. This sort of thing looks good for the casual reviewer, but I imagine isn't much use for actually finding opportunities for improvements.
There's actually a note at the bottom saying that the scales have no relation to one another. And yet they all get added up?
It would help if we used units, even if they were more imaginary than real. For example, is the math score a percentage rate of getting a correct response on some kind of math (obviously not in this case)? If it's a total score, what is the maximum? Is it a rate of learning or an absolute measure? And so on.
Adding them up is clearly absurd, but we do it all the time: that's what grade averages are too.
The graphs were made with Tableau, by the way. It's great for generating reports.
Subscribe to:
Post Comments (Atom)
-
"How much data do you have?" is an inevitable question for program-level data analysis. For example, assessment reports that attem...
-
The annual NACUBO report on tuition discounts was covered in Inside Higher Ed back in April, including a figure showing historical rates. (...
-
I'm scheduled to give a talk on grade statistics on Monday 10/26, reviewing the work in the lead article of JAIE's edition on grades...
-
(A parable for academic workers and those who direct their activities) by David W. Kammler, Professor Mathematics Department Southern Illino...
-
I read Peter Sacks' Standardized Minds a few years ago when I was helping put together our general education assessment process . This...
-
In the last article , I showed a numerical example of how to increase the accuracy of a test by splitting it in half and judging the sub-sco...
-
Introduction Within the world of educational assessment, rubrics play a large role in the attempt to turn student learning into numbers. ...
-
tl;dr Searched SACS reports for learning outcomes. Table of links, general observations, proposal to create a consortium to make public th...
-
Introduction A few days ago , I listed problems with using rubric scores as data to understand learning. One of these problems is how to i...
-
This post is the first of a series on student achievement. The National Center for Education Statistics (NCES) summarizes graduation rates...
No comments:
Post a Comment