Blackboard

Itemized question breakdown

rated by 0 users
Answered (Verified) This post has 1 verified answer | 6 Replies | 4 Followers

Top 25 Contributor
Male
122 Posts
Warner Taylor posted on 8 Jun 2011 7:30 PM

I have instructors who are very unhappy that they can't pull itemized data about questions in a question set.  Can anyone give me any information on how this might be possible.  In WebCT4.1 (an OLD system) it was possible but BB9.1 (a NEW system) doesn't have the option.  Please provide any solution you are aware of.  I've even tried to pull using Respondus and it won't work that way either.

WT

Answered (Verified) Verified Answer

Top 500 Contributor
Female
9 Posts

 

Normal 0 false false false EN-US X-NONE X-NONE MicrosoftInternetExplorer4

Hi Warner,

When you download results you want to be sure to select “By Question and User” and “All Attempts”.  This will download ALL the information you need.  After uploading into Access you will create queries to sort and pull the specific data needed.  Then you can use the wizard or design view to create reports – or even just pull the data into excel. 

One other thing to note, if you didn’t randomize your questions then you can use the Question ID # to sort and group all answers for one question.  However, if you did randomize, you’ll have to figure out another way to identify the questions.  I use Respondus to create my exams, it embeds the question number which I can strip out of the question field into its own column before uploading to Access.

Like I said it’s a process, but once you have everything created you can pull detailed information together rather quickly.  Smile

 

Stephanie

All Replies

Top 10 Contributor
Female
1,024 Posts

Warner - I don't know of a work around for this besides downloading the results to an excel spreadsheet and manipulating the data from there. This was discussed in a Suggestion Squad and Blackboard is aware of the wanted feature. You may want to submit it to the suggestion box as well at http://suggestions.blackboard.com.

paige

Top 500 Contributor
Female
9 Posts

Warner,

I’ve had the same issue where my instructors were used to getting a lot more detailed information than what is available in BB.  To resolve this and provide all that information to them, I download the results and then upload to an access database and from there I’ve created my own queries & reports.  I can provide a question analysis (aka attempts statistics), especially useful when I use random blocks or want to drop any essay or fill-in questions from the statistics.  I can pull an individual question or several so instructors can grade fill-in’s/short answer quickly on one spreadsheet instead of having to access each individual student record in BB.  I can also quickly adjust scores if the instructors are dropping a question, granting points for an alternate answer, etc.  I also use the results to create a point biserial report.

This has been working for me, however there is some formatting on my side in order to get this all done.  I’m sure there are other solutions and would certainly like to hear what others are doing.


Stephanie

 

Top 25 Contributor
Male
122 Posts

I'm creating an Access DB, but don't know much about the reports in Access to be able to get wha tI want out.  The other problem, is that the download doesn't show you what answer the student selected, it only shows if they got the correct or wrong answer.

Top 500 Contributor
Female
9 Posts

 

Normal 0 false false false EN-US X-NONE X-NONE MicrosoftInternetExplorer4

Hi Warner,

When you download results you want to be sure to select “By Question and User” and “All Attempts”.  This will download ALL the information you need.  After uploading into Access you will create queries to sort and pull the specific data needed.  Then you can use the wizard or design view to create reports – or even just pull the data into excel. 

One other thing to note, if you didn’t randomize your questions then you can use the Question ID # to sort and group all answers for one question.  However, if you did randomize, you’ll have to figure out another way to identify the questions.  I use Respondus to create my exams, it embeds the question number which I can strip out of the question field into its own column before uploading to Access.

Like I said it’s a process, but once you have everything created you can pull detailed information together rather quickly.  Smile

 

Stephanie

Not Ranked
1 Posts

Hi Warner,

Our building block, EAC Outcomes, provides among other things detailed test and test question data (including validity statistics such as KR-20s, point biserial correlations, and p-values) for BB9.1 exams.  You can learn more at http://eacoutcomes.com/stats.htm and of course I'd be happy to demonstrate it for you if you're interested.

All my best,

Chris

 

Top 25 Contributor
Male
122 Posts

Thanks to everyone for the replies.  I've built a MS Access database and given my instructors details on how to download it and put their data into the database to get a report.  The report is way longer than I really wanted, but this is because I don't know much about Access. 

I believe this is a feature that BB should add in the near future, because it was a very valuable tool in the WebCT platform that they have swallowed up.

Page 1 of 1 (7 items) | RSS