Who Will Guarantee the Quality of Item Bank
With the introduction of CAT, most of our efforts are put on model design, or in other words we only care to let it work. Comparing with traditional test, in which items are designed and used for only for time, CAT reserves more critical requirement on item pool. As we know, perfect item bank will not guarantee perfect performance in CAT; however, today, we are far away from perfect item bank. Besides, what is means GOOD item pool? How to measure the metrics of item quality? How to use them in an optimal way? How to update them? How large is it? If we lost at the very beginnig, how can we persuade people to accept its authority of CAT?
posted by Shunkai Fu @ 7:59 AM
2 Comments:
A related issue:
Unless you have a VERY large testing program, it is very difficult to use CAT to pretest items for future use without raising new concerns, including:
1. How do you seed the pretest items in a CAT so that they do not affect scores (or perception of performance by examinees)? For example, an easy pretest item (though we don't yet know it's easy) is embedded in the midst of a hard route, or vice versa. Does this affect the test-taking experience enough to affect the examinee's score--or the estimated parameters of the item being pretested?
2. What is the effective impact on item parameter estimates of NOT pretesting on a representative sample of test takers? Even if none if such items come early in the test, is there an ability estimate x context x difficulty effect, where context is the placement of the item in the test?
3. How do you control exposure of items and still get enough administrations to be confident in the parameter estimates of items being pretested for the pool?
Just the tip of the iceberg...?
[url=http://www.adulthostedblogs.com/?u=videoseadrian5]OJOsoft VOB Converter[/url] [url=http://www.answerbag.com/profile/1236275]Xilisoft Video Converter 3.1 Professional[/url]
Clipstream Video Acker DVD Audio Ripper 2.0.65
http://www.answerbag.com/profile/1236477 Amadis Video Converter Suite 3.5 2
[url=http://www.answerbag.com/profile/1238659]Aurora MPEG to DVD Burner 5.2.4[/url] [url=http://www.adulthostedblogs.com/?u=videoseabbie6]A-Z iPod Video Converter 6.90[/url]
Altdo WMV&ASF to AVI WMV DVD Converter&Burner McSee Movie Converter
http://www.adulthostedblogs.com/?u=videosealix7 Absolute Video.to Audio Converter 2.9.9
Frontcam
my icq:858499940385
Post a Comment
<< Home