Samples
Contents
We have a few samples for you to admire and play with.
All of these samples have links leading to downloadable workbooks ready to run with Lertap. One sample, the "Cooks Tour", has test and survey results which are not only Lertap-ready, but do not require a download of any sort.
A note for item and test analysis classes and instructors: two of the samples below might be particularly useful as they include actual test/survey items as well as Excel workbooks containing authentic data. They are No. 4 and No. 17. The other samples by and large have data only, an exception being "FIMS", No. 15, an example with items and data but involving considerable complexity.
In the table below, "Complexity" mostly refers to the set up of the workbook's CCs worksheet, where lines of Lertap's control language are housed.
No. |
Name |
Complexity |
Subtests |
Description |
|---|---|---|---|---|
(1) |
Simple |
1 cognitive |
A 10-item quiz given by a chemistry teacher. |
|
(2) |
Simple |
1 affective |
A questionnaire with 10 Likert questions; some require reverse-scoring. |
|
(3) |
Simple |
1 cognitive |
A 15-item maths quiz for high school students. Has a mis-keyed item, but otherwise exhibits good item performance, with very acceptable reliability, and interesting quintile plots. |
|
(4) |
Simple |
1 cognitive |
A set of 13 multiple choice maths items used to test elementary skills back before the advent of calculators. Includes actual test items, and allows for comparing results by four geographic zones. A recommended dataset for beginning Lertap users, and also for students new to item and test analysis topics. |
|
(5) |
Simple |
1 cognitive |
Nursing exam with 60 items, scored on a mastery basis with a score of 70% required in order to pass. Has a faulty student record which should be culled from the Data worksheet. Looks at classification consistency. Includes a breakout of results from different countries. |
|
(6) |
Simple |
1 cognitive |
A 60-item test from a business school, with some students caught cheating. (RSA analysis used to detect who they were. Note that Samples 12 and 13 below also apply RSA.) |
|
(7) |
Medium |
3 cognitive |
50-item English-language test for junior high school students in S.E. Asia country. Of the 50 items, 10 were trial (or "pretest") items. |
|
(8) |
Simple |
2 cognitive |
Difficult university screening test; 25 mathematics and 25 physics questions, with cut-score at 50%. Poor reliability, but adequate to good classification consistency. |
|
(9) |
Medium |
5 cognitive |
A 100-item cognitive test, used to demonstrate how to set up Lertap so that it will calculate split-half reliability figures. |
|
(10) |
Simple |
2 affective |
Trial items developed by a doctoral student to measure a person's perceived ability to change, and to succeed in spite of adversity. Looks at scale reliability; alludes to the relationship between principal components and coefficient alpha. |
|
(11) |
Complex |
6 cognitive |
Involves two forms of a 70-item aptitude test for senior high school students. Each form had a mixture of multiple-choice and constructed-response items. Issues investigated: parallel-forms reliability, correlations among M-C and C-R subtests, and practice effects. |
|
(12) |
Simple |
1 cognitive |
Results from a medical school admissions test with 100 items, many of them using multiple responses. |
|
(13) |
Simple |
1 cognitive |
Test results from a typical university instructor-made test. Has 30 items and 127 student responses. Used to show how Lertap's cheat checker, "RSA" is used, with results compared to those from another "similarity detector". |
|
(14) |
Simple |
1 cognitive |
Very similar to the Uni Class A dataset; an additional example of the application of Lertap "RSA", response similarity analysis. Involves 34 items and 132 students. |
|
(15) |
Complex |
1 cognitive |
Results from the First International Mathematics Study, "FIMS", with data from Japanese and Australian students -- has a mixture of supply (constructed response) and multiple-choice items, and also has two nominal variables for use in group comparisons, gender and country. |
|
(16) |
Simple |
5 affective |
Has data for five five-item personality scales based on work from Berkeley University's Personality Lab. |
|
(17) |
Simple |
1 affective |
Sample data from an application of the Beck Depression Inventory. |
|
(18) |
Simple |
1 cognitive |
Compare the performance of high school girls and boys on a geology test, with an eye for possible "DIF", differential item functioning. |
|
(99) |
Medium |
1 cognitive |
An instrument given at the end of a workshop, with both cognitive and affective items. The cognitive questions covered the workshop's content. The affective questions collected feedback on how participants felt about the workshop. |
Tidbit:
Lertap is controlled by the lines in the CCs worksheet. As you page ahead, you'll see a variety of CCs worksheets, with their corresponding lines of controls for Lertap. The best reference for these controls is the on-line help system. Another reference is the manual; although it is more dated than on-line help, the manual is still a good reference to turn to when you prefer to sit back in your armchair with a cuppa and a good, relaxing, off-line, book to read.