Writing Test Items to Evaluate Higher Order Thinking

Thomas M Haladyna's "Writing Test Items to Evaluate Higher Order Thinking" is an economical book of 264 pages divided into three parts. Part 1 introduces basic concepts and terminology, in a relatively jargon-free and accessible manner. It also presents an overview of testing and cognition, and their relation to evaluating higher-order thinking. It ends with a look at a broad range of questions types, comparing their characteristics and merits (however, some of the capabilities of computer-based testing are omitted).Part 2 is the most significant part of this book. Haladyna examines closely the nature of different testing approaches for different needs. He offers many concrete, practical recommendations and warnings, and numerous examples. In addition, he further develops his typology of different testing needs and assessment types, and the distinction between low-inference and high-inference tests in measuring higher-order mental skills. There is also a chapter on affective tests, with approaches for the testing of motivation, attitude, self-confidence, and other areas of the affective domain.Part 3 introduces approaches to verifying the quality and validity of test items, and to improving existing items. It also includes a more technical chapter on the statistical analysis of test items, and the use of item analysis in examining test items and test results.Haladyna's book is well organized and clearly presented. No particular prior technical knowledge is assumed, and he does not stray into overly technical or abstract discussions of testing rationales or research efforts (although each chapter usefully ends with comprehensive references). The book generally avoids assuming any particular practical implementation, such as a classroom setting or computer-based testing, but some of the methods described will clearly suit some implementations more than others. This is mostly left to the reader to discern. "Writing Test Items to Evaluate Higher Order Thinking" represents a clear and thorough introduction to and integration of testing theory and practice as applied to higher-order evaluation, while maintaining a practical approach that encourages adaptation of the ideas to the reader's and students' particular needs.Recommended for those seeking an introduction to the area of testing (higher-order or not) and techniques for putting theory into practice, and for more experience practitioners looking for useful ideas presented in an approachable yet rigorous way. (...)

I have written several tests without the benefit of proper instruction on test creation. After reading this book, I have identified many areas in which I can improve upon my work. I would recommend this book to any test writer that wants to get more from their existing material, or to the novice. The writer's style is easy to follow, and at points fairly humorous which helps keep the reader attached to the content.