Test Interpretation Rating Scale

Abstract

The Test Interpretation Rating Scale (TIRS) is a historical psychometric instrument developed by Dressel and Matteson in 1950 to evaluate the effectiveness and quality of test interpretation interviews in a counseling context. Its primary focus is on assessing the degree of client participation and the methods employed by the counselor when conveying standardized test results. The scale is structured around several critical dimensions of the interpretation process, including client readiness, clarity of explanation, the counselor’s relational position, and the collaborative development of conclusions and alternatives. The TIRS was instrumental in studying the impact of client-centered approaches versus counselor-dominant methods in educational and vocational guidance.

Keywords

Test Interpretation Rating Scale, TIRS, Test Interpretation, Counseling, Client Participation, Educational Measurement, Counselor Training, Psychometrics, Guidance.

Authors

Paul L. Dressel, Ross W. Matteson

Purpose

The fundamental purpose of the TIRS was to provide a structured, objective method for raters to evaluate the dynamic interaction between a counselor and a client during the feedback session of standardized test results. Developed within the context of the Michigan State College (M.S.C.) Counseling Center, the scale was specifically created to support research—most notably the study by Dressel and Matteson (1950) investigating the effectiveness of increased client involvement in the interpretation process.

The instrument serves as a supervisory and research tool, quantifying the extent to which the counseling session adheres to principles of client-centered facilitation, where the client actively understands and integrates the test data, rather than passively receiving information from the expert counselor.

Construct

The primary psychological construct measured by the TIRS is the quality of the Test Interpretation Process, specifically focusing on the variable of Client Participation. This construct encompasses several sub-dimensions that define an effective, collaborative interpretation session:

• Readiness: The timing and appropriateness of introducing test data based on the client’s expressed interest and emotional state.
• Profile Use: The degree to which visual data (profiles) are shared and discussed jointly by the client and counselor.
• Explanation: The clarity, simplicity, and adequacy of the counselor’s explanation of the test mechanics and results.
• Client Participation: The opportunities provided for the client to express intellectual understanding, emotional reactions, and personal experiences related to the results.
• Counselor’s Position: The relational stance adopted by the counselor regarding the validity and finality of the test results.
• Conclusions and Alternatives: The extent to which the client is permitted or guided to draw their own conclusions and suggest future courses of action, based on the interpreted data.

Validity

As a historical and observational rating scale, formal, modern assessments of construct or criterion validity are limited in the source material. The scale’s validity is primarily rooted in its content validity, as its dimensions directly reflect established best practices and theoretical considerations regarding effective test feedback and guidance counseling prevalent in the mid-20th century, particularly emphasizing person-centered approaches championed by figures like Carl Rogers.

The scale’s structure (using 5-point descriptions ranging from poor/counselor-dominant to excellent/client-led) provides clear operational definitions for behaviors, lending face validity to its use as a measure of optimal counseling technique.

Reliability

Specific statistical reliability indices (such as internal consistency or test-retest reliability) for the TIRS are not explicitly detailed in the original excerpt. However, the rigor of the original 1950 study suggests that reliability focused on inter-rater reliability, ensuring consistency among different observers using the scale to rate the same counseling sessions. The detailed, behaviorally anchored descriptions (1 through 5 for each dimension) are intended to minimize subjective interpretation and enhance the reliability of judgment ratings made by trained raters.

Factor Analysis

While the TIRS dimensions exhibit clear conceptual clustering (e.g., dimensions related to counselor technique versus dimensions related to client integration), no formal factor analysis results are provided in the source documentation. The scale operates as a multi-dimensional, descriptive rating tool, where the eight distinct areas are designed to capture different facets of the test interpretation session rather than collapsing into a single, unified factor.

Instrument

Test Type: Observational Rating Scale (Rater-completed checklist)

Format: Eight dimensions, each rated on a 5-point descriptive scale.

Language Available: English (Original publication language).

Population Group: Counselor-Client dyads in educational or vocational guidance settings.

Age Group: Typically college students or adult clients undergoing standardized testing.

Population Details: Originally used with students at the M.S.C. Counseling Center (Michigan State College).

Test Methodology: Raters observe or review recordings of counseling sessions and assign a numerical rating (1-5) to each of the eight behavioral dimensions based on the descriptions provided. The scores reflect the degree of client-centeredness in the Test Interpretation process.

Keywords

Psychological Assessment, Vocational Guidance, Counseling Interview, Rating Protocol, Dressel and Matteson, Educational and Psychological Measurement, Client-Centered Therapy, Counselor Evaluation.

Authors

Author ORCID Identifier: Not available/Applicable (Historical instrument)

Affiliation Email addresses: Not available/Applicable (Historical instrument)

Correspondence Address: Paul L. Dressel and Ross W. Matteson were affiliated with Michigan State College at the time of publication.

Permissions & Fee and Test Year

The Test Interpretation Rating Scale was first published in 1950 in the journal Educational and Psychological Measurement, a journal published by SAGE Publications. Permissions for contemporary use or adaptation would need to be sought through the copyright holder, SAGE Publications, given the age of the instrument. No fee information for general use is available from the original research documentation.

Reference’s

Dressel, Paul L., & Matteson, Ross W. (1950). The effect of client participation in test interpretation. Educational and Psychological Measurement, 10, 693-706., © 1950 by SAGE Publications.

Items of the Test Interpretation Rating Scale

IMPORTANT: The following scale items must be preserved in their original language and must not be changed in any way.

Readiness

Test data were introduced when:

1. client seemed interested in discussing another matter.
2. client first appeared and without waiting for evidence of readiness.
3. client showed no desire to discuss them or anything else.
4. client requested them, even though not clearly ready.
5. client was interested and ready.

Profile

Profile was:

1. replaced by numerical data.
2. used primarily by the counselor.
3. placed before the client but discussed by the counselor.
4. placed before the client and jointly discussed by client and counselor.
5. placed before the client and the discussion was led by him.

Explanation of the mechanics of the profile was:

1. so technical or otherwise inadequate as to be actually confusing to client.
2. given only in very general terms, i.e., not adequately covered.
3. rather technical but seemingly grasped by client.
4. simple but too detailed or too sketchy.
5. adequate and simple.

Client Participation

The client was:

1. given no chance for expression.
2. provided chance for intellectual expression but no emotional outlet.
3. given little opportunity to develop and clarify emotional elements in his reaction.
4. given occasional opportunity for free self-expression and relation of experiences.
5. skillfully led to express his feelings, hunches, explanations, experiences.

Counselor’s Position

The Counselor:

1. placed himself and the test results in opposition to the client.
2. offered consolation to the point of negating effectiveness of the test results.
3. was placed in a neutral position, since there was no emotional reaction.
4. indicated the validity of test results questioned by client.
5. neither defended nor discounted the test results.

Conclusions

The client was:

1. left without a conclusion.
2. offered a conclusion by the counselor.
3. offered several conclusions by the counselor.
4. pushed to draw his own conclusions.
5. permitted to draw own conclusions after adequate time to absorb and react to details.

Alternatives

The counselor:

1. concurred in a single course of action by default.
2. only hinted at possible alternate courses of action.
3. was placed in a neutral position, since alternate courses had already been considered.
4. suggested alternate courses of action.
5. "led" client to suggest alternate courses of action.

Other Factors

The counselor:

1. insisted on discussing only the test results.
2. offered no additional information, except in answer to direct questions.
3. introduced additional information, but held to tests as focal point.
4. introduced additional information as of equal value with test results.
5. gave emphasis to the “multiplicity of other factors.”