Professional Performance Scale

Abstract

The professional performance Scale is a concise, 5-item psychological instrument designed for the assessment of an employee’s general job performance based exclusively on the judgment of their immediate supervisor (hetero-assessment). Developed and validated in German, this scale demonstrates exceptional internal consistency, with reliability coefficients, including Cronbach’s Alpha, consistently reported above 0.90. The scale is a validated measure suitable for use across various industries and provides strong indications of both content and Predictive Validity, linking managerial appraisal of performance to underlying cognitive abilities like complex problem-solving.

Keywords

Professional performance, Occupational performance, Supervisor appraisal, Hetero-assessment, Job success, Performance appraisal, Berufliche Leistung.

Authors

Prof. Dr. Daniel Danner (and research colleagues).

Purpose

The primary purpose of the scale is to provide a brief yet highly reliable measure of an employee’s general occupational effectiveness from the perspective of their direct supervisor. It is widely employed in organizational and psychological research to establish the predictive power of various assessment tools (e.g., personality inventories or performance tests) against real-world job outcomes. The scale is suitable for written surveys across different companies and industries.

Construct

The scale measures Professional Performance (Berufliche Leistung), which is considered a fundamental criterion for career success. Following the classification framework proposed by Dette, Abele, and Renner (2004), the scale captures ‘success judgments’ derived from ‘external assessment’ (supervisor’s rating) and focuses on the employee’s performance relative to their ‘global career’ trajectory, rather than specific, isolated job tasks. The underlying theoretical assumption is that performance is a stable, measurable attribute of the employee.

Validity

The scale provides comprehensive evidence supporting its validity:

• Content Validity: The final five items were rigorously selected from a pool of 30 items based on extensive literature review and subsequent empirical testing. In a qualitative step, 18 managers rated the final five items as highly suitable for assessing professional performance (M = 4.89 on a 6-point scale).

• Convergent Validity: In the study sample of N=138 professionals, the scale mean correlated positively and significantly with the mean score of the Conscientiousness subscale (r = 0.17, p = .041), aligning with established literature linking this personality trait to job performance.

• Predictive Validity: Further evidence is supported by Danner, Hagemann, Hager, Schankin, and Funke (2011), who demonstrated a significant relationship between the assessment of professional performance using this scale and an employee’s ability to solve complex problems. This finding suggests that the scale captures general performance differences that are temporally stable and consistent across situations, often reflecting underlying cognitive and trait differences.

Reliability

The psychometric evaluation indicates that the scale possesses excellent Reliability. Estimates of internal consistency are very high, suggesting minimal measurement error. The reported reliability coefficients include:

• Cronbach’s Alpha: α = 0.91.

• Split-Half Correlation (Spearman-Brown corrected): r = 0.89.

These values fall within the superior range for psychological assessments, confirming that the 5-item scale provides a highly consistent measurement of the Professional Performance construct.

Factor Analysis

The dimensionality of the scale was thoroughly examined using Linear Structural Equation Modeling (SEM) with the Maximum-Likelihood estimator (Mplus 6.0). Item analysis strongly supports the conclusion that the measured construct is unidimensional.

A parallel measurement model, which assumes equal path coefficients and equal error variances, demonstrated a good model fit: Root Mean Square of Approximation (RMSEA) = 0.05, Comparative Fit Index (CFI) = 0.99, and χ²(13) = 17.72, p = .169. The variance of the latent True-Score variable was σ² = 0.43 (p < .001). Furthermore, the difference between the parallel model and a tau-congeneric measurement model was not statistically significant (Δχ²(8) = 12.35, p = .136), reinforcing the structural integrity and unidimensionality of the scale.

Instrument

Test Type: Hetero-assessment (Supervisor’s Judgment Scale)

Format: Written questionnaire employing a 6-point Likert scale (mixed format).

Language Available: German (deutsch).

Population Group: Working professionals (employees).

Age Group: Adults (average age in main sample M = 43.16 years).

Population Details: The main psychometric sample (N=138) consisted of employees participating in a psychological study, assessed by their respective supervisors. The supervisors themselves came from various companies and industries (e.g., education, public administration, finance, technology, social services).

Test Methodology: Supervisors are instructed to rate the general professional performance of a designated employee. Items 1-3 use an agreement scale (e.g., “strongly disagree” to “strongly agree”), while Items 4-5 use an evaluative scale (e.g., “very poor” to “very good”). The scale mean is used as the overall indicator of Professional Performance.

Keywords

Job performance, Psychometrics, Supervisor rating, Organizational psychology, Assessment center validation, Conscientiousness.

Authors

Author ORCID Identifier: Not provided in source content.

Affiliation Email addresses: [email protected]

Correspondence Address: Prof. Dr. Daniel Danner, Hochschule der Bundesagentur für Arbeit (HdBA), Seckenheimer Landstraße 16, 68163 Mannheim, Germany.

Permissions & Fee and Test Year

The scale is validated (Status of Development: validiert). The primary validation studies and referenced work (Danner et al., 2011) suggest the scale was developed and psychometrically evaluated around 2011. Information regarding specific licensing fees or formal permissions is not provided in the source content, but contact should be directed to the corresponding author.

Reference’s

• Bollen, K. A. (1989). Structural equations with latent variables. New York: Wiley.

• Danner, D., Hagemann, D., Hager, O., Schankin, A., & Funke, J. (2011). Titel nicht angegeben, Studie zur psychologischen Forschung an der Universität Heidelberg.

• Dette, D., Abele, A., & Renner, O. (2004). Dimensionen beruflicher Leistung: Eine Taxonomie.

• Goodman, S. A., & Svyantek, D. J. (1999). Person-organization fit and contextual performance: Do the four C’s fit? Journal of Vocational Behavior, 55(2), 254-275.

• Higgins, G. E., Peterson, J. B., Pihl, R. O., & Lee, K. (2007). The role of the five-factor model of personality in predicting job performance: A meta-analysis.

• Littlepage, G. E., Bragg, D. M., & Rust, J. (1978). The relationship between measures of job satisfaction and performance.

• Rammstedt, B., & John, O. P. (2005). Measuring personality in one minute or less: A 10-item short version of the Big Five Inventory (BFI-10). Journal of Research in Personality, 41(1), 195-207.

• Stemmler, G., Hagemann, D., Amelang, M., & Barttussek, D. (2011). Differentielle Psychologie und Persönlichkeitsforschung. Kohlhammer.

• Steyer, R., & Eid, M. (2001). Messung und Testtheorie. Hogrefe.

• Steyer, R., Schmitt, M., & Eid, M. (1999). Latent state-trait models in psychological assessment. European Journal of Psychological Assessment, 15(3), 229-245.

• Tsui, A. S. (1984). A multiple-constituency approach to performance appraisal: An empirical test. Academy of Management Journal, 27(3), 458-467.

• Wayne, S. J., & Liden, R. C. (1995). The role of affect in the performance appraisal process. Journal of Organizational Behavior, 16(1), 59-68.

Items of the professional performance Scale

IMPORTANT: The following scale items must be preserved in their original language and must not be changed in any way.

• 1. Der Mitarbeiter erreicht vereinbarte bzw. vorgegebene Ziele.

• 2. Der Mitarbeiter verhält sich kompetent bei allen arbeitsbezogenen Aufgaben.

• 3. Der Mitarbeiter erfüllt meine Erwartungen hinsichtlich seiner Funktion und seines Verantwortungsbereichs.

• 4. Wie bewerten Sie die Qualität seiner Arbeit?

• 5. Wie bewerten Sie das Leistungsniveau, das Sie allgemein bei diesem Mitarbeiter beobachten können?