Chess Self-Efficacy Scale (CSS)

Abstract

The Chess Self-efficacy Scale (CSS), developed by Olivo and Barbaranelli in 2023, is a specialized psychometric instrument designed to quantify players’ beliefs in their ability to manage their own functioning and the environmental demands inherent in the game of chess. The scale was initially developed in Italy, utilizing the critical incident technique for content generation, resulting in a 38-item measure. The development included a rigorous examination of the scale’s factor structure, reliability, and validity. The CSS serves as a research tool to investigate how emotional and motivational factors contribute to the achievement of ambitious goals in nonphysical competitive sports.

Keywords

Performance, Emotion, Negative Emotions, Positive Emotions, Problem-Solving, Preparation and Game, Chess, Self-Efficacy, Nonphysical Sports, Exploratory Structural Equation Modeling.

Authors

Olivo, Ilaria; Barbaranelli, Claudio

Purpose

The primary purpose of the Chess Self-efficacy Scale (CSS) is to establish a valid and reliable measure for quantifying self-efficacy specifically within the domain of competitive chess. It aims to quantify players’ beliefs in their ability to manage their internal psychological state and respond effectively to the strategic and environmental demands encountered during training and matches.

Furthermore, the scale is intended to facilitate research into the relationship between crucial psychological constructs—such as emotional regulation and motivation—and the successful achievement of high-level performance and ambitious goals among competitive players in nonphysical sports settings.

Construct

The CSS measures domain-specific Self-Efficacy, defined as a player’s belief in their capacity to execute specific behaviors necessary to produce desired outcomes in competitive chess. This construct is operationalized across a hierarchical structure, encompassing both broad and specific aspects of competitive play.

The confirmed hierarchical model suggests that self-efficacy in chess is composed of several first-order factors (e.g., Problem-Solving, Emotion Management) which contribute to higher-order factors like Performance and General Self-Efficacy. This comprehensive approach allows for a nuanced assessment of a player’s perceived control over various stages of the game, including preparation, execution, and emotional response.

Validity

The validity of the CSS was established through comprehensive psychometric analysis, providing strong evidence for its utility in competitive settings.

Specifically, evidence for Criterion Validity was found by demonstrating the scale’s ability to differentiate significantly between groups of players categorized by their official competitive ratings (a relevant external criterion). Significant differences were observed across player rating groups for two key first-order factors: the Preparation and Game factor, F(2, 319) = 5.304, p < .01 (η² = 0.032), and the Problem-Solving factor, F(2, 319) = 10.321, p < .001 (η² = 0.061). These results confirm that the CSS is sensitive enough to distinguish performance capabilities based on established criteria of chess expertise.

Reliability

The internal consistency of the CSS was rigorously assessed using both Cronbach’s alpha and Omega coefficients for all derived factor scales, indicating adequate to excellent reliability across the board.

The specific reliability coefficients for the factor scales derived from the Confirmatory Factor Analysis (CFA) are detailed below, supporting the internal cohesion and dependability of the measure:

• Preparation and Game Factor Scale: Alpha = .88, Omega = .88

• Problem-Solving Factor Scale: Alpha = .84, Omega = .82

• Negative Emotions Factor Scale: Alpha = .87, Omega = .86

• Positive Emotions Factor Scale: Alpha = .77, Omega = .75

• Performance Factor Scale: Alpha = .89, Omega = .92

• Emotion Factor Scale: Alpha = .85, Omega = .90

• General Self-Efficacy Factor Scale: Alpha = .90, Omega = .95

Factor Analysis

The factor structure of the CSS was established through a sequence of advanced psychometric analyses, including Exploratory Factor Analysis (EFA), Exploratory Structural Equation Modeling (ESEM), and Confirmatory Factor Analysis (CFA).

Initial EFA using parallel analysis identified a four-factor solution which accounted for 34.93% of the total variance. Subsequent ESEM confirmed the fit of this 4-factor structure, demonstrating good fit indices (RMSEA = .046; SRMR = .039), even though the chi-square was statistically significant (χ²(557) = 992, p < .001). Finally, CFA results confirmed the stability of the four first-order factors and provided crucial support for the hypothesized hierarchical structure, including the second- and third-order factorial models of chess self-efficacy.

Instrument

Test Type: Original Inventory/Questionnaire.

Format: The CSS comprises 38 items, each rated on a 5-point Likert-type scale, ranging from 1 (“not confident at all”) to 5 (“completely confident”). The administration method utilized was electronic.

Language Available: English; Italian.

Population Group: Human; Male; Female.

Age Group: Adulthood (18 years & older).

Population Details: The scale was validated using a sample of competitive chess tournament players located in Italy.

Test Methodology: The methodology included comprehensive psychometric evaluation: Test Validity (Criterion Validity), Test Reliability (Internal Consistency), and Factor Analysis (Confirmatory Factor Analysis, Exploratory Factor Analysis, and Structural Equation Modeling).

Keywords

Performance, Emotion, Negative Emotions, Positive Emotions, Problem-Solving, Preparation and Game, Chess, Self-Efficacy, Nonphysical Sports, Exploratory Structural Equation Modeling.

Authors

Olivo, Ilaria

Affiliation: Sapienza University of Roma

Author ORCID Identifier: No data is Available

Barbaranelli, Claudio

Affiliation: Sapienza University of Roma

Affiliation Email addresses: [email protected]

Correspondence Address: Sapienza University of Roma, Department of Psychology, Via dei Marsi 78, Roma, Italy, 00185.

Author ORCID Identifier: No data is Available

Permissions & Fee and Test Year

Permissions: Contact Corresponding Author (Claudio Barbaranelli).

Commercial: No.

Fee: No.

Test Year: 2023.

Reference’s

Olivo, I., & Barbaranelli, C. (2023). Checking your chess! Development and validation of the Chess Self-efficacy Scale in a competitive setting. TPM-Testing, Psychometrics, Methodology in Applied Psychology, 30(3), 303–318. https://doi.org/10.4473/TPM30.3.4

Items of the Chess Self-efficacy Scale (CSS)

IMPORTANT: The following scale items must be preserved in their original language and must not be changed in any way.

The Chess Self-efficacy Scale consists of 38 items. No specific item details are provided in the text beyond the number of items and the general format of a 5-point Likert scale.

Factors and Subscales: The CSS is structured around four major factors and two higher-order subscales:

Factors:

• Preparation and game

• Negative emotions

• Problem-solving

• Positive emotions

Subscales:

• Performance

• Emotion