Psychological Assessment

Pitfalls in research on ecological validity of novel executive function tests: A systematic review and a call to action.
The term “ecological validity” (EV) has traditionally referred to test scores’ ability to predict real-world functioning. However, a test’s similarity to real-world tasks is sometimes mistaken for evidence of its ability to predict daily life, sometimes bypassing rigorous validation research. The goal of this systematic review was to examine the type and quality of evidence used to support claims of EV of novel face-valid tests of executive functions (EF). MEDLINE and PsychINFO databases were searched using the following terms: ecologic* AND neuropsychol* AND (executive function* OR executive dysfunction OR executive abilit*). Thirty-two articles that explicitly stated that their results demonstrated EV of a novel face-valid test of EF were identified. Results showed that only 60% of studies based their claims about EV on test scores’ ability to predict functional outcomes, with the remaining 40% relying on other evidence (e.g., correlations with other measures, participant feedback, group differences). Among the studies that did base their conclusions on test scores’ ability to predict outcomes (n = 19), an overwhelming majority relied on behavioral rating scales, utilized small sample sizes and participant-to-variable ratios, and failed to control for covariates and multiple comparisons. Poor scientific rigor was particularly pronounced in studies of “naturalistic” tests. The present systematic review reveals significant conceptual, methodological, and statistical flaws among an overwhelming majority of studies that claim to have found support for the EV of a novel face-valid test of EF. We call upon authors, reviewers, and editors to safeguard the scientific rigor of research in this area. (PsycInfo Database Record (c) 2024 APA, all rights reserved)
Differences in presurgical MMPI-3 scores across trajectories of recovery from spine surgery.
Approximately 30% of patients who undergo spinal surgery for chronic back pain continue to experience significant pain and disability up to 2 months following surgery. Prior studies have identified mental health variables including depression and anxiety as predictors of poorer postsurgical outcomes using screening instruments, but no studies have examined long-term outcomes using the Minnesota Multiphasic Personality Inventory–3 (MMPI-3), a commonly used tool used in presurgical psychological evaluations (PPE). Using group-based trajectory modeling and a sample of 404 spine surgery evaluees, the present study examined the trajectories of changes in disability scores from presurgery through 3, 12, and 24 months postsurgery. We then compared scores on MMPI-3 scales between trajectory groups. We identified three trajectory groups of change in disability over time: a rapid-remitting group (8%), characterized by moderate presurgical disability that rapidly and substantially remitted by 12 and 24 months; a steady-recovering group (68%), characterized by moderate presurgical disability, slower change over time, and mild levels of disability at the 2-year time point; and a persisting disability group (24%), characterized by severe presurgical disability that continued into long-term follow-ups. Participants in the persisting pain group produced higher presurgical scores on somatic/cognitive and internalizing MMPI-3 scales than participants in the rapid-remitting and steady-recovering groups. Our results support the clinical utility of the MMPI-3 in PPEs and highlight the importance of evaluating somatic/cognitive concerns and internalizing dysfunction to identify patients who are likely to have poorer postsurgical outcomes. (PsycInfo Database Record (c) 2024 APA, all rights reserved)
Development and initial validation of the Multifaceted Instrument for Body Image Disturbance (MI-BoD).
Specific facets of body image disturbance have an important role in eating disorder (ED) onset and maintenance yet have been assessed with single items and/or questionnaires predominantly developed in female samples to capture desire for a thinner body. The aim of this multipart study was to develop the multifaceted instrument for body image disturbance (MI-BoD) that will assess body image disturbance across gender and body size. In Study 1, interviews were conducted with 31 ED lived experience experts (45% females) to develop an initial item pool which was then rated for relevance and clarity by 59 international field experts, shortened and refined by the research team, and then rerated by 20 field experts and 91 ED lived experience experts. Of the 477 items developed from interviews, 46 were retained for the initial validation study. In Study 2, the MI-BoD was administered to undergraduate students (N = 937; 84% females), community adolescents (N = 208; 58% females), and individuals with self-reported ED diagnosis (N = 410; 77% females) to assess its preliminary psychometric properties. Exploratory factor analysis revealed six underlying factors, namely, Dissatisfaction, Overvaluation, Preoccupation, Fear of Weight Gain, Body Checking, and Body Exposure. No differential item functioning was detected for most MI-BoD items across gender, weight status, and ED status (symptomatic vs. asymptomatic). Overall, the MI-BoD showed good internal consistency, convergent and divergent validity, concurrent validity, and test–retest reliability. In conclusion, the MI-BoD is a promising tool for assessment of important facets of body image disturbance across gender, body size, and ED symptomatology. (PsycInfo Database Record (c) 2024 APA, all rights reserved)
Factor structure, measurement invariance, and psychometric properties of the Posttraumatic Cognitions Inventory (PTCI) and its brief version (PTCI-9) in Chinese adolescents and adults.
The Posttraumatic Cognitions Inventory (PTCI) is a widely used self-report tool to assess negative posttraumatic cognitions about self, world, and self-blame, but the factor structure remains controversial. Recently, a brief version of the PTCI with nine items (PTCI-9) loading onto three factors has been developed, and an excellent model fit was obtained. In this study, we examined the psychometric properties of the PTCI and PTCI-9 in a large sample of trauma-exposed Chinese adolescents (n = 1,451; mean age = 13.67 years, SD = 1.24) and adults (n = 924; mean age = 39.6 years, SD = 5.43). Confirmatory factor analysis indicated an acceptable model fit for the original PTCI but a better model fit for the PTCI-9. Furthermore, the configural, metric, and scalar invariances of the PTCI-9 were supported across age groups (adolescent and adult), gender (male and female), trauma exposure (direct and indirect), and types of traumatic events (interpersonal and noninterpersonal). The PTCI and PTCI-9 and their subscale scores showed adequate internal consistency reliability in adolescent and adult samples. The PTCI-9 also demonstrated good convergent validity, as demonstrated by statistically significant correlations with PTSD, depression, anxiety, and life satisfaction. Overall, the present study supports the Chinese PTCI and PTCI-9 as valid measures of negative cognitions in both adolescents and adults and makes meaningful comparisons of negative cognitions across gender, trauma exposure, and types of traumatic events. Notably, as a brief and valid tool, the PTCI-9 is suggested to be used in survey and longitudinal studies for adolescents and adults. (PsycInfo Database Record (c) 2024 APA, all rights reserved)
Measurement invariance of the Depressive Symptom Inventory–Suicidality Scale across race, ethnicity, sexual orientation, and plurality of minoritized identities.
Measurement invariance across diverse groups, though crucial for determining the generalizability of a measure, has not yet been tested in many assessments of suicidal thoughts. The present study assessed the measurement invariance and psychometric properties of one such assessment, the Depressive Symptom Inventory–Suicidality Subscale, across multiple identity dimensions in a large data set (n = 1,118) that combined three diverse samples. Findings supported measurement invariance of the scale by race, ethnicity, and sexual orientation when comparing those who were majority-aligning with their minoritized counterparts, as well as good internal consistency and expected convergent validity. The expected one-factor structure fit well for all three of the samples assessed. Overall, the results support measurement invariance and generalizability of the Depressive Symptom Inventory–Suicidality Subscale. Future studies should continue assessing measures of suicidal thoughts and behaviors through testing invariance across identities, especially as it pertains to specific identity subgroups and their intersections. (PsycInfo Database Record (c) 2024 APA, all rights reserved)
Dispositional hope, psychological flexibility, and psychological distress: Psychometric properties of the Personalized Psychological Flexibility Index among Turkish adults.
The present study examined the psychometric properties of the Personalized Psychological Flexibility Index (PPFI) in a Turkish adult community sample, which consisted of 837 people (65% female) aged between 18 and 68 (Mage = 29.93, SD = 13.21). Exploratory factor analysis yielded a three-factor structure corresponding to acceptance, avoidance, and harnessing, in accordance with the original PPFI. Confirmatory factor analysis showed that the three-factor model outperformed the one-factor model and showed a good model fit. The Turkish adaptation of the PPFI and its subscales exhibited high internal consistency, convergent validity with dispositional hope, and distress endurance in expected directions. Notably, the Turkish adaptation of the PPFI also showed excellent divergent validity from indices of negative emotionality. This study has offered additional support for the construct validity of the Turkish adaptation of the PPFI by investigating the relationship between psychological flexibility, dispositional hope, and psychological distress. Psychological flexibility emerged as a mediator between dispositional hope and psychological distress, and potential explanations were discussed. The present study offers evidence of the reliability and validity of the PPFI and its potential applicability in the Turkish adult population. (PsycInfo Database Record (c) 2024 APA, all rights reserved)

Psychological Assessment - Vol 36, Iss 4