Psychological Assessment

Using experience sampling methods/ecological momentary assessment (ESM/EMA) in clinical assessment and clinical research: Introduction to the special section.
This article introduces the special section on experience sampling methods and ecological momentary assessment in clinical assessment. We review the conceptual basis for experience sampling methods (ESM; Csikszentmihalyi & Larson, 1987) and ecological momentary assessment (EMA; Stone & Shiffman, 1994). Next, we highlight several advantageous features of ESM/EMA as applied to psychological assessment and clinical research. We provide a brief overview of the articles in this special section, each of which focuses on 1 of the following major classes of psychological disorders: mood disorders and mood dysregulation (Ebner-Priemer & Trull, 2009), anxiety disorders (Alpers, 2009), substance use disorders (Shiffman, 2009), and psychosis (Oorschot, Kwapil, Delespaul, & Myin-Germeys, 2009). Finally, we discuss prospects, future challenges, and limitations of ESM/EMA. (PsycINFO Database Record (c) 2009 APA, all rights reserved)
Ecological momentary assessment of mood disorders and mood dysregulation.
In this review, we discuss ecological momentary assessment (EMA) studies on mood disorders and mood dysregulation, illustrating 6 major benefits of the EMA approach to clinical assessment: (a) Real-time assessments increase accuracy and minimize retrospective bias; (b) repeated assessments can reveal dynamic processes; (c) multimodal assessments can integrate psychological, physiological, and behavioral data; (d) setting- or context-specific relationships of symptoms or behaviors can be identified; (e) interactive feedback can be provided in real time; and (f) assessments in real-life situations enhance generalizability. In the context of mood disorders and mood dysregulation, we demonstrate that EMA can address specific research questions better than laboratory or questionnaire studies. However, before clinicians and researchers can fully realize these benefits, sets of standardized e-diary questionnaires and time sampling protocols must be developed that are reliable, valid, and sensitive to change. (PsycINFO Database Record (c) 2009 APA, all rights reserved)
Ambulatory assessment in panic disorder and specific phobia.
Anxiety disorders are among the most prevalent mental disorders. In panic disorder, panic attacks often occur at unpredictable times, making it difficult to study these episodes in the laboratory. In specific phobias, symptoms occur in very circumscribed situations and specific triggers are sometimes difficult to reproduce in the laboratory. Ambulatory assessment, or ecological momentary assessment, can further the understanding of the natural course and scope of symptoms under ecologically valid circumstances. Because bodily symptoms are integral to the diagnosis of anxiety disorders, the objective assessment of physiological responses in the patients’ natural environment is particularly important. On the one hand, research has highlighted intriguing discrepancies between the experience of symptoms and physiology during panic attacks. On the other hand, it has validated symptom reporting during therapeutic exposure to phobic situations. Therefore, ambulatory assessment can yield useful information about the psychopathology of anxiety disorders, and it can be used to monitor change during clinical interventions. (PsycINFO Database Record (c) 2009 APA, all rights reserved)
Ecological momentary assessment (EMA) in studies of substance use.
Ecological momentary assessment (EMA) is particularly suitable for studying substance use, because use is episodic and thought to be related to mood and context. This article reviews EMA methods in substance use research, focusing on tobacco and alcohol use and relapse, where EMA has been most applied. Common EMA designs combine event-based reports of substance use with time-based assessments. Approaches to data organization and analysis have been very diverse, particularly regarding their treatment of time. Compliance with signaled assessments is often high. Compliance with recording of substance use appears good but is harder to validate. Treatment applications of EMA are emerging. EMA captures substance use patterns not measured by questionnaires or retrospective data and holds promise for substance use research. (PsycINFO Database Record (c) 2009 APA, all rights reserved)
Momentary assessment research in psychosis.
There is an expanding interest to study psychosis in the realm of daily life. The study of the person in the context of daily life may provide a powerful addition to more conventional and cross-sectional research strategies in the study of psychosis. This article first discusses the nature of experience sampling research in psychosis and demonstrates the feasibility and validity of studies using the experience sampling method (ESM) in this patient group. Second, the article presents a review of all ESM research in psychosis with a special focus on (a) the phenomenology, (b) the etiology, and (c) psychological models of psychosis. Variability over time and the dynamic interplay with the environment were found to be essential features of the positive symptoms of psychosis, whereas behavioral patterns as well as self-reported affect in daily life reality might be essential when studying negative symptomatology. ESM contributes to a better understanding of the interplay between psychotic experiences and environmental features, such as stress or cannabis exposure. Finally, the study of symptomatic variability may fuel new research into psychological models and treatment of psychosis and the study of the person–environment interplay may foster new Gene × Environment interaction studies. (PsycINFO Database Record (c) 2009 APA, all rights reserved)
Mindful Attention Awareness Scale (MAAS): Psychometric properties of the French translation and exploration of its relations with emotion regulation strategies.
Over the past few years, several questionnaires have been developed to measure mindfulness. The Mindful Attention Awareness Scale (MAAS) was created to specifically capture attention and awareness in daily life (Brown & Ryan, 2003). In this article, we present a French adaptation of the MAAS. In the 1st study, we explored the psychometric properties of this adaptation. In the 2nd study, we investigated its relation to cognitive emotion regulation and depressive symptomatology using path analysis. As in the original version of the MAAS, the French adaptation has a strong 1-factor structure. Moreover, there was a negative relationship between the MAAS and the severity of depressive symptoms, both directly and indirectly. The indirect pathway was mediated by the nonadaptive cognitive emotion regulation strategy of self-blame and the adaptive cognitive emotion regulation strategy of positive reappraisal. In conclusion, this questionnaire represents a valid mindfulness measure for French-speaking clinicians and researchers. (PsycINFO Database Record (c) 2009 APA, all rights reserved)
Sex differences in interpersonal problems: A circumplex analysis.
The structure and magnitude of sex differences in interpersonal problems across several data sets were examined, guided by the interpersonal circumplex model and the structural summary method. Data were self-reported interpersonal difficulties, assessed with the 64-item version of the Inventory of Interpersonal Problems (IIP; L. M. Horowitz, S. E. Rosenberg, B. A. Baer, G. Ureño, & V. S. Villaseñor, 1988). In Study 1, the authors focused on sex differences at the level of specific interpersonal complaints (item level). In Study 2, the authors examined sex differences in octant scores of the IIP circumplex (scale level), in a reanalysis of archival data. The structural summary method was used to identify points of maximum difference between men and women in the interpersonal continuum and to estimate effect sizes. Results from the 2 studies converged in suggesting a dimension of difference involving problems in Hostile-Dominance vs. Friendly-Submission. The magnitude of effect size was consistent with previous reports in the personality literature. These sex differences appeared to be best explained by a one-dimensional model. Findings were generally consistent across 3 different types of samples. (PsycINFO Database Record (c) 2009 APA, all rights reserved)
A multimethod assessment of juvenile psychopathy: Comparing the predictive utility of the PCL:YV, YPI, and NEO PRI.
The current study compares 3 distinct approaches for measuring juvenile psychopathy and their utility for predicting short- and long-term recidivism among a sample of 1,170 serious male juvenile offenders. The assessment approaches compared a clinical interview method (the Psychopathy Checklist: Youth Version [PCL:YV]; Forth, Kosson, & Hare, 2003), a new self-report measure (the Youth Psychopathic Traits Inventory; Andershed, Kerr, Stattin, & Levander, 2002), and a personality-based approach (the NEO Psychopathy Resemblance Index; Lynam & Widiger, 2007). Results indicate a modest overlap between the 3 measures (rs = .26–.36); however, youths were often identified as psychopathic by 1 measure but not by others. Measures were weakly correlated with reoffending during subsequent 6- and 12-month periods. Findings suggest that although such scores may be useful indicators of the need for heightened monitoring in the short term, care should be taken when making predictions about long-term recidivism among adolescents. Moreover, the lack of long-term predictive power for the PCL:YV and the inconsistent psychopathy designations obtained with different measures raise serious questions about the use of such measures as the basis for legal or clinical treatment decisions. (PsycINFO Database Record (c) 2009 APA, all rights reserved)
Assessment of dependency, agreeableness, and their relationship.
Agreeableness is central to the 5-factor model conceptualization of dependency. However, 4 meta-analyses of the relationship of agreeableness with dependency have failed to identify a consistent relationship. It was the hypothesis of the current study that these findings might be due in part to an emphasis on the assessment of adaptive, rather than maladaptive, variants of agreeableness. This hypothesis was tested by using experimentally altered NEO Personality Inventory—Revised (Costa & McCrae, 1992) items that were reversed with respect to their implications for maladaptiveness. The predicted correlations were confirmed with the experimentally altered version with measures of dependent personality disorder, measures of trait dependency (including 2 measures of adaptive dependency), and measures of dependency from alternative dimensional models of personality disorder. The theoretical implications of the findings and suggestions for future research are discussed. (PsycINFO Database Record (c) 2009 APA, all rights reserved)
Development and validation of a measure of interpersonal strengths: The Inventory of Interpersonal Strengths.
An Inventory of Interpersonal Strengths (IIS) was developed and validated in a series of large college student samples. Based on interpersonal theory and associated methods, the IIS was designed to assess positive characteristics representing the full range of interpersonal domains, including those generally thought to have negative qualities (e.g., introversion, coldness, submissiveness). The 8 subscales (octants) of the 64-item IIS demonstrated good circumplex features and reliability. Tests comparing Big 5 interpersonal factors, Inventory of Interpersonal Problems (IIP), Battery of Interpersonal Capabilities (BIC), and other interpersonal measures demonstrated convergent and discriminant validity and shared interpersonal structure. The IIS accounted for significant additional variance in life satisfaction and quality of personal relationships beyond the IIP and the BIC. (PsycINFO Database Record (c) 2009 APA, all rights reserved)
Learning effects in the block design task: A stimulus parameter-based approach.
Learning effects were assessed for the block design (BD) task, on the basis of variation in 2 stimulus parameters: perceptual cohesiveness (PC) and set size uncertainty (U). Thirty-one nonclinical undergraduate students (19 female) each completed 3 designs for each of 4 varied sets of the stimulus parameters (high-PC/high-U, high-PC/low-U, low-PC/high-U, and low-PC/low-U), ordered randomly within a larger set of designs with mixed stimulus characteristics. Regression analyses revealed significant, although modest, learning effects in all conditions. Negative-logarithmic learning slopes (growth factors) were greatest for high-U/high-PC designs and smallest for low-U/low-PC designs. Comparison of these slopes with known Wechsler Adult Intelligence Scale (3rd ed.; D. Wechsler, 1997; and 4th ed.; D. Wechsler, 2008) BD subtest gain scores demonstrated that presenting novel test items matched on stimulus parameters in multiple administrations reduced learning effects compared with the repeated use of the same test items. The results suggest that repeated administration of novel test items of the BD subtest, matched for PC and U, would result in more accurate assessments of changes in examinees’ abilities over time than would the use of the same items. Difficulties inherent in implementing this method are also discussed. (PsycINFO Database Record (c) 2009 APA, all rights reserved)
Using comparison data to differentiate categorical and dimensional data by examining factor score distributions: Resolving the mode problem.
Factor-analytic research is common in the study of constructs and measures in psychological assessment. Latent factors can represent traits as continuous underlying dimensions or as discrete categories. When examining the distributions of estimated scores on latent factors, one would expect unimodal distributions for dimensional data and bimodal or multimodal distributions for categorical data. Unfortunately, identifying modes is subjective, and the operationalization of counting local maxima has not performed very well. Rather than locating and counting modes, the authors propose performing parallel analyses of categorical and dimensional comparison data and calculating an index of the relative fit of these competing structural models. In an extensive Monte Carlo study, the authors replicated prior results for mode counting and found that trimming distributions' tails helped. However, parallel analyses of comparison data achieved much greater accuracy, improved base rate estimation, and afforded consistency checks with other taxometric procedures. Two additional studies apply this approach to empirical data either known to be categorical or presumed to be dimensional. Each study supports this new method for factor-analytic research on the latent structure of constructs and measures in psychological assessment. (PsycINFO Database Record (c) 2009 APA, all rights reserved)
Do smokers know what we're talking about? The construct validity of nicotine dependence questionnaire measures.
Few studies have examined whether nicotine dependence self-report questionnaires can predict specific behaviors and symptoms at specific points in time. The present study used data from a randomized clinical trial (N = 608; M. E. Piper et al., 2007) to assess the construct validity of scales and items from 3 nicotine dependence measures: the Fagerström Test for Nicotine Dependence (T. F. Heatherton, L. T. Kozlowski, R. C. Frecker & K.-O. Fagerström, 1991), the Nicotine Dependence Syndrome Scale (S. Shiffman, A. J. Waters, & M. Hickcox, 2004), and the Wisconsin Inventory of Smoking Dependence Motives (M. E. Piper et al., 2004). Scales from these measures were used to predict participants' reports on real-time measures of withdrawal symptoms and smoking behavior and retrospective self-report questionnaires to assess convergent and discriminative validity. The nicotine dependence measures' scales and items generally predicted the real-time measures of similar constructs, but the percent of variance accounted for was low. The nicotine dependence measures did, however, show evidence of discriminative validity. Thus, this study provides modest support for the construct validity of these nicotine dependence scales. (PsycINFO Database Record (c) 2009 APA, all rights reserved)
Pathological gambling subtypes.
Although pathological gambling (PG) is regarded in the 4th edition of the Diagnostic and Statistical Manual of Mental Disorders (American Psychiatric Association, 1994) as a unitary diagnostic construct, it is likely composed of distinct subtypes. In the current report, the authors used cluster analyses of personality traits with a non-treatment-seeking community sample of gamblers and identified 3 PG subtypes. Gamblers partitioned into a simple PG cluster, characterized by low rates of comorbid psychopathology and trait scores near the normative mean; a hedonic PG cluster, characterized by moderate rates of comorbid psychopathology and a proclivity for excitement seeking and positive affect; and a demoralized PG cluster, characterized by high rates of comorbid psychopathology and a propensity toward negative affect, low positive emotionality, and disinhibition. The findings provide preliminary support for an empirically based typology of gamblers, distinguishable in terms of personality structure, which may reflect different etiologies. (PsycINFO Database Record (c) 2009 APA, all rights reserved)
Measurement of emotion dysregulation in adolescents.
The construct of emotion dysregulation increasingly has been used to explain diverse psychopathologies across the lifespan. The Difficulties in Emotion Regulation Scale (DERS; K. L. Gratz & L. Roemer, 2004) represents the most comprehensive measure of the construct to date and exhibits good reliability and validity in adults; however, the measure has yet to be tested in adolescents. The present study examined the psychometric properties of the DERS in a community sample of 428 adolescents (ages 13–17 years). Exploratory factor analysis supported a 6-factor structure consistent with the 6 DERS subscales. Internal consistencies for the subscales were good to excellent (alphas ranged from .76 to .89). In support of the measure’s construct validity, the DERS exhibited robust correlations with psychological problems reflecting emotion dysregulation, specifically depression, anxiety, suicidal ideation, eating disorders, alcohol use, and drug use. Intercorrelations among the DERS subscales ranged from negligible to high (range: r = .04 to r = .68), and potential problems with discriminant validity were noted. In general, results support the reliability and validity of the DERS as a measure of emotion dysregulation in adolescents. (PsycINFO Database Record (c) 2009 APA, all rights reserved)
Factorial invariance of the Dyadic Adjustment Scale across gender.
The Dyadic Adjustment Scale (DAS; G. B. Spanier, 1976) is the most widely used inventory of relationship satisfaction in the social sciences, yet the question of whether it is measuring the same concept in men and women has never been addressed. In the current study, the authors examined the factor structure of the DAS in a sample of 900 currently married couples who participated in the Minnesota Twin Family Study. Confirmatory factor analysis was applied to a second-order factor solution with Spanier’s four factors (Dyadic Consensus, Dyadic Satisfaction, Dyadic Cohesion, Affectional Expression) loading on one higher order factor (Relationship Adjustment), to test for measurement invariance across gender. The second-order solution was relatively invariant across gender, even when taking into account the nonindependent nature of the data. This suggests that the best conceptualization of the DAS is one of a gender-invariant measure of marital adjustment with four distinct subfactors and that differences between men and women on any of these constructs can be interpreted by both clinicians and researchers as true mean differences rather than measurement bias. (PsycINFO Database Record (c) 2009 APA, all rights reserved)
Assessing posttraumatic stress disorder with or without reference to a single, worst traumatic event: Examining differences in factor structure.
The authors examined the effects of a methodological manipulation on the Posttraumatic Stress Disorder (PTSD) Checklist’s factor structure: specifically, whether respondents were instructed to reference a single worst traumatic event when rating PTSD symptoms. Nonclinical, trauma-exposed participants were randomly assigned to 1 of 2 PTSD assessment conditions: referencing PTSD symptoms to their worst trauma (trauma-specific group, n = 218) or to their overall trauma history in general (trauma-general group, n = 234). A 3rd group of non-trauma-exposed participants (n = 464) rated PTSD symptoms globally from any stressful event. Using confirmatory factor analysis, the authors show that the 4-factor PTSD model proposed by D. W. King, G. A. Leskin, L. A. King, and F. W. Weathers (1998; separating effortful avoidance and emotional numbing) demonstrated the best model fit for trauma-general and non-trauma-exposed participants. The 4-factor PTSD model proposed by L. J. Simms, D. Watson, and B. N. Doebbeling (2002; emphasizing a general dysphoria factor) demonstrated the best model fit for trauma-specific participants. Measurement invariance testing revealed that non-trauma-exposed participants were different from both trauma-exposed groups on factor structure parameters, but trauma groups were not substantially different from each other. (PsycINFO Database Record (c) 2009 APA, all rights reserved)
A multitrait (ADHD–IN, ADHD–HI, ODD toward adults, academic and social competence) by multisource (mothers and fathers) evaluation of the invariance and convergent/discriminant validity of the Child and Adolescent Disruptive Behavior Inventory with Thai adolescents.
Confirmatory factor analysis was used with a multitrait (attention-deficit/hyperactivity disorder—inattention, attention-deficit/hyperactivity disorder—hyperactivity/impulsivity, oppositional defiant disorder toward adults, academic competence, and social competence) by multisource (mothers and fathers) matrix to test the invariance and convergent/discriminant validity of the 5-factor model between mothers’ and fathers’ ratings of Thai adolescents (Year 1: n = 872; Year 2: n = 903; Year 3: n = 700; Year 4: n = 984) with the Child and Adolescent Disruptive Behavior Inventory (G. L. Burns, T. Taylor, & J. Rusby, 2001). The results showed equality of like-item loadings, intercepts, and residuals, as well as like-factor variances, covariances, and means between mothers’ and fathers’ ratings within each of the 4 yearly samples. In addition, the between-parent factor correlations showed convergent and discriminant validity with the within-parent factor correlations, showing discriminant validity for each year as well. These results for Thai adolescents and similar results (G. L. Burns et al., 2008) for mothers’ and fathers’ ratings of Brazilian, Thai, and American children provide broader support for the construct validity of the scale. The confirmatory factor analysis invariance and convergent/discriminant validity procedure with multiple sources is considered to provide a much more sophisticated procedure to evaluate the construct validity of attention-deficit/hyperactivity disorder and oppositional defiant disorder rating scales than a single-source approach. (PsycINFO Database Record (c) 2009 APA, all rights reserved)

Psychological Assessment - Vol 21, Iss 4