Work-related social skills evaluation among schizophrenia patients: Validity and reliability of self-administered scales and role playing [Evaluación de habilidades sociales para el trabajo en pacientes con esquizofrenia: Validez y confiabilidad del autoreporte y la técnica de juego de roles]

Introduction: Only 20 to 30% of psychiatric disorders patients have a full-time competitive job. These figures might dramatically drop to 15% for those with more severe and persistent mental disorders, like schizophrenia, and could be obviously much lower in patients from developing countries. Lack of social competence and social skills necessary in the workplace have been suggested as an individual variable that explain the frequent difficulty in acquiring and maintaining a job among people with schizophrenia. Therefore, social skills' training has been widely used as an effective treatment modality to counteract those deficits. In order to develop cultural sensitive treatments, it is generally accepted that it is necessary to have valid and reliable methods to evaluate this construct in every particular population. Tsang and Pearson (2000) proposed a work-related social skills evaluation specifically designed for people with schizophrenia. This measure is composed of two parts: 1. A self-administered scale that evaluates subjective perception about social competence related to obtaining and maintaining a job. In this instance, patients rate a ten-item scale according to the degree of difficulty they experience in handling the situation. 2. A simple role playing exercise in which an expert evaluates the patient's work-related social skills by the simulation of two situations: participating in a job interview, and requesting one day of leave at short notice from a supervisor. Here, the kinds of behaviour rated include basic social survival skills, basic social skills related to voice quality and nonverbal communication, and overall performance. The expert evaluator uses a five point scale in which 4 indicates a normal performance and 0 a poor one. This kind of evaluation offers advantages compared to general social skills measures that were not designed to evaluate people with persistent and severe mental disorders, and specifically over the ones that consist merely in check lists. The aim of the present study was to translate into Spanish and to evaluate the reliability and validity of Tsang and Pearson's both self-administered scale (SA) and expert evaluation (EE) of work-related social skills among Mexican patients with schizophrenia. Method: A non-random sample of male and female Mexican adults with a confirmed diagnosis of schizophrenia by the Schedules for Clinical Assessment in Neuropsychiatry (SCAN), completed SA and EE evaluations. Additionally, a psychiatrist recorded their global functioning based on the evaluation proposed by American Psychiatric Association (GAF), and all relevant socio-demographic and clinical variables (gender, age, educational level, previous work experience, and type of service required, between ambulatory and hospitalized patients). Fifteen days later, a sub-sample participated in a second evaluation with both work-related social skills measures. Cronbach's alphas were calculated for SA and EE measures to obtain internal consistencies. Pearson's correlations were performed to determine the relationship between these measures and first and fifteen day after applications, to have the data of split-half reliability and short temporally stability, respectively. Then, convergent validity was evaluated with Pearson correlations between GAF scores and both SA and EE work-related social skills measures. Finally, the expected relationship between global functioning and type of mental health service employed (ambulatory service vs. hospitalization) was evaluated comparing both patient groups with independent samples t-Student test. EE and SA scores between these groups were then compared using another t-test. In all cases, predetermined alpha value was 95%. Results: A total of 54 schizophrenia patients was recruited; 64.8% were males (n=35) and 35.2% (n=19) females. Overall mean age was 36.6 ± 9 years old (range = 19-57). Years of formal education mean was 7.6 ± 3.8 (range = 1-17); and 77.8% reported some kind of previous work experience (non-competitive job; n = 42). Practically half of them were attending external consultation services (53.7% ambulatory patients, n = 29) and the rest of them were hospitalized (theoretically with more severe disorders). Reliability data. Cronbach's alphas coefficients were SA=0.69, EE=0.85. A sub-sample of 36 patients completed initial and fifteen day work-related social skills evaluations. Correlations between them were SA=0.66 and EE=0.73, p≤.01. Validity data. For all the sample, high, positive and significant correlations between GAF and EE was obtained (r= 0.71, p≤ .01). No statistical relationship among GAF and AA was observed. EE total scores, but not SA ones, were clinically and statistically higher among outpatients in contrast to those who were hospitalized (12.9 ± 2.5 vs. 10.72 ± 3.4; t=-2.77, gl=52, p=.008). In congruence, outpatients had a better global functioning (59.79 ± 8.5 vs. 52.12 ± 8.5; t=2.97, gl=52, p=.004). Similarly, higher EE scores were obtained by patients with previous job experience (12.76 ± 2.55 vs. 8.91 ± 3.53; t=4.11, gl=51, p≤.0001). No gender differences were observed. Conclusions: Evidence of internal consistency, temporal stability and construct validity of EE format to measure work-related social skills among Mexican patients with schizophrenia were documented. Still, the self-administered scale did not show enough reliability coefficients nor validity indicators. This is congruent with data offered for the original version in English: Expert evaluation Cronbach's alphas were higher than the self-reported ones (.96 vs .80, respectively). However, for both SA and EE evaluations, the original English versions internal consistencies were higher than the Spanish ones evaluated in the present study. This could be explained by years of education and work status disparities among the samples. The expert evaluation by role playing showed a better short-temporal stability than the self-administered scale. Additionally, the EE scores, but not the SA ones, correlated in a high, positive and statistical fashion with the general functioning of the patients, and were higher in ambulatory than in hospitalized patients. Similarly, the original English EE, but not the SA evaluation, demonstrated better validity indicators by comparing people with and without schizophrenia. These data suggest that the evaluation of this construct among Mexican patients with a low educational level has to be performed by an expert using role playing exercises, instead of self-administered scales. Further studies are necessary in order to generalize the use of these measures among other populations