Validation of the Automatic Thoughts Questionnaire-18 item- Multiple Sclerosis-Arabic (ATQ-18-MS-Ar) among multiple sclerosis patients.
- *Corresponding Author:
- Muaweah Ahmad Alsaleh
PhD, Neuropsychologist, Psychotherapist
Center for Research on Risks and Vulnerabilities
University of Caen Normandy & CHU de Caen, France.
E-mail: [email protected]
Accepted date: October 15, 2016
Objective: Our study has validated the Automatic thoughts Questionnaire among Syrian multiple sclerosis patients. The Automatic Thoughts Questionnaire-18 item-Multiple Sclerosis-Arabic has included both the version of the 8-item Negative Automatic Thoughts Questionnaire and 10 positive items from the Automatic Thoughts Questionnaire-Revised.
Method: A total of 65 Syrian multiple sclerosis patients have been recruited in Damascus Hospital and Ibn Alnafees Hospital for validation of Automatic Thought Questionnaire-18 item-Multiple Sclerosis-Arabic.
Results: The internal consistency reliability (alpha>0.70) and the split-half reliability were very good. Exploratory factor analysis (accounted for 72.28% of total variance) indicated 3 factors for the Automatic Thought Questionnaire-18 item-Multiple Sclerosis-Arabic: negative thought, positive thought (emotional), and positive thought (cognitive). The Negative Automatic Thoughts Questionnaire was positively related to depression, stress and anxiety (p<0.01), and negatively related to self-esteem and life satisfaction (p<0.01). The Positive Automatic Thoughts Questionnaire subscale score was negatively related to depression, stress and anxiety (p<0.05), and positively related to self-esteem and life satisfaction (p<0.01).
Conclusion: This study is the first research that examines the positive and negative cognitions in multiple sclerosis patients and confirms the internal and external validity of the Automatic Thought Questionnaire-18 item-Multiple Sclerosis-Arabic. This study suggested that an examination of both the positive and negative dimensions of thoughts contribute to understanding of the depression in multiple sclerosis. Clinical implications: The validation of a tool (Automatic Thought Questionnaire-18 item-Multiple Sclerosis-Arabic) has three important clinical implications: deposit a valid research instrument in multiple sclerosis. Ability to evaluate two style of thinking, negative and positive and study their role in the initiation, maintenance and treatment of depression in multiple sclerosis patients. Automatic Thought Questionnaire-18 item-Multiple Sclerosis- Arabic minimizes the diagnostic false for evaluate the depression in multiple sclerosis patients. Examination of both the positive and negative dimensions of cognition might contribute to a greater understanding of the psychopathology of depression in multiple sclerosis.
Negative and positive automatic thoughts, Validation, Reliability, Questionnaire, Depression, Multiple sclerosis patients, Cognitive behavioral therapy, Syria.
Depression is frequent and is an important frequent determination of quality of life (QOF), in MS, which impairs cognitive function seriously and can lead to suicide. Depression also damages relationships and can decrease the treatment adherence (as disease modifying treatments). Fortunately, depression is a treatable disorder, but it is inadequately treated when it is well detected because depression is overlooked in neurological clinic which is very busy [1-3]. A challenge faced by the clinician is to determine whether certain symptoms relate to depression or to MS. The most widely cited example is fatigue and, in addition, insomnia, altered appetite and impaired memory and concentration. These symptoms can lead to diagnostic false such as diagnostic false positives. According to Feinstein, for minimize this diagnostic false can be assigned to the presence of cognition such as depressive beliefs [3,4].
According to Ingram et al. “cognition is the way we think about ourselves” . Many theories on the psychopathology have explored the automatic thoughts [5,6]. Many theories have indicated the central role of cognition in the etiology, origin, maintenance and treatment of mental disorders and various psychopathologies including depression but also in the psychological well-being [7-13]. Kendall said: “the examination of both negative and positive cognitions could contribute to a better understanding of the healthpathology relationship” . The Automatic Thoughts Questionnaire (ATQ: ATQ-30)  and Automatic Thoughts Questionnaire-Revised (ATQ-R)  was developed to evaluate negative and non-negative self-statements associated with the depression [16-19]. ATQ have not been validated for patients with multiple sclerosis.
The validation of the ATQ-18-MS-Ar (Automatic Thoughts Questionnaire-18 item- Multiple Sclerosis-Arabic) that includes negative and positive automatic thought items is lacking in Arabic and Syrian communities. Our study has the intention to validate the short 8-items version of the ATQ-N (Negative Automatic Thoughts Questionnaire) and the positive subscale of the ATQ-R (Automatic Thoughts Questionnaire-Revised; 10-items positive) among Syrian MS patients. In addition, the factor validation of the ATQ-18-MS-Ar (Automatic Thought Questionnaire-18 item- Multiple Sclerosis-Arabic) in the Syria sample was examined by the EFA (exploratory factor analysis).
Our cross-sectional study was performed on Syrian MS patients. 65 patients from the Damascus Hospital and Ibn Alnafees Hospital participated in this study. The average age was 35.75 years (SD=12.35). There were 27 (67.5%) females and 13 (32.5 %) males. Participation in this study is completely voluntary and participants' responses are anonymous.
Inclusion and Exclusion Criteria
Male and female patients between 18 and 56 years old were included in the study. All patients were Syrian. We've excluded patients with low educational level who can't read and understand the items. We also have excluded patients with severe neurological incapacity who have cognition difficulties especially in memory and understanding capacity.
Determination of MS Diagnosis
The patients, who are enrolled in the study, have a confirmed diagnosis of MS. Damascus Hospital and Ibn Alnafees Hospital use the reliable Criteria such as the MRI, VEP and CSF analysis, neural impulses exam, a neurological exam is performed and a thorough medical history is obtained prior to diagnosis.
Procedure and Measures
The ATQ, Beck Depression Inventory (BDI-II) [20-22], Satisfaction with Life Scale (SWLS) , Depression Anxiety Stress Scale-21 (DASS-21) [24-26], Rosenberg self-esteem scale (RSES)  were used in this study. Before completing the measures, participants were asked to read instructions about filling in the questionnaire. Then, patients have completed the scales ATQ-18 [8,15]. We have chosen the short 8-items of the ATQ-N because these 8-items have an internal consistency and the validity equivalent to the original ATQ-N (ATQ-30) . We used the eight Arabic items from the English ATQ-30  in this study. For assess positive thoughts (PT), our study also used and added the 10-items positive from the ATQ-R .
The translation process has been implemented to ATQ-10  and ATQ-8  (Annex 1 and 2). The 10-items positive and 8-items negative thoughts have been translated into Arabic using the traditional translation. We have done three original translations. The translation from English into Arabic was conducted by bilingual psychologists. The consensus referred to the synthesis of different translation versions. Then, the unified version had been assessed by three professors in mental health. After back- translating, the new version was commented with native English speaker’s experts. Then, we've carried out the comments. This last version was only one version tested.
On a 5-point scale ranging from 1 (“not at all”) to 5 (“all the time”), each one of the participant was assessed the rate of the frequency of each thought in the past week. For the scores, higher scores will indicate the greater positive and/or negative thoughts.
Before evaluation the psychometric properties of the ATQ-18-MS-Ar, this study used Cronbach’s alpha coefficient and split-half reliability for testing the internal consistency reliability for ATQ-18-MS-Ar. Construct validity, discriminant validity and concurrent validity were estimated by correlating the ATQ-18-MS-Ar score with the BD-II, DASS-21, SWLS and RSES scores. In addition, our study has used the EFA (exploratory factor analysis) to test the factor validation of the ATQ-18-MSAr. Finally, three-steps hierarchical multiple regression analyses have been defined for each of the two dependent variable (depression), while using the same three predictors for gender, positive thinking and negative thinking in this analysis. The statistical analysis was realized using R (programming language) software version. Our study used the level of significance that is p ≤ 0.05.
Our study received authorization from the Damascus Hospital and Ibn Alnafees Hospital, the neurology service. The Ethics and Research Committee of the Damascus Hospitals has accepted this study protocol. The informed consents have been approved from the participants after the study protocol and their objectives have been described. Human ethics committee approval protocol number was 517/ خ-07/2015/10.
All the persons who take part in this study have given the informed consent.
Cronbach’s Alpha (Internal Consistency Reliability)
Reliability of the ATQ-18-MS-Ar was very good. Alpha was 0.87 for the Negative Thoughts (NT) and 0.85 for the Positive Thoughts (PT). Split-half was 0.86 for the NT; 0.90 for the PT; and 0.81 for the ATQ-18-MS-Ar total score.
Our results indicate that the ATQ-18-MS-Ar have high reliability.
Convergent and Divergent Validity
In Table 1, correlations between ATQ-18-MS-Ar and other scales are shown. The NT (negative thought) is negatively related to self-esteem (r=-0.39, p<0.01) and life satisfaction (r=-0.58, p<0.001), and positively related to depression (r=0.55, p<0.001; 0.34, p<0.01), anxiety (r=0.50, p<0.001), and stress (r=0.50, p<0.001). The PT (positive thought) is negatively related to depression (r=-0.32, -0.35, p<0.01), anxiety (r=-0.19, p<0.05) and stress (r=-0.15, p<0.05) and positively related to self-esteem (r=0.36, p<0.01) and life satisfaction (r=0.56, p<0.001). These correlations are consistent with previous results, indicating that the ATQ-18-MS-Ar has very good construct validity (convergent and divergent validity).
Construct validity shows that the ATQ-18-MS-Ar has the ability to measure and evaluate specifically and only the thinking variable (negative thinking and positive thinking).
Criterion Validity: Concurrent Validity
The NT is significantly and positively related to BDI-II, rho=0.57, p<0.001, the DASS-21, rho=0.53, p<0.001. The PT is significantly and negatively related to BDI-II, rho=- 0.35, p<0.05, the DASS-21, rho=-0.28, p<0.05 (Table 2). Finally, the results show highly significant correlations between the ATQ-18-MS-Ar and other depression scales (BDI-II and DASS-21), indicating a good concurrent validity.
It checks whether the questionnaires of PT and NT have the ability to distinguish between the two extremes of the population or different groups using the "t" test. The result of "t" for two average is very significant (PT: t=-12.873, df=12, p<0.00001; NT: t=-6.6789, df=12, p<0.00001). The questionnaire PT has a good ability to discriminate between subjects who have PT, subjects that do not have PT. Similarly to the PT, questionnaire NT show good ability to discriminate subjects who NT, subjects that do not have NT.
To measure the difference on the total scores of the ATQ- 18-MS-Ar (PT and NT) between depressed and nondepressed patients, the BDI-II was used with the cut-off point of 10 to form two groups, which represent nondepressed and depressed patients. The depressed group was composed by 27 subjects (20 females and 7 males).
|PT||NT||BDI-II||D-DASS-21||A- DASS-21||S- DASS-21||RSES||SWLS|
|NT: negative thinking; PT: positive thinking. DASS-21: Depression Anxiety Stress Scales-21. D: Depression. A: Anxiety. S: Stress. BDI-II: Beck Depression Inventory-II. RSES: Rosenberg self-esteem scale. SWLS: Satisfaction with Life Scale.
*p<0.05; **p<0.01; ***p<0.001.
Table 1. Correlation of the ATQ-18-MS-Ar with criterion measurements.
|Criterion variable||Spearman correlation (rho) ATQ-18-MS-Ar|
|NT||p-value||Confidence Interval||PT||p-value||Confidence Interval|
|Depression-BDI-II||0.57||0.0001||0.289 ? 0.755||-0.35||0.02||-0.617 ?
|Depression- DASS-21||0.53||0.0004||0.217 ? 0.767||-0.28||0.05||-0.567 ?
|Note: p <0.001*** ; p<0.01** ; p =0.05*|
Table 2: Spearman correlation
For the BDI-II, differences between these two groups were tested regarding the total score of the ATQ-8 negative and ATQ-10 positive, to see if differences in these scores for depressed and non-depressed groups were found. The ATQ-8 (t=3.9095, p<0.001; M=21.777 vs. M=11.153), and ATQ-10 (t=-3.4738, p<0.001; M=31.444 vs. M=39.769) successfully discriminated depressed from non-depressed subjects. The depressed subjects obtained significantly higher scores in ATQ-8 and fewer score in ATQ-10 than non-depressed.
So, the questionnaire ATQ-18-MS-Ar (PT and NT) is valid within the MS population.
Exploratory Factor Analysis (EFA)
The EFA is realized on the 18 items. The Kaiser-Meyer- Olkin is 0.61 and Bartlett’s test is statistically significant, x2=721.915, p<0.0001, which confirm the appropriateness for realization the EFA on ATQ-18-MS-Ar.
Parallel analysis has given three eigenvalues which are higher than 1 (6.49, 3.63 and 2.87, respectively) and which accounts for 72.28% of the total variance for the ATQ-18-MS-Ar.
According to Table 3, Factor 1 contains 8 items of negative thought; and was appointed “negative thought”. Factor 2 contains 6 items related to the emotional component of positive thought and was appointed “ (emotional-positive thought)”; and Factor 3 contains 4 items pertaining to the cognitive component of positive thought and was appointed “(cognitive-positive thought ).”
|PT and NT items||Factor1:
positive thought (emotional)
positive thought (cognitive)
|Note. EFA=exploratory factor analysis; ATQ=Automatic Thought Questionnaire. Extraction method: Principal axis factoring. Rotation method: VARIMAX with Kaiser normalization q : question.|
Table 3: Results of the EFA of the ATQ-18-MS-Ar.
ATQ-18 as a Predictor of Depression and Depressive Symptomatology
Kendal et al. indicate that adding the score of positive selfstatements to the score of negative automatic thoughts, evidenced increasing predictiveness of depression, supporting that depressive mood is linked not only to the presence of negative automatic thoughts but also to the absence of positive markers .
A hierarchical multiple regression is computed to investigate if addition of the positive items of this questionnaire (ATQ-10 positive items) to the total of the negative items of the ATQ-18-MS-Ar (ATQ-8 negative items), led to a significant increase in the variance accounted for when using a measure of depression (BDI) as a dependent variable.
Results suggested that addition of the score for the positive items to the model led to a significant increase in the ability to predict depression (ATQ-negative (Model 2), R2=0.31, F (36)=5.68, p<0.01; (Model 3), R2=0.33, F (35)=4.265, p<0.01) (Table 4).
Gender and age accounted for 0.9% of variability in the dependent variable (BDI). When negative items of the ATQ-18 were added to the model in Model 2, the model accounted for 31% of the variance and when adding the positive items composing factor 2 and 3, the percentage of variability accounted for went up significantly from 31% to 33%. Thus, by controlling sex and age, results indicate that the ATQ-negative items predict depression and addition of the score for positive items leads to a significant increase in the prediction of depression (BDI).
Table 4: Model Summary of the three-steps hierarchical multiple regression.
The main aim of this study was to study the Arabic version of the ATQ in a sample of 65 MS patients and present its psychometric properties. The overall MS prevalence in Arab countries has been increased in recent years , with a greater need to validate psychological instruments, such as ATQ, which can be useful in clinical practice, especially for substitute conventional measurment of depressive symptoms in MS patients. Furthermore, this instrument had never been studied in MS patients in Syria. In this study, we also explore the link between cognitions evaluated by the ATQ-18-MS-Ar and depressive symptomatology.
This study provided the evidences for the psychometric properties of the ATQ-18-MS-Ar in a sample of MS patients in Damascus, Syria. 18 items were retained for the Syrian ATQ-18-MS-Ar after an item analysis was conducted by combining the ATQ-8 (Automatic Thoughts Questionnaire-8 items Negative) and the ATQRP (Automatic Thoughts Questionnaire-Revised-10 items Positive). The 18-item ATQ-MS-Ar has demonstrated a satisfactory reliability and good validity.
The ATQ-18-MS-Ar shows a good reliability, such as various studies [16,17,19]. These results indicate that ATQ-18-MS-Ar measures the same construct (PT and NT). The validity of the Syrian ATQ-18-MS-Ar has been demonstrated by its good construct validity (convergent and divergent validity).The ATQ-8 items (Factor 1) was negatively related to self-esteem and life satisfaction and positively related to depression, anxiety and stress. Our results are consistent with Burgess, Haaga on ATQ- 30; Netemeyer et al. on ATQ-8 and Alsaleh on ATQ- 18-Fr (Thoughts Questionnaire-18 questions- French) [19,28,30].
Similarly, consistent with Burgess, Haaga in 1994 on ATQ-RP and PATQ, and Alsaleh on ATQ-18-Fr, the ATQ- 10 items (Factors 2 and Factors 3) is positively associated with self-esteem and life satisfaction, and a negatively associated with depression, anxiety and stress. Thus, ATQ- 18-MS-Ar is a reliable and valid instrument for evaluation positive and negative automatic thoughts in a Syrian population, as MS patients [19,30].
Our study is the first to validate the ATQ in a MS patient’s sample. EFA indicates three factors for ATQ-18-MSAr with 72.28% cumulative percentage for explaining variance in this ATQ-18-MS-Ar. It is meaningful and interpretable among Arabic and Syrian communities.
Overall, these results of our study indicate that the ATQ- 18-MS-Ar can be completed by MS patients and has good psychometric characteristics.
Our study was based on the number of participants which is not high, so further researches on the ATQ-18-MS-Ar would be worthwhile. Furthermore, there were difficulties in extending both the number and the age range of the sample because of the bad circumstances due to war. Some of the important data such as EDDS and the course of MS were missed. This is a pilot study, and further studies will be conducted in other MS samples with larger size.
The purpose of the research that we conducted was to present a validated Arabic version of a questionnaire of PT and NT (ATQ-18-MS-Ar) adapted to the MS population.
The evaluation of psychometric properties shows that the transverse properties of PT and NT are reliable. The reliability of the questionnaire is excellent, the majority of the variables used for validity are good, the results of this study suggest that the ATQ-18-MS-Ar is a valid assessment tool and may be useful in assessing patients. The ATQ-18- MS-Ar is a reliable and valid tool for evaluation automatic thought for sick population, as MS patients, because ATQ- 18-MS-Ar has high internal consistency and good validity. Exploratory factor analysis indicates and confirms factor validity for this scale.
In conclusion, this study is the first research that confirms the internal and external validity of the questionnaire and attests to its relevance in Arabic language. The application of ATQ-18-MS-Ar, among MS, showed its quality and usefulness to measure positive and negative thoughts. ATQ-18-MS-Ar appears as a reliable and valid instrument.
- Fragoso YD, Adoni T, Anacleto A, Gama PD, Goncalves MV, et al. Recommendations on diagnosis and treatment of depression in patients with multiple sclerosis. Pract Neurol 2014; 14: 206-209.
- Siegert RJ, Abernethy DA. Depression in multiple sclerosis: A review. J Neurol Neurosurg Psychiatry 2005; 76: 469-475.
- Feinstein A. Multiple sclerosis and depression. Multiple Sclerosis Journal 2011; 11: 1276-1281.
- Alsaleh M. Analyse psychosociale et cognitive de la santé mentale chez les étudiants de première année : Validation du questionnaire des pensées positives et négatives et du questionnaire de la dépression de Beck. Effet des pensées positives et des facteurs psychosociaux. laboratoire du CERReV (EA 3918), Université de Caen Normandie 2016.
- Ingram RE, Kendall PC, Siegle G, Guarino J. Psychometric properties of the positive automatic thoughts questionnaire. Psychological Assessment 1995; 7: 495-507.
- Curwen B, Palmer S, Ruddell P. Brief Cognitive Behaviour Therapy. Sage, London 2000.
- Beck AT. Cognitive therapy and the emotional disorders. The New American Library New York; 1976.
- Hollon SD, Kendall PC. Cognitive self-statements in depression: Development of an automatic thoughts questionnaire. Cognitive Therapy and Research 1980; 4: 383-395.
- Ingram RE, Wisnicki KS. Assessment of positive automatic cognition. Journal of Consulting and Clinical Psychology 1988; 56: 898?902.
- Purdon C. Thought suppression and psychopathology. Behaviour Research and Therapy 1999; 37: 1029-1054.
- Tanaka NAO, Uji M, Hiramura H, Chen ZI, Shikai N, et al. Cognitive patterns and depression: Study of a Japanese university student population. Psychiatry and Clinical Neurosciences 2006; 60: 358-364.
- Kopala-Sibley DC, Santor DA. The mediating role of automatic thoughts in the personality-event-affect relationship. Cognitive Behaviour Therapy 2009; 38: 153-161.
- Beck JS. Cognitive behavioral therapy: Basics and beyond (2nd ed.) Guilford Press, New York 2011.
- Kendall PC. Methodology and cognitive-behavioral assessment. Behavioural and Cognitive Psychotherapy 1983; 11: 285-301.
- Kendall PC, Howard BL, Hays RC. Self-referent speech and psychopathology: The balance of positive and negative thinking. Cognitive Therapy and Research 1989; 13: 583-598.
- Pereira IMD. Portuguese version of the automatic thoughts questionnaire-revised: Study of its psychometric properties and relationship with depressive symptomatology in adolescents. Universidade de Coimbra - UNIV-FAC-AUTOR, Faculdade de Psicologia e de Ciências da Educação 2013.
- Pan JY, Ye S, Ng P. Validation of the Automatic Thoughts Questionnaire (ATQ) Among Mainland Chinese Students in Hong Kong. Journal of Clinical Psychology 2015; 1-11.
- Alsaleh M, Lebreuilly R, Lebreuilly J, Tostain M. Cognitive balance: States-of-Mind model and mental health among french students. Best Practices in Mental Health 2015; 1: 42-53.
- Alsaleh M, Lebreuilly R, Lebreuilly J, Tostain M. The relationship between negative and positive cognition and psychopathological states in aduls aged 18 to 20. Journal de Thérapie Comportementale et Cognitive 2016.
- Beck AT, Steer RA, Brown GK. Manual for BDI-II. Psychological Corporation, San Antorio, TX 1996.
- Whisman MA, Perez JE, Ramel W. Factor structure of the Beck Depression Inventory. Journal of Clinical Psychology 2000; 56: 545-551.
- Whooley MA, Avins LA, Miranda J, Browner WS. Case-finding instruments for depression: Two questions are as good as many. J Gen Intern Med 1997; 12: 439-445.
- Diener E, Robert A, Emmons RJL, Griffin S. The Satisfaction with Life Scale. Journal of Personality Assessment 1985; 49: 71-75.
- Lovibond SH, Lovibond PF. Manual for the Depression anxiety Stress Scales (2nd Ed) Psychology Foundation, Sydney 1995a.
- Loviband PF. Long-term stability of depression, anxiety, and stress syndromes. Journal of Abnormal Psychology 1998; 107: 520-526.
- Taouk M, Lovibond PF, Laube R. Psychometric properties of an Arabic version of the Depression Anxiety Stress Scales (DASS21). Report for New South Wales Transcultural Mental Health Centre, Cumberland Hospital, Sydney 2001.
- Rosenberg M. Society and the adolescent self-image. Wesleyan University Press, Middletown, CT 1989.
- Netemeyer RG, Williamson DA, Burton S, Biswas D, Jindal S, et al. Psychometric properties of shortened versions of the Automatic Thoughts Questionnaire. Educational and Psychological Measurement 2002; 62: 111-129.
- Heydarpour P, Khoshkish S, Abtahi S, Moradi-Laken M, Sahraian, M. Multiple sclerosis epidemiology in Middle East and North Africa: A systematic review and meta- analysis. Neuroepidemiology 2015; 44: 232-244.
- Burgess E, Haaga DA F. The positive automatic thoughts questionnaire (ATQ-P) and the automatic thoughts questionnaire-revised (ATQ-RP): Equivalent measures of positive thinking? Cognitive Therapy and Research 1994; 18: 15-23.