Development of a Self-Reported Communication Competence Questionnaire for Patients with Schizophrenia

Article information

J Korean Acad Psychiatr Ment Health Nurs. 2023;32(4):388-401
Publication date (electronic) : 2023 December 29
doi : https://doi.org/10.12934/jkpmhn.2023.32.4.388
1Professor, Department of Nursing, Wonkwang University, Iksan, Korea
2Associate Professor, College of Nursing, Research Institute of Nursing Science, Jeonbuk National University, Jeonju, Korea
3Assistant Professor, Kunsan College of Nursing, Gunsan, Korea
Corresponding author: Park, Sook Kyoung College of Nursing, Jeonbuk National University, 567 Baekje-daero, Deokjin-gu, Jeonju 54896, Korea. Tel: +82-63-270-4478, Fax: +82-63-270-3127, E-mail: yoursky@jbnu.ac.kr
- This research was supported by the National Research Foundation of Korea (NRF) funded by the Korean government (No.2018R1D1A1B07043235).
Received 2023 October 12; Revised 2023 November 17; Accepted 2023 November 30.

Abstract

Purpose

To develop a self-reported communication competency scale for patients with schizophrenia.

Methods

Twenty-nine preliminary items were selected from 42 candidate items derived from literature review and qualitative interviews using content validity analysis of expert opinions to evaluate 637 patients’ schizophrenia communication competence. Data from 383 individuals were analyzed. Confirmatory factor analysis was conducted using data of 280 individuals. The final dataset included data from 254 participants. Data were subjected to exploratory and confirmatory factor analyses using SPSS and AMOS 24.0.

Results

After evaluating the model fit index for the last 24 items, the following results were obtained: x2=633.95 (p<.001), x2/df (degree of freedom)=2.26, SRMR=0.04, RMSEA=0.06, TLI=0.93, CFI=0.94, NFI=0.96. Therefore, this tool’s suitability was evaluated as acceptable. The final scale comprised 24 items and 3 subscales that could measure basic, interpersonal, and communicative expression of patients with schizophrenia.

Conclusion

A self-reported communication competency scale was developed for patients with schizophrenia. It is expected to help measure the effectiveness of intervention programs to improve communication among patients with schizophrenia.

INTRODUCTION

We communicate with many people daily. It is challenging if we do not communicate with people in our lives. Communication can help us know when, where, and how to speak. It helps us exchange information with others, give value to others, and react internally and externally [1]. In other words, it is the ability to effectively express thoughts and feelings using language, symbols, texts, and media suitable for various situations. It refers to the ability to correctly understand the thoughts and feelings expressed in words and writings of others, listen to and respect opinions of others, and mediate conflicts effectively [2].

However, patients with schizophrenia show cognitive deficits in various areas due to the disease, significantly affecting their communication [3,4]. Schizophrenia is a typical mental illness that occurs mainly in people in their 20s and 30s. It is rarely cured within a short period . About 70% of diagnosed patients become chronic through continuous symptom onset and repeated recurrence [5]. As the disease becomes chronic, negative symptoms such as poor or inconsistent verbal expression, decreased emotional expression, lack of spontaneous conversation, loss of interest in social interaction, inappropriate response to situation, regression, and withdrawal appear [6,7]. For them, inappropriate communication decreases emotional expression. Inappropriate responses that do not fit a situation can cause communication problems [8]. This communication disorder is most commonly experienced by patients with schizophrenia, among other mentally ill patients, leading to social isolation due to chronic difficulties in social interaction and problems in interpersonal relationships [8]. Communication disorders in patients with schizophrenia can directly lead to their difficulties in interpersonal relationships and social adjustment, even if symptoms improve. Communication disorders in patients with schizophrenia is a significant cause of repeated hospitalization [9,10]. Since patients with schizophrenia experience difficulties and conflicts in interpersonal relationships due to communication problems, communication training programs are being implemented to solve these problems.

Tools such as “Marital Communication Measurement,” “Adolescent Empathy Tool,” and “Interpersonal Relations Measuring Tool” can be used to evaluate the effectiveness of a communication training program after simple vocabulary correction and supplementation work [11,12]. However, as communication characteristics between patients with schizophrenia and the general public are very different, it is difficult to use communication measurement tools for ordinary people with only simple vocabulary correction and supplementation. In addition, as it is difficult to measure characteristic deficits in communication of patients with schizophrenia, a communication competency measurement tool for patients with schizophrenia is needed.

Most tools developed to measure communication in patients with schizophrenia have been designed to identify communication problems. In addition, Communication Disturbance Index, a tool that could measure a concept similar to communication, has been developed [13]. However, the tool has low reliability [14] as subjective analysis is possible. In addition, among tools frequently used in clinical practice, it is a general purpose for measuring communication in patients with schizophrenia when the Diagnostic and Statistical Manual of Mental Disorders (DSM -4) is applied using Global Assessment of Functioning (GAF) measures [15]. However, the GAF score is limited in measuring communication because it evaluates various factors such as apathy, communication difficulties, and lack of self-management, which are overall indicators of vocal symptoms with a single score. Thus, it is not being used frequently [16].

One instrument has been developed in Japan to measure communication in patients with schizophrenia [17]. However, its use is challenging as it does not fit the domestic psychiatric environment. In addition, it is not a self-report questionnaire [18]. Furthermore, it is challenging to use tools developed abroad directly in Korea because understanding of items may change due to cultural differences in vocabulary expression when using tools developed abroad. Therefore, it is necessary to objectively evaluate a program’s effectiveness in reducing recurrence of patients with schizophrenia becoming pendent in daily life and develop a systematic tool to understand the communication ability level of patients with schizophrenia. Thus, the objective of this study was to develop a self-reported communication competency scale for patients with schizophrenia to understand the communication ability level of patients with schizophrenia and to assess the effectiveness of an intervention program. Its reliability and validity were then evaluated.

METHODS

1. Research Objective

This methodological study aimed to develop a tool for measuring communication competency of patients with schizophrenia and to verify its reliability and validity.

2. Research Process

1) Tool development process

(1) Components and initial question compositions

① Literature review

This study reviewed domestic and foreign literature to examine the concept of communication and its sub-components. This study focused on interpersonal and nonverbal communication. Based on sub-factors of communication ability derived from literature review and communication characteristics of patients with schizophrenia, this study will develop a tool with three sub-concepts: "general communication ability," "interpersonal communication ability," and "expressive communication ability."

A review of relevant domestic and international literature was conducted to identify communication issues faced by patients with schizophrenia. PubMed, MEDLINE, and CINAHL were searched. Domestic literature was searched at RISS4U, KISS, and the Library of Congress. Keywords were searched by combining different words such as 'schizophrenia and/or communication', 'schizophrenia empathy', 'schizophrenia interpersonal relationship' and 'psychosis communication'. In addition, by studying books on schizophrenia, we were able to identify anatomical and physiological issues associated with the condition as well as communication characteristics of patients with schizophrenia. We also learned about effective approaches for communicating with these patients. Based on this, we constructed semi-structured interview questions that could reflect communication characteristics of patients with schizophrenia (Appendix 1).

② Focus group interview

A focus group interview was conducted to confirm conversation patterns of patients with schizophrenia. Selection criteria for interview participants were the same as those for the preliminary focus group interview participants. There were seven interview participants. For focus group interviews, all contents were used until no new data were obtained. The average age of participants was 52.8 years and the average length of hospitalization was 10.3 years. Focus group interviews were conducted directly by a researcher with ten years of experience as a psychiatric ward chief nurse and 12 years of experience as a professor in charge of psychiatric nursing. The interview was conducted one-on-one after the content of discussion was thoroughly explained and consent was obtained. At the beginning of interviews, two or more individual interviews were conducted to form a rapport with the patient after a specific time. The first interview took approximately 40~70 minutes. Data were transcribed and analyzed immediately after the interview. Missing information was added during the second interview while checking the report.

③ Preliminary tool development

Preliminary questions were completed based on constituent factors derived in the first step. In this study, essential tool items were prepared from 42 meaningful data points from a literature review and focus group interviews with schizophrenia patients. Preliminary questions consisted of three sub-areas: 15 questions on “daily communication ability,” 15 questions on “interpersonal communication ability,” and 12 questions on emotional communication ability. Tool items were evaluated with a 5-point Likert scale. Preliminary questions were completed based on constituent factors derived in the first step. In this study, essential tool items were prepared from 42 meaningful data points from a literature review and focus group interviews with schizophrenia patients. Preliminary questions covered three sub-areas: 15 questions on "daily communication ability," 15 questions on "interpersonal communication ability," and 12 questions on emotional communication ability. These questions were evaluated with a 5-point Likert scale.

(2) Content validity

Content validity of the first set (42 preliminary items) was tested by a panel of three psychiatrists, five professors of nursing, and three mental health nurses with extensive experience in tool development. Opinions were collected regarding any incomprehensible sentences, ambiguous expressions, words that were difficult to interpret, and further questions that needed to be added. Agreement of panel members was estimated using a item-level content validity index (I-CVI) and a scale-level content validity index (S-CVI/Ave). The content validity of an item was determined as suitable for selection if the I-CVI score was ≥0.78 and the S-CVI/Ave score was ≥90 [19]. Eight items were removed, including the following items with I-CVI < 0.80: "When talking to other people, you can start the conversation first"; "I hear a deadpan voice when talking to others"; "I can describe my family's symptoms related to my illness." In addition, a total of 13 items, including 2 items for conversation with family, 2 items for disease management, and 1 item for polite expressions, were deleted based on expert opinion that they were redundant or unsuitable for schizophrenia patients.

2) Tool validation process

(1) Participants

Selection criteria for study participants were as follows: 19 years of age or older, diagnosed with schizophrenia by a mental health professional according to the DSM-5 diagnostic criteria, did not receive a dual diagnosis such as drug or alcohol addiction other than schizophrenia, and had symptoms at the time of data collection. Participants who were judged by their attending physician to be cooperative and capable of answering the survey, as well as those who understood the purpose of this study and agreed to participate, were included. Under the assumption that the number of participants in the tool development study should be at least 100 and 7 to 10 times the number of items required for exploratory factor analysis [20], the total number of participants was determined to be 390, which was 8 times the initial 42 questions, considering a dropout rate of 15%. Data from 383 (98.2%) participants were analyzed, excluding 7 participants who answered survey questions insincerely or left many questions unanswered.

For secondary data collection, the sample size was determined to be 240 participants based on the recommendation that a minimum of 200 participants would be required for confirmatory factor analysis (CFA) [21]. Considering a dropout rate of 15%, a total of 280 people were recruited. Among these, data from 254 (90.7%) people were used in the study, excluding data from 26 individuals who answered survey questions insincerely or had a high number of unanswered questions.

(2) Data collection

Preliminary tools developed in this study were verified by a psychiatric ward, a psychiatric hospital, a psychiatric rehabilitation facility, and day hospital systems of university hospitals located in two provinces that researchers and research assistants could easily access. Data were collected from patients with schizophrenia at 11 locations. Data collection for this study was conducted twice. The first period was from December 1, 2020 to February 28, 2021. The second period was from March 14, 2021 to June 1, 2021.

(3) Ethics statement

For ethical consideration of patients, contents and methods of this study were approved by the institutional research ethics review committee of the researcher's affiliated university hospital and each institution for data collection (IRB NO: **UH 2019-11-006-00). The purpose of this study was explained to the director and permission was obtained from all participants. Patients who used a ward, center, or facility with data collection approved by the attending physician were recruited. Patients who expressed their intention to participate in this study were informed the purpose of this study and that: 1) contents of this research and collected data would be used only for research purposes; and 2) they could withdraw from this study at any time.

(4) Statistical analysis

Data analysis of this study was performed using SPSS/WIN 25.0 and AMOS 26.0 (IBM Corp., Armonk, NY, USA) statistical programs. Participants’ general characteristics were calculated as frequency, percentage, mean, and standard deviation. Content validity of the tool was evaluated using a 4-point Likert scale from the expert group and calculated using the I-CVI. To verify construct validity, EFA was performed first. After confirming whether the collected data was suitable for factor analysis by performing Kaiser-Mayer-Olkin (KMO) and Bartlett sphericity tests, items with an eigenvalue of 1 as the standard were evaluated for items with communalities of 0.40 or more and factor loadings of 0.50 or more. Factors were extracted for (Peters et al. 2019) Confirmative factor analysis was performed to investigate the structure of the sub-region. In the confirmatory factor analysis, validation of model fit was performed using the x2 statistic (p-value), x2, the absolute fitness index for evaluating overall fit/df, Standardized Root Mean Residual [SRMR], and root mean square error of approximation (RMSEA), taking into account simplicity of the model, the primary Tucker-Lewis Index (TLI), Comparative Fit Index (CFI), and Normal Fit Index (NFI), which are relative fit indices to evaluate the fit of a proposed model. Next, a multi-trait/multi-item matrix analysis was conducted to investigate convergent and discriminant validity of questions. To assess reliability, internal consistency reliability was measured using Cronbach’s ⍺ value, the most commonly used method.

RESULTS

1. Participant Characteristics

Regarding general characteristics of participants in this study, primary data collection subjects for exploratory factor analysis had 224 (58.5%) men and 159 (41.5%) women. The most common age was 50~59 years, accounting for 35.2% (n=135). Regarding marital status, 83.8% (n=321) were single (including separated, widowed, and single) and 16.2% (n=62) were married. Regarding educational background, 53.0% (n=203) had graduated from high school. The onset period was 21 years or longer for 49.8% (n=190) subjects. Regarding current residence, inpatients accounted for the most at 52.7% (n=202), followed by rehabilitation centers at 29.8% (n=114) and day hospitals at 17.5% (n=67). Subjects of secondary data collection for confirmatory factor analysis had 173 (68.2 %) men and 81 (31.8%) women. The most common age was 50~59 years, accounting for 37.0% (n=94). Regarding marital status, 69.3% (n=176) were single (including separated, widowed, and single) and 30.7% (n=78) were married. Regarding educational background, 53.9% (n=137) had graduated from high school. The onset period was 21 years or longer for 59.2% (n=145) subjects. Regarding current residence, inpatients accounted for the most at 51.0% (n=125), followed by rehabilitation centers at 32.7% (n=80) and day hospitals at 16.3% (n=40) (Table 1).

General Characteristics of Patients

2. Construct Validity

1) Item analysis

Item analysis was first performed to evaluate items in the tool. As a result of analyzing items, the average score of items was 3.24~3.77. The skewness was -0.72~-0.14 and kurtosis was -1.79~-0.52, showing a normal distribution in all items. No items needed to be deleted. As a result of analyzing corrected item-total correlation coefficient between individual items and all items, the correlation coefficient was 0.50 or higher, confirming the internal consistency of items. Therefore, all 29 items were selected and used for a Communication Competency Questionnaire for patients with Schizophrenia (CCQS) (Table 2).

Item Analysis of Communication Competency Questionnaire for Patients with Schizophrenia

2) Exploratory factor analysis

After checking items' internal consistency and content validity, EFA was calculated to verify construct validity (Table 3). As a result of performing the Kaiser-Meyer-Olkin (KMO) test to determine whether the sample was appropriate for factor analysis, KMO value was 0.962 (reference value 0.50), close to 1. Bartlett’s sphericity test was performed to determine whether the correlation coefficient matrix was suitable for factor analysis. Results showed x2=6,613.02 and p<.001, confirming that the correlation coefficient matrix was ideal for factor analysis. Principal component analysis (PCA) is an effective method for identifying construct validity. Thus, PCA was performed for factor analysis. PCA is a suitable approach for this purpose because it is focused on factor clustering. Varimax orthogonal rotation was used to ensure independence between factors and make the developed tool practical and user-friendly.

Factor Loading from Exploratory Factor Analysis for CCQS

As criteria for determining the number of factors, three factors were extracted by referring to an eigenvalue of 1 or more and the slope of a scree plot. Questions with a commonality of more than 0.30 and an absolute value of the maximum factor loading of more than 0.50 were selected [2]. Items that were repeatedly found to be appropriate for the above conditions by checking commonalities and factor loadings were deleted. Items 10, 16, and 40, which showed a total commonality of .30 or less. Therefore, it was deleted. As a result of re-checking the commonality and factor loading of the 26 items across the 3 sub-factors, no additional items were found to be included.

The cumulative explained variance was 60.74%. Factor loadings ranged from a minimum of 0.52 to a maximum of 0.81, with the 1st factor explaining 23.21% of the variance, the 2nd factor explaining 21.96% of the variance, and the 3rd factor explaining 15.57% of the variance (Table 3).

3) Confirmatory factor analysis

Confirmatory factor analysis was conducted on the three sub-factors identified in the exploratory factor analysis using additional data collected from a sample of 378 participants (Table 4). Standardized regression weight (SRW) was analyzed to test the validity of sub-measurement variables for each factor. For confirmatory factor analysis, SRW was first analyzed to test the validity of sub-measurement variables for each factor. As a result, two questions were deleted as they were found to have SRWs less than 0.5. After deleting the two questions and examining the SRW in detail, the SRW ranged from 0.70 to 0.83 for factor 1, 0.65 to 0.78 for factor 2, and 0.67 to 0.81 for factor 3. In conclusion, the tool developed in this study demonstrated a high level of reliability.

Results of Confirmatory Factor Analysis and Reliability for CCQS-24

CFA model verification was performed based on Goodness-of-Fit Index (GFI), Standard Root Mean square Residual (SRMR), Root Mean Square Error of Approximation (RMSEA), Tucker-Lewis Index (TLI), and Normed Fit Index (NFI). The model fit could be judged to be good if GFI, AGFI, NFI, and TLI are 0.90 or greater and SRMR and RMSEA are 0.05 or less [10]. After evaluating the model fit index for the last 24 items, the following results were obtained: x2=633.95 (p<.001), x2/df (degrees of freedom)=2.26, SRMR=0.04, RMSEA=0.06, TLI=0.93, CFI=0.94, and NFI=0.96 (Table 4).

4) Convergent and discriminant validity of CCQS-24 items

The convergent and discriminant validity of CCQS-24 items were tested using a multi-trait multi-item matrix analysis. Results showed that the correlation coefficient between the 24 items and subscales to which each item belongs spanned from 0.50 to 0.77, with all of them being 0.40 or above, indicating that the item's convergent validity was 100% successful (Table 5). In the item's discriminant validity, the correlation coefficient with other subscales to which each item did not belong ranged from 0.14 to 0.45. No item had a value greater than the correlation coefficient compared to the factor to which each item belonged. At the same time, the discriminant validity of the items was established if there was a difference in the correlation coefficient between each item and its corresponding subscale, as well as the correlation coefficient with other subscales. Furthermore, each subscale's Cronbach’s ⍺ coefficient was higher than correlation coefficients among other subscales. Thus, features of each subscale were distinct. Therefore, the item-discriminant validity success rate was 100% (Table 5).

Multi-Trait Multi-Item Matrix (Correlation Matrix Corrected for Overlap) for Item Convergent and Discriminant Validity

3. Reliability Verification

To evaluate the reliability of the tool, we calculated internal consistency reliability using Cronbach’s ⍺. As a result, Cronbach’s ⍺ value for all 24 questions was 0.96. The change in Cronbach’s ⍺ value when items were removed was 0.93~0.94. Thus, the range of variation was not large. This indicated that the scale had a high level of internal consistency. There were no questions that significantly affected the internal consistency. Cronbach’s ⍺ values of subdomains were 0.93, 0.92, and 0.87 (Table 4).

DISCUSSION

This study aimed to develop a Communication Competency Questionnaire for patients with Schizophrenia (CCQS-24). Finally, an instrument with 3 factors and 24 items was developed. Many intervention programs have been applied to improve communication of patients with schizophrenia in Korea. However, a tool to measure this effect has not been established yet. Therefore, this study is expected to help measure the effectiveness of intervention programs to improve communication of patients with schizophrenia. This study used exploratory and confirmatory factors to verify construct validity. Initially, 42 items were derived. They were first verified for content validity by a group of experts. After excluding duplicate and difficult-to-understand items, 24 items were finally derived through a confirmatory factor analysis and several confirmations. The number of items in the tool for patients with schizophrenia should not be too large considering their short concentration [22]. Therefore, if the current 24 questions could be improved and shortened to 10 to 12 questions in a short version through future studies, its clinical utility will be higher.

After conducting the KMO test before factor analysis, it was determined that the KMO value was appropriate. This indicates that the correlation between variables was well explained by other factors. The contribution of a single factor to the overall variation with practical significance is called cumulative explanatory variance. The cumulative explanatory variance in this study was 60.74%, which was satisfactory. Looking at each factor of this tool, the first factor was named "General Communication Ability." This corresponded with the essential role of communication. It can be seen as the most fundamental communication skill, which is the ability to effectively convey one's message to others and establish connections through conversation. However, schizophrenia patients have problems with this essential communication competency. Thus, their interpersonal relationships are gradually lost [10]. An interpersonal relationship means a person-to-person relationship that gives and receives mutual help. Improving interpersonal relationships is very important for patients with schizophrenia who have a therapeutic goal of interacting with society and living an independent life [10]. Therefore, it is important to have basic communication skills so that measurable interpersonal relationships could be formed. This factor included items of "I can end my conversations with others politely."’ and "When I talk to other people, I can start a conversation first."’

Ten items were selected for the second factor of "Interpersonal Communication Ability." Looking at characteristics of these items, they consisted of inquiries that could assess listening and conversational abilities across different topics. Patients with schizophrenia lack empathy when communicating with others. They do not understand other people's emotions. They cannot adequately express their own emotions, which further reduces their social functioning [12]. Therefore, it is essential to understand other people's emotions and express their own emotions as they aim to maintain stable interpersonal relationships while maintaining an independent life and returning to society [18]. Additionally, negative symptoms can further regress the expression of emotions. Thus, interventions to improve them should be applied. Since items of this sub-factor consisted of contents that could enhance empathy while concentrating on the conversation, it could help evaluate patients’ intervention programs. This factor included items of "When I communicate, I express what I understand verbally by speaking or nodding my head" and "I can actively participate in conversations with other people.”

For the third factor, five items were selected for "Expressive Communication Ability." These items could evaluate listening and communication skills of various subjects. They consisted of inquiries about whether patients could articulate their symptoms and categorize medical personnel (such as nurses and doctors) and family members. This is similar to a study conducted by Takahashi et al. (2006). They found that the communication ability of schizophrenia patients varied depending on the subject. They identified 'interpersonal communication ability' as a sub-factor when developing a tool for patients. In this study, a subfactor was also constructed within the same context.

In other words, schizophrenia is a chronic disease. It is beneficial to have a clear understanding of its symptoms and side effects of drugs in order to determine the appropriate treatment approach and communicate with them effectively. Although side effects of antipsychotic medications manifest in various ways, patients tend not to disclose them. Therefore, it is necessary to educate them on how to communicate their experiences. In addition, intervention programs such as drug education, social skills training, and cognitive behavioral therapy should be implemented in clinical practice to address positive or negative symptoms, such as hallucinations and delusions that might manifest openly [5]. Therefore, it is believed that this tool can be effectively used to evaluate the effectiveness of these intervention programs. In addition, it is believed that this tool can be used for schizophrenia patients. It is distinguished from communication tools used for the general public.

Factor loading in EFA represents the level of correlation between each factor and variable. As all questions in this study had factor loadings ≥0.5, the significance was substantial. Furthermore, for the reliability of the tool developed in this study, Cronbach’s ⍺ values ranged between 0.86 and 0.92 for each factor. The reliability of the tool for the last 24 items of this tool had a Cronbach’s ⍺ of 0.96, indicating very high reliability. Generally, the smaller the number of items, the lower the reliability [2]. However, when this tool was reduced from the initial 42 items to the final 24 items, it showed a high Cronbach’s ⍺. Cronbach’s ⍺ for each of the three factors also showed a value of .80 or more, indicating sufficient reliability. Thus, it was considered as a stable tool. Considering that an ⍺ ≥.60 adequately confirms the reliability of an exploratory study [23], the CCQS-24, which measures the communication skills of patients with schizophrenia, is judged to be appropriate in terms of reliability. Additionally, the CCQS-24 does not contain heterogeneous items. Thus, participants can obtain consistent responses. Questions can also be considered as comprehensive measures. In particular, among sub-factors, interpersonal communication ability is thought to differ between a measured value reported by the patient and a value measured by medical personnel. Therefore, a further study is needed to increase the reliability of the tool by confirming the correlation between the two measures.

The fit of this tool was confirmed through confirmatory factor analysis. Errors for items 1 and 5 exceeded one. Thus, these items were deleted. As a result of evaluating the model fit index for the last 24 items, CFI free from sample characteristics is recommended rather than GFI for model fit [2]. This study showed a CFI of 0.94, which was higher than the CFI standard of 0.90. It satisfied all other conditions. Therefore, the suitability of this tool was evaluated as an acceptable level [20]. Concept reliability for convergent validity is a criterion for assessing concentrated validity. It evaluates whether the indicator properly measures the intended concept [2,20]. Analysis of the convergent and discriminant validity of the CCQS-24 items using multi-trait multi-item matrix analysis revealed 100% convergent and discriminant validity, indicating that items consistently measured construct concepts and that factor independence was preserved. The scale has 24 items evaluated with a 5-point Likert scale ranging from 1 (Strongly disagree) to 5 (Strongly agree).

CONCLUSION

In this study, a communication ability measurement tool was developed for patients with schizophrenia. The reliability and validity of the developed tool were confirmed. Therefore, the tool developed in this study can measure communication abilities of patients with schizophrenia. However, it has the following two limitations. First, due to its self-report nature, there might be discrepancies between results reported by the patient and those assessed by the medical staff. Second, criterion validity was not assessed during the evaluation process for validity. This needs to be confirmed through further research.

Notes

The authors declared no conflicts of interest.

AUTHOR CONTRIBUTIONS

Conceptualization or/and Methodology: Song, EJ & Park, SK

Data curation or/and Analysis: Kwak, YB & Park, SK

Funding acquisition: Song, EJ

Investigation: Kwak, YB & Park, SK

Project administration or/and Supervision: Song, EJ

Resources or/and Software: Park, SK

Validation: Song, EJ & Park, SK

Visualization: Kwak, YB & Park, SK

Writing: original draft or/and review & editing: Song, EJ & Park, SK

References

1. Encyclopedia Britannica. Britannica Online. London, Britannica Company; 2023 Available from: https://www.britannica.com/search?query=communication Accessed Sept. 27, 2023.
2. Song TJ. SPSS/AMOS statistical analysis method. 3rd ed. Paju: Hakjisa; 2019. p. 308-320.
3. Docherty NM, Hall MJ, Gordinier SW, Cutting LP. Conceptual sequencing and disordered speech in schizophrenia. Schizophrenia Bulletin 2000;26(3):723–735. https://doi.org/10.1093/oxfordjournals.schbul.a033489.
4. Grant PM, Beck AT. Evaluation sensitivity as a moderator of communication disorder in schizophrenia. Psychological Medicine 2009;39:1211–1219. https://doi.org/10.1017/S0033291709005479.
5. Stephen HS, Stephen WN, Cleveland GS. Schizophrenia: a review. American Family Physician 2007;75(12):1821–1829.
6. Kim MS, Park SY, Choi JS. Differences in social and clinical characteristics between readmission and dehospitalization in Long-Term Inpatients with Schizophrenia. Korean Journal of Schizophrenia Research 2020;23(1):38–44. https://doi.org/10.16946/kjsr.2020.23.1.38.
7. Jauhar S, Johnstone M, Mckenna PJ. Schizophrenia. Lancet 2022;399(10323):473–486. https://doi.org/10.1016/S0140-6736(21)01730-X.
8. Dugan JE. Second language acquisition and schizophrenia. Second Language Research 2014;30(3):307–321. https://doi.org/10.1177/0267658314525776.
9. Merrill AM, Karcher NR, Cicero DC, Becker TM, Docherty AR, Kerns JG. Evidence that communication impairment in schizophrenia is associated with generalized poor task performance. Psychiatry Research 2017;249:172–179. https://doi.org/10.1016/j.psychres.2016.12.051.
10. Woo JH, Jang JH, Cho JH. Effects of an empowerment program for patients with schizophrenia. Journal of Korean Academy of Psychiatric and Mental Health Nursing 2018;27(2):123–134. https://doi.org/10.12934/jkpmhn.2018.27.2.123.
11. Jung SJ, Oh SJ. The study on the effect of cognitive-behavioral group art therapy program on the self-esteem and empathy of chronic schizophrenic patients. Journal of Arts Psychotherapy 2015;11(2):159–178.
12. Kim JS, Lim YM. The effects of a self-esteem improvement program on self-esteem, depression, and interpersonal relationships in community-dwelling patients with chronic schizophrenia. Journal of Korean Academy of Psychiatric and Mental Health Nursing 2010;19(4):420–428. https://doi.org/10.12934/jkpmhn.2010.19.4.420.
13. Docherty NM, Derosa M, Anderson N. Communication disturbance in schizophrenia and mania. Archives of General Psychiatry 1996;53(4):358–364. https://doi.org/10.1001/archpsyc.1996.01830040094014.
14. Park YH, Han KS. Development and evaluation of a Communication Enhancement Program for people with Chronic Schizophrenia: a quasi-experimental pretest-posttest design study. Applied Nursing Research 2018;42:1. https://doi.org/10.1016/j.apnr.2018.04.007.
15. Park KW, Lee DG, Lee HR, Kim CW, Ryu SH. Functional disabilities evaluated using World Health Organization disability assessment schedule 2.0 in patients with chronic schizophrenia and Its Related Factors. Journal of Korean Neuropsychiatric Association 2019;58(1):47–54. https://doi.org/10.4306/jknpa.2019.58.1.47.
16. Gold LH. DSM-5 and the assessment of functioning: the World Health Organization Disability Assessment Schedule 2.0 (WHO DAS 2.0). Journal of the American Academy of Psychiatry and the Law (Online) 2014;42(2):173–181.
17. Takahashi M, Tanaka K, Miyaoka H. Reliability and validity of communication skills questionnaire (CSQ). Psychiatry and Clinical Neurosciences 2006;60(2):211–218. https://doi.org/10.1111/j.1440-1819.2006.01488.x.
18. Prat G, Casas-Anguera E, Garcia-Franco M, Escandell MJ, Martin JR, Vilamala S, et al. Validation of the communication skills questionnaire (CSQ) in people with schizophrenia. Psychiatry Research 2014;220:646–653. https://doi.org/10.1016/j.psychres.2014.06.036.
19. Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Research in Nursing & Health 2007;30(4):459–467. https://doi.org/10.1002/nur.20199.
20. Wolf EJ, Harrington KM, Clark SL, Miller MW. Sample size requirements for structural equation models: an evaluation of power, bias, and solution propriety. Educational and Psychological Measurement 2013;76(6):913–934. https://doi.org/10.1177/0013164413495237.
21. Hinkin TR. A brief tutorial on the development of measures for use in survey questionnaires. Organizational Research Methods 1998;1(1):104–121. https://doi.org/10.1177/109442819800100106.
22. Park SA, Sung KM. Development of a measurement of stress for hospitalized schizophrenic patient. Journal of Korean Academy of Nursing 2014;44(3):339–49. https://doi.org/10.4040/jkan.2014.44.3.339.
23. Warkins MW. Exploratory factor analysis: a guide to best practice. Journal of Black Psychology 2018;44(3):219–246. https://doi.org/10.1177/0095798418771807.

Appendix

Appendix 1. Interview Questions for Each Sub-factor

Appendix 2. Final Developed Tool (CCQS)

Appendix 3. 조현병 환자의 의사소통 능력 측정도구 문항

Article information Continued

Table 1.

General Characteristics of Patients

Variables Categories EFA
CFA
x2 or t p
n=383 n=254
Gender Man 224 (58.5) 173 (68.2) 0.31 .672
Women 159 (41.5) 81 (31.8)
Age (year) <29 21 (5.5) 16 (6.3) 7.54 .938
30~39 50 (13.1) 34 (13.4)
40~49 113 (29.5) 73 (28.7)
50~59 135 (35.3) 94 (37.0)
>60 64 (16.7) 37 (14.6)
Marital status Single 321 (83.8) 176 (69.3) 18.20 .614
Married 62 (16.2) 78 (30.7)
Educational background <Middle school 83 (21.7) 54 (21.3) 2.41 .654
High school 203 (53.0) 137 (53.9)
≥College 97 (25.3) 63 (24.8)
Period of onset (year) <10 47 (12.2) 60 (24.5) 3.14 .199
11~20 146 (38.1) 40 (16.3)
>21 190 (49.8) 145 (59.2)
Current residence Hospital 202 (52.7) 125 (51.0) 4.88 .268
Rehabilitation center 114 (29.8) 80 (32.7)
Home (day hospital) 67 (17.5) 40 (16.3)

CFA=confirmatory factor analysis; EFA=exploratory factor analysis.

Table 2.

Item Analysis of Communication Competency Questionnaire for Patients with Schizophrenia

Items M±SD Skewness Kurtosis ICT (r)
I can say hello to others first. 3.77±1.29 -0.72 -0.52 0.58
When I talk to other people, I can start a conversation first. 3.49±1.26 -0.35 -0.92 0.68
I can end my conversations with others politely. 3.59±1.26 -0.49 -0.78 0.71
I can communicate opinions to others through hand and foot gestures. 3.42±1.32 -0.35 -0.99 0.60
I can pay attention to what other people are saying. 3.75±1.23 -0.63 -1.64 0.72
I can make eye contact when talking to other people. 3.64±1.24 -0.48 -1.79 0.71
I can detect other people's emotions through facial expressions and body language. 3.45±1.24 -0.32 -0.92 0.68
I can express pleasant feelings to others when pleasant things happen. 3.68±1.23 -0.55 -0.67 0.73
When I communicate, I express my understanding either through words or by nodding my head. 3.40±1.23 -0.29 -0.89 0.56
I can persuade others when I have a different opinion. 3.40±1.23 -0.27 -0.86 0.75
I am good at explaining what I think to others. 3.62±1.20 -0.42 -0.75 0.75
I am good at explaining my feelings to others. 3.60±1.15 -0.41 -0.64 0.79
I can express my thoughts through actions and gestures. 3.50±1.24 -0.36 -0.81 0.72
I am good at explaining my experiences to others. 3.63±1.16 -0.45 -0.68 0.78
I can ask my family for help if I am in a difficult situation. 3.58±1.26 -0.48 -0.97 0.61
I can turn to my doctor for help if I am in a difficult situation. 3.69±1.26 -0.62 -0.67 0.69
I can talk to my family about problems with my treatment. 3.63±1.27 -0.49 -0.83 0.66
I can explain to my doctor about symptoms related to my illness. 3.68±1.27 -0.54 -0.81 0.72
I can explain to the nurse about symptoms related to my illness. 3.60±1.32 -0.49 -0.93 0.74
I can tell my friends so they know who I am. 3.36±1.21 -0.21 -0.83 0.68
I can say that my friends are good listeners to me. 3.40±1.23 -0.19 -0.94 0.68
I share my feelings through conversations with others. 3.55±1.21 -0.32 -0.85 0.75
I talk about things that everyone else is interested in. 3.61±1.16 -0.32 -0.87 0.74
When I talk to other people, I think other people also talk similarly to me. 3.24±1.23 -0.14 -0.87 0.61
Similarly, I express by words or by nodding my head that I understand what the other person is saying. 3.49±1.21 -0.30 -0.82 0.66
I can participate in other people's conversations. 3.59±1.22 -0.45 -0.73 0.67
I care about how others feel when I tell them my opinion. 3.46±1.24 -0.29 -0.92 0.70
I can accurately tell others about my needs. 3.60±1.22 -0.43 -0.79 0.77
I don't find it difficult to talk to my superiors. 3.60±1.20 -0.44 -0.71 0.65

ICT=item-total correlation; M=mean; SD=standard deviation.

Table 3.

Factor Loading from Exploratory Factor Analysis for CCQS

Factors Item Factors
Communality
I II III
Ⅰ. General communication ability I can end my conversations with others politely. 0.74 0.31 0.17 0.56
When I talk to other people, I can start a conversation first. 0.69 0.26 0.25 0.60
I can communicate opinions to others through hand and foot gestures. 0.68 0.30 0.03 0.68
I can say hello to others first. 0.67 0.05 0.33 0.56
I can pay attention to what other people are saying. 0.67 0.29 0.31 0.63
I can make eye contact when talking to other people. 0.67 0.27 0.32 0.62
I can persuade others when I have a difference of opinion. 0.61 0.41 0.28 0.53
I am good at explaining what I think to others. 0.61 0.41 0.30 0.60
I can express pleasant feelings to others when pleasant things happen. 0.59 0.35 0.36 0.62
I am good at explaining my feelings to others. 0.57 0.45 0.38 0.63
I can detect other people's emotions through facial expressions and body language. 0.56 0.41 0.22 0.67
Ⅱ. Interpersonal communication ability When I communicate, I express my understanding either through words or by nodding my head. 0.25 0.76 0.14 0.56
I can participate in other people's conversations. 0.24 0.72 0.21 0.64
When I talk to other people, I think other people also talk similarly to me. 0.18 0.66 0.25 0.63
I say my friends are good listeners to me. 0.31 0.65 0.25 0.71
I care about how others feel when I tell them my opinion. 0.31 0.63 0.30 0.63
I don't find it difficult to talk to my superiors. 0.29 0.62 0.25 0.64
I share my feelings through conversations with others. 0.38 0.60 0.33 0.55
I talk about things that everyone else is interested in. 0.43 0.55 0.34 0.57
I can tell my friends so they know who I am. 0.27 0.54 0.44 0.62
I can express my thoughts through actions and gestures. 0.43 0.51 0.35 0.60
Ⅲ. Expressiveness communication ability I can talk to my family about problems with my treatment. 0.24 0.26 0.77 0.52
I can ask my family for help if I am in a difficult situation. 0.19 0.26 0.73 0.66
I can turn to my doctor for help if I am in a difficult situation. 0.35 0.28 0.66 0.62
I can explain to my doctor about symptoms related to my illness. 0.35 0.36 0.62 0.59
I can explain to the nurse about symptoms related to my illness. 0.34 0.43 0.58 0.53
Eigenvalue 6.03 5.71 4.05
% Variable 23.21 21.96 15.57
Cumulative variance 23.21 45.17 60.74
Kaiser-Meyer-Olkin (KMO)=0.962; Bartlett's test of sphericity x2=6,613.02 (p<.001).

CCQS=communication competency questionnaire for patients with schizophrenia.

Table 4.

Results of Confirmatory Factor Analysis and Reliability for CCQS-24

Subscales (n) n Estimate SRW SE t p Cronbach's ⍺ M±SD (1~5)
Ⅰ. General communication ability (9) 4 1 0.75 - - <.001 0.93 3.58±1.26
2 0.944 0.71 0.067 14.16 <.001
6 0.964 0.73 0.064 14.97 <.001
7 0.991 0.74 0.065 15.33 <.001
11 1.022 0.76 0.064 15.92 <.001
12 1.019 0.81 0.062 16.42 <.001
9 0.990 0.76 0.064 15.38 <.001
13 1.009 0.83 0.060 16.94 <.001
8 0.923 0.70 0.066 14.08 <.001
Ⅱ. Interpersonal communication ability (10) 36 1 0.72 - - <.001 0.92 3.48±1.22
37 1.004 0.72 0.073 13.78 <.001
29 0.923 0.65 0.074 12.47 <.001
26 1.030 0.73 0.073 14.03 <.001
38 1.044 0.73 0.074 14.08 <.001
41 0.943 0.68 0.072 13.09 <.001
27 1.085 0.78 0.072 15.00 <.001
28 1.032 0.78 0.069 14.89 <.001
25 0.992 0.72 0.072 13.72 <.001
14 1.046 0.74 0.074 14.03 <.001
Ⅲ. Expressiveness communication ability (5) 21 1 0.74 - - <.001 0.87 3.64±1.27
18 0.895 0.67 0.070 12.86 <.001
19 0.993 0.74 0.069 14.32 <.001
22 1.077 0.80 0.069 15.50 <.001
23 1.136 0.81 0.072 15.76 <.001
Model fit x2 (p)=633.95 (<.001), x2/dF=2.26, SRMR=.04, RMSER=.06 (.058~.070), TLI=.93, CFI=.94, NFI=.90 0.96 3.57±1.25

CFI=comparative fit index; M=mean; NFI=normal fit index; RMSEA=root mean square error of approximation; SE=standardized error; RMR=standardized root mean residual; SD=standard deviation; SRW=standardized regression weights; TLI=Tucker-Lewis index.

Table 5.

Multi-Trait Multi-Item Matrix (Correlation Matrix Corrected for Overlap) for Item Convergent and Discriminant Validity

Items Factors
2SE
Factors I Factors II Factors III
Items 4 0.74 0.31 0.17 0.130
Items 2 0.69 0.26 0.25 0.134
Items 6 0.67 0.29 0.31 0.128
Items 7 0.67 0.27 0.32 0.130
Items 11 0.61 0.41 0.28 0.128
Items 12 0.61 0.41 0.30 0.124
Items 9 0.59 0.35 0.36 0.128
Items 13 0.57 0.45 0.38 0.120
Items 8 0.56 0.41 0.22 0.132
Items 36 0.25 0.76 0.14 0.131
Items 37 0.24 0.72 0.21 0.146
Items 29 0.18 0.66 0.25 0.148
Items 26 0.31 0.65 0.25 0.146
Items 38 0.31 0.63 0.30 0.144
Items 41 0.29 0.62 0.25 0.144
Items 27 0.38 0.60 0.33 0.138
Items 28 0.43 0.55 0.34 0.144
Items 25 0.27 0.54 0.44 0.148
Items 14 0.43 0.51 0.35 0.121
Items 21 0.24 0.26 0.77 0.140
Items 18 0.19 0.26 0.73 0.138
Items 19 0.35 0.28 0.66 0.138
Items 22 0.35 0.36 0.62 0.144
Items 23 0.34 0.43 0.58 0.130

SE=standard error.

Main topic sub-factor Detailed questions
How do we communicate? General communication ability - Can you say hello to others?
- Can I use honorifics or titles of respect?
- What do you do when there is a difference of opinion?
- Where do you look when talking to others?
Interpersonal communication ability - What do you do when someone else is talking?
- Is it possible to effectively communicate with diverse audiences?
- Do you observe other people's facial expressions?
Expressive communication ability - Can you discern other people's emotions through their facial expressions?
- Can you use appropriate gestures or actions during a conversation?
- Can you describe your problems or symptoms?
- Can you use appropriate gestures when asking for help?
Factors (n) Items
General communication ability (9) I can end my conversations with others politely.
When I talk to other people, I can start a conversation first.
I can pay attention to what other people are saying.
I can make eye contact when talking to other people.
I can persuade others when I have a difference of opinion.
I am good at explaining what I think to others.
I can express pleasant feelings to others when nice things happen.
I am good at explaining my feelings to others.
I can detect other people's emotions through facial expressions and body language.
Interpersonal communication ability (10) When I communicate, I express my understanding either through words or by nodding my head.
I can participate in other people's conversations.
When I talk to other people, I think other people also talk similarly to me.
I say my friends are good listeners to me.
I care about how others feel when I tell them my opinion.
I don't find it difficult to talk to my superiors.
I share my feelings through conversations with others.
I talk about things that everyone else is interested in.
I can tell my friends so they know who I really am.
I can express my thoughts through actions and gestures.
Expressiveness communication ability (5) I can talk to my family about problems with my treatment.
I can ask my family for help if I am in a difficult situation.
I can turn to my doctor for help if I am in a difficult situation.
I can explain to my doctor about symptoms related to my illness.
I can explain to the nurse about symptoms related to my illness.
번호 설문 문항 1 2 3 4 5
1 다른 사람들과 대화할 때 먼저 대화를 시작할 수 있다.
2 다른 사람들이 대화하는 중간에 참여할 수 있다.
3 다른 사람들과 대화를 정중하게 마무리 할 수 있다.
4 다른 사람들과 의견 차이가 있을 때 설득할 수 있다.
5 다른 사람들이 말할 때 집중하여 들을 수 있다.
6 다른 사람들과 대화할 때 눈을 맞추면서 대화할 수 있다.
7 유쾌한 일이 있을 때 다른 사람들에게 유쾌한 감정을 표현할 수 있다.
8 다른 사람들에게 나의 생각을 잘 설명할 수 있다.
9 다른 사람들의 얼굴표정이나 몸짓에서 다른 사람의 감정을 알 수 있다.
10 나는 대화할 때 내가 상대의 말을 잘 알아듣고 있음을 말 또는 고갯짓으로 표현한다.
11 나는 다른 사람들이 대화하고 있는 중간에 참여할 수 있다.
12 나의 친구들은 내가 말을 잘 들어 주는 친구라고 말한다.
13 다른 사람들과 대화할 때 다른 사람들이 나와 비슷한 방식으로 대화한다고 생각한다.
14 나는 다른 많은 사람들이 흥미를 가지는 주제에 대해 대화할 수 있다.
15 다른 사람들에게 나의 의견을 말할 때 다른 사람들의 기분을 살핀다.
16 나의 친구들은 내가 자신들에 대해 관심이 있다는 것을 믿는다.
17 나는 다른 사람들과의 대화를 통하여 나의 느낌을 나눈다.
18 나는 윗사람과 이야기하는 것을 어려워하지 않는다.
19 나는 나의 행동과 몸짓으로 나의 생각을 표현할 수 있다.
20 나는 나의 처치와 관련된 문제가 있을 때 나의 가족에게 말할 수 있다.
21 나는 내가 어려운 상황에 있을 때 가족에게 도움을 요청할 수 있다.
22 나는 내가 어려운 상황에 있을 때 의사에게 도움을 요청할 수 있다.
23 나는 나의 질병과 관련된 증상을 의사에게 설명할 수 있다.
24 나는 나의 질병과 관련된 증상을 간호사에게 설명할 수 있다.

1: 전혀 그렇지 않다 2: 그렇지 않다 3: 보통이다 4: 그렇다 5: 매우 그렇다.