Can the Acoustic Analysis of Expressive Prosody Discriminate Schizophrenia?

  1. Martínez-Sánchez, Francisco
  2. Muela Martínez, José Antonio
  3. Cortés Soto, Pedro
  4. García Meilán, Juan José
  5. Vera Ferrándiz, Juan Antonio
  6. Egea Caparrós, Amaro
  7. Pujante Valverde, Isabel María
Zeitschrift:
The Spanish Journal of Psychology

ISSN: 1138-7416

Datum der Publikation: 2015

Ausgabe: 18

Art: Artikel

DOI: 10.1017/SJP.2015.85 DIALNET GOOGLE SCHOLAR lock_openOpen Access editor

Andere Publikationen in: The Spanish Journal of Psychology

Ziele für nachhaltige Entwicklung

Zusammenfassung

Emotional states, attitudes and intentions are often conveyed by modulations in the tone of voice. Impaired recognition of emotions from a tone of voice (receptive prosody) has been described as characteristic symptoms of schizophrenia. However, the ability to express non-verbal information in speech (expressive prosody) has been understudied. This paper describes a useful technique for quantifying the degree of expressive prosody deficits in schizophrenia, using a semi-automatic method, and evaluates this method�s ability to discriminate between patient and control groups. Forty-five medicated patients with a diagnosis of schizophrenia were matched with thirty-five healthy comparison subjects. Production of expressive prosodic speech was analyzed using variation in fundamental frequency (F0) measures on an emotionally neutral reading task. Results revealed that patients with schizophrenia exhibited significantly more pauses (p < .001), were slower (p < .001), and showed less pitch variability in speech (p < .05) and fewer variations in syllable timing (p < .001) than control subjects. These features have been associated with «flat» speech prosody. Signal processing algorithms applied to speech were shown to be capable of discriminating between patients and controls with an accuracy of 93.8%. These speech parameters may have a diagnostic and prognosis value and therefore could be used as a dependent measure in clinical trials.

Bibliographische Referenzen

  • Adolphs R. (2001). The neurobiology of social cognition. Current Opinion in Neurobiology, 11, 231–239. http://dx.doi.org/10.1016/S0959-4388(00)00202-6
  • Allott K. A., Schäfer M. R., Thompson A., Nelson B., Bendall S., Bartholomeusz C. F., … Amminger G. P. (2014). Emotion recognition as a predictor of transition to a psychotic disorder in ultra-high risk participants. Schizophrenia Research, 153, 25–31. http://dx.doi.org/10.1016/j.schres.2014.01.037
  • Alpert M., Kotsaftis A., & Pouget E. R. (1997). At issue: Speech fluency and schizophrenic negative signs. Schizophrenia Bulletin, 23, 171–177.
  • Alpert M., Rosenberg S. D., Pouget E. R., & Shaw R. J. (2000). Prosody and lexical accuracy in flat affect schizophrenia. Psychiatry Research, 97, 107–118. http://dx.doi.org/10.1016/S0165-1781(00)231-6
  • Alpert M., Shaw R. J., Pouget E. R., & Lim K. O. (2002). A comparison of clinical ratings with vocal acoustic measures of flat affect and alogia. Journal of Psychiatry Research, 36, 347–353. http://dx.doi.org/10.1016/S0022-3956(02)00016-X
  • Bech P., Larsen J. K., & Andersen J. (1988). The BPRS: Psychometric Developments. Psychopharmacology Bulletin, 24(1), 117–121.
  • Boersma P., & Weenink D. (2013). Praat: Doing phonetics by computer (5.1.42 version). [Computer software]. Amsterdam, The Netherlands: University of Amsterdam. Retrieved from http://www.praat.org/
  • Brazo P., Beaucousin V., Lecardeur L., Razafimandimby A., Dollfus S. (2014). Social cognition in schizophrenic patients: The effect of semantic content and emotional prosody in the comprehension of emotional discourse. Frontiers in Psychiatry, 5, 120. http://dx.doi.org/10.3389/fpsyt.2014.00120
  • Cantero F. J. (2003). Fonética y didáctica de la pronunciación [Phonetics and Didactics of pronunciation]. In A. Mendoza (Ed.), Didáctica de la Lengua y la Literatura para Primaria [Didactics of the language and literature for elementary]. (pp. 1–24). Madrid, Spain: Pearson.
  • Clemmer E. J. (1980). Psycholinguistic aspects of pauses and temporal patterns in schizophrenic speech. The Journal of Psycholinguistic Research, 9, 161–185. http://dx.doi.org/10.1007/BF01067469
  • Cohen A. S., & Elvevåg B. (2014). Automated computerized analysis of speech in psychiatric disorders. Current Opinion in Psychiatry, 27, 203–209. http://dx.doi.org/10.1097/YCO.0000000000000056
  • Cohen A. S., & Hong S. L. (2011). Understanding constricted affect in schizotypy through computerized prosodic analysis. Journal of Personality Disorders, 25, 478–491. http://dx.doi.org/10.1521/pedi.2011.25.4.478
  • Cohen A. S., Alpert M., Nienow T. M., Dinzeo T. J., & Docherty N. M. (2008). Computerized measurement of negative symptoms in schizophrenia. Journal of Psychiatry Research, 42, 827–836. http://dx.doi.org/10.1016/j.jpsychires.2007.08.008
  • Cohen A. S., Iglesias B., & Minor K. S. (2009). The neurocognitive underpinnings of diminished expressivity in schizotypy: What the voice reveals. Schizophrenia Research, 109, 38–45. http://dx.doi.org/10.1016/j.schres.2009.01.010
  • Cohen A. S., Kim Y., & Najolia G. M. (2013). Psychiatric symptom versus neurocognitive correlates of diminished expressivity in schizophrenia and mood disorders. Schizophrenia Research, 146, 249–253. http://dx.doi.org/10.1016/j.schres.2013.02.002
  • Cohen A. S., McGovern J. E., Dinzeo T. J., & Covington M. A. (2014). Speech deficits in serious mental illness: A cognitive resource issue?. Schizophrenia Research, 160, 173–179. http://dx.doi.org/10.1016/j.schres.2014.10.032
  • Cohen A. S., Mitchell K. R., & Elvevåg B. (2014). What do we really know about blunted vocal affect and alogia? A meta-analysis of objective assessments. Schizophrenia Research, 159, 533–538. http://dx.doi.org/10.1016/j.schres.2014.09.013
  • Couture S. M., Penn D. L., & Roberts D. L. (2006). The functional significance of social cognition in schizophrenia: A review. Schizophrenia Bulletin, 32, S44–S63. http://dx.doi.org/10.1093/schbul/sbl029
  • Dickey C. C., Vu M. A. T., Voglmaier M. M., Niznikiewicz M. A., McCarley R. W., & Panych L. P. (2012). Prosodic abnormalities in schizotypal personality disorder. Schizophrenia Research, 142, 20–30. http://dx.doi.org/10.1016/j.schres.2012.09.006
  • Emmerson L. C., Ben-Zeev D., Granholm E., Tiffany M., Golshan S., & Jeste D. V. (2009). Prevalence and longitudinal stability of negative symptoms in healthy participants. International Journal of Geriatric Psychiatry, 24, 1438–1444. http://dx.doi.org/10.1002/gps.2284
  • First M. B., Spitzer R. L., Gibbon M., & Williams J. B. W (1996). Structured Clinical Interview for DSM-IV Axis I Disorders—Clinician Version (SCID-CV). New York, NY: New York State Psychiatric Institute, Biometrics Research Department.
  • Green M. F., & Horan W. P. (2010). Social cognition in Schizophrenia. Current Directions in Psychological Science, 19, 243–248. http://dx.doi.org/10.1177/0963721410377600
  • Green M. F., Bearden C. E., Cannon T. D., Fiske A. P., Hellemann G. S., Horan W. P., … Nuechterlein K. H (2012). Social cognition in schizophrenia, Part 1: Performance across phases of illness. Schizophrenia Bulletin, 38, 854–864. http://dx.doi.org/10.1093/schbul/sbq171
  • Hoekert M., Kahn R. S., Pijnenborg M., & Aleman A. (2007). Impaired recognition and expression of emotional prosody in schizophrenia: Review and meta-analysis. Schizophrenia Research, 96, 135–145. http://dx.doi.org/10.1016/j.schres.2007.07.023
  • Hooker C., & Park S. (2002). Emotion processing and its relationship to social functioning in schizophrenia patients. Psychiatry Research, 112, 41–50. http://dx.doi.org/10.1016/S0165-1781(02)00177–4
  • Horan W. P., Green M. F., DeGroot M., Fiske A., Hellemann G. S., Kee K., … Nuechterlein K. H. (2012). Social cognition in schizophrenia, Part 2: 12-month stability and prediction of functional outcome in first-episode patients. Schizophrenia Bulletin, 38, 865–872. http://dx.doi.org/10.1093/schbul/sbr001
  • Johns L. C., Roseell S., Frith C., Ahmad F., Hemsley D., Kuipers E., & McGuire P. K. (2001). Verbal self-monitoring and auditory verbal hallucinations in patients with schizophrenia. Psychological Medicine, 31, 705–715. http://dx.doi.org/10.1017/S0033291701003774
  • Johnson-Selfridge M., & Zalewski C. (2001). Moderator variables of executive functioning in schizophrenia: Meta-analytic findings. Schizophrenia Bulletin, 27, 305–316. http://dx.doi.org/10.1093/oxfordjournals.schbul.a006876
  • Kee K. S., Green M. F., Mintz J., & Brekke J. S. (2003). Is emotion processing a predictor of functional outcome in schizophrenia? Schizophrenia Bulletin, 29, 487–497. http://dx.doi.org/10.1093/oxfordjournals.schbul.a007021
  • Kliper R., Vaizman Y., Weinshall D., & Portuguese S. (2010). Evidence for depression and dchizophrenia in speech prosody. Athens, Greece: Proceedings of ISCA Tutorial and Research Workshop on Experimental Linguistics.
  • Kohler C. G., Walker J. B., Martin E. A., Healey K. M., & Moberg P. J. (2010). Facial emotion perception in schizophrenia: A meta-analytic review. Schizophrenia Bulletin, 36, 1009–1019. http://dx.doi.org/10.1093/schbul/sbn192
  • Kring A. M., & Ellis O. (2013). Emotion deficits in people with schizophrenia. Annual Review of Clinical Psychology, 9, 409–433. http://dx.doi.org/10.1146/annurev-clinpsy050212-185538
  • Kring A. M., & Moran E. K. (2008). Emotional response deficits in schizophrenia: Insights from affective science. Schizophrenia Bulletin, 34, 819–834. http://dx.doi.org/10.1093/schbul/sbn071
  • Kucharska-Pietura K., David A. S., Masiak M., & Phillips M. L. (2005). Perception of facial and vocal affect by people with schizophrenia in early and late stages of illness. The British Journal of Psychiatry, 187, 523–528. http://dx.doi.org/10.1192/bjp.187.6.523
  • Kugler B. T., & Caudrey D. J. (1983). Phoneme discrimination in schizophrenia. The British Journal of Psychiatry, 142, 53–59. http://dx.doi.org/10.1192/bjp.142.1.53
  • Lang P. J., Bradley M. M., & Cuthbert B. N. (2005). International affective picture system (IAPS): Affective ratings of pictures and instruction manual. Technical Report A-6. Gainesville, FL: University of Florida.
  • Leentjens A. F. G., Wielaert S. M., Harskamp F. V., & Wilmink F. W. (1998). Disturbances of affective prosody in patients with Schizophrenia; a cross sectional study. The Journal of Neurology, Neurosurgery, & Psychiatry, 64, 375–378. http://dx.doi.org/10.1136/jnnp.64.3.375
  • Lukoff D., Nuechterlein K. H., & Ventura J. (1986). Manual for the Expanded Brief Psychiatric Rating Scale (BPRS). Schizophrenia Bulletin, 12, 594–602.
  • Martínez-Sánchez F., Meilán J. J., Pérez E., Carro J., & Arana J. M. (2012). Patrones prosódicos en sujetos con la Enfermedad de Alzheimer [Prosodic profiles of patients suffering from Alzheimer’s Disease]. Psicothema, 24(1), 16–21.
  • Matsumoto K, Samson G. T., O’Daly O. D., Tracy D. K, Patel A. D., & Shergill S. S. (2006). Impaired prosodic discrimination in patients with schizophrenia. British Journal of Psychiatry, 89, 180–181.
  • Melinder M. R. D., & Barch D. M. (2003). The influence of a working memory load manipulation on language production in schizophrenia. Schizophrenia Bulletin, 29, 473–485. http://dx.doi.org/10.1093/oxfordjournals.schbul.a007020
  • Mertens P. (2004). Le prosogramme: Une transcription semi-automatique de la prosodie [The prosogram: Semi-automatic transcription of prosody]. Cahiers de l'Institut de Linguistique de Louvain, 30, 7–25. http://dx.doi.org/10.2143/CILL.30.1.519212
  • Michelas A., Faget C., Portes C., Lienhart A. S., Boyer L., Lançon C., & Champagne-Lavau M. (2014). Do patients with schizophrenia use prosody to encode contrastive discourse status? Frontiers in Psychology, 5, 755. http://dx.doi.org/10.3389/fpsyg.2014.00755
  • Nicholson I. R., Chapman J. E., & Neufeld R. W. J. (1995). Variability in BPRS definitions of positive and negative symptoms. Schizophrenia Research, 17, 177–185. http://dx.doi.org/10.1016/0920-9964(94)00088-P
  • Pascual S., Solé B., Castillón J. J., Abadía M. J., & Tejedor M. J. (2005). Prosodia afectiva y reconocimiento facial y verbal de la emoción en la esquizofrenia [Expressive prosody and facial and verbal emotional recognition in schizophrenia]. Revista de Psiquiatría de la Facultad de Medicina de Barcelona, 32, 179–183.
  • Patel A. D. (2008). Music, language and the brain. Oxford, UK: Oxford University.
  • Penn D. L., Sanna L. J., & Roberts D. L. (2008). Social perception in schizophrenia: An overview. Schizophrenia Bulletin, 34, 408–411.
  • Peralta V., & Cuesta M. J. (1994). Validación de la escala de los síndromes positivo y negativo (PANSS) en una muestra de esquizofrénicos españoles [Standardization of the Positive and Negative Syndrome Scale (PANSS) in a sample of Spanish schizophrenic patients]. Actas Luso-Españolas de Neurología y Psiquiatría, 22, 171–177.
  • Putnam K. M., & Kring A. M. (2007). Accuracy and intensity of posed emotional expressions in unmedicated schizophrenia patients: Vocal and facial channels. Psychiatry Research 151, 67–76. http://dx.doi.org/10.1016/j.psychres.2006.09.010
  • Shaw R. J., Dong M., Lim K. O., Faustman W. O., Pouget E. R., & Alpert M. (1999). The relationship between affect expression and affect recognition in schizophrenia. Schizophrenia Research, 37, 245–250. http://dx.doi.org/10.1016/S0920-9964(98)00172–8
  • Silver H., Goodman C., Knoll G., Isakov V., & Modai L. (2005). Schizophrenia patients with a history of severe violence differ from nonviolent schizophrenia patients in perception of emotions but not cognitive function. Journal of Clinical Psychiatry, 66, 300–308. http://dx.doi.org/10.4088/JCP.v66n0305
  • Silver H., Shlomo N., Turner T., & Gur R. C. (2002). Perception of happy and sad facial expressions in chronic schizophrenia: Evidence for two evaluative systems. Schizophrenia Research, 55, 171–177. http://dx.doi.org/10.1016/S0920-9964(01)00208–0
  • Trémeau F. A. (2006). Review of emotion deficits in schizophrenia. Dialogues in Clinical Neuroscience, 8, 59–70.
  • Trémeau F., Malaspina D., Duval F., Correa H., HagerBudny M., Coin-Bariou L., … Gorman J. M. (2005). Facial expressiveness in patients with schizophrenia compared to depressed patients and nonpatient comparison subjects. The American Journal of Psychiatry, 162(1), 92–101. http://dx.doi.org/10.1176/appi.ajp.162.1.92