Desenvolvimento e validação de uma Escala de Avaliação de Competências Comunicativas em idade pré-escolar e escolar

Marisa Seabra; Daniela Figueiredo; Pedro Sá Couto; Marisa Lousada

doi:10.21814/rpe.37758

Authors

Marisa Seabra Escola Superior de Saúde, Universidade de Aveiro, Portugal https://orcid.org/0009-0008-7052-2935
Daniela Figueiredo Centro de Investigação em Tecnologias e Serviços e Saúde - CINTESIS.UA@RISE, Escola Superior de Saúde, Universidade de Aveiro, Portugal https://orcid.org/0000-0002-3160-7871
Pedro Sá Couto Centro de Investigação e Desenvolvimento em Matemática e Aplicações, Universidade de Aveiro, Portugal https://orcid.org/0000-0002-5673-8683
Marisa Lousada Centro de Investigação em Tecnologias e Serviços e Saúde - CINTESIS.UA@RISE, Escola Superior de Saúde, Universidade de Aveiro, Portugal https://orcid.org/0000-0003-0326-0257

DOI:

https://doi.org/10.21814/rpe.37758

Keywords:

Assessment, Communication Skills, Validation, Preschool Age, School Age

Abstract

In Portugal, there are several instruments to assess different language domains. Nonetheless, there are few validated instruments specifically to assess the pragmatic domain. The main aim of this study was to develop and validate the Communicative Skills Assessment Scale (EAC) focused on pragmatic skills in children from 4 to 8 years old. This cross-sectional, descriptive-correlational study was divided into three phases: (1) development of the Communicative Skills Assessment Scale; (2) validation of the scale content through a panel of experts and calculation of the Content Validity Index (CVI); (3) data collection from 143 children with typical language development and analysis of internal consistency and test-retest reliability in a subsample of 24 children. The EAC has content validity, demonstrated by the consensus obtained by a panel of experts (CVI = 1.000). The value of internal consistency calculated using Cronbach's alpha was 0.929, indicating high internal consistency. The test-retest reliability analysis showed excellent stability (ICC between 0.943 and 1.000). The main findings show that the EAC has good psychometric characteristics of validity and reliability to be used in the clinical practice of speech and language therapists with children from 4 to 8 years old.

Downloads

Download data is not yet available.

References

Alduais, A., Majorano, M., & Bastianello, T. (2025). Examining pragmatic language development in preschoolers with and without neurodevelopmental disorders: A cross-sectional study. Applied Neuropsychology: Child, 14(1), 29–45. https://doi.org/10.1080/21622965.2023.2224483

Alexandre, N. M. C., & Coluci, M. Z. O. (2011). Validade de conteúdo nos processos de construção e adaptação de instrumentos de medidas. Ciência & Saúde Coletiva, 16(7), 3061–3068. https://doi.org/10.1590/S1413-81232011000800006

Almeida, J., & Rocha, J. (2009). Caracterização do Perfil Pragmático de Crianças em Idade Pré- Escolar e Escolar. In Universidade Fernando Pessoa (Ed.), Cadernos de Comunicação e Linguagem (Vol. 1, pp. 69–86).

American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.).

American Speech-Language-Hearing Association. (n.d.). Social communication benchmarks. https://www.asha.org/practice-portal/clinical-topics/social-communication-disorder/social-communication-benchmarks/

Arundale, R. B. (1999). An alternative model and ideology of communication for an alternative to politeness theory. Pragmatics, 9(1), 119–153. https://doi.org/10.1075/PRAG.9.1.07ARU

Azevedo, C. L. M. (2021). Escala de comunicação para idade escolar (ECIE) – Versão para professores: Um estudo exploratório com alunos com e sem necessidades educativas do 3.º e 4.º anos do ensino básico [Dissertação de mestrado, Universidade do Minho]. RepositóriUM. https://repositorium.sdum.uminho.pt/handle/1822/75451

Binns, A. V., & Cardy, J. O. (2019). Developmental social pragmatic interventions for preschoolers with autism spectrum disorder: A systematic review. Autism and Developmental Language Impairments Linguagem (Vol. 4, pp. 1–18). https://doi.org/10.1177/2396941518824497

Bishop, D. (1998a). Clinical supervision in practice. Macmillan Education UK.

Bishop, D. V. M. (1998b). Development of the Children’s Communication Checklist (CCC): A method for assessing qualitative aspects of communicative impairment in children. Journal of Child Psychology and Psychiatry, 39(6), 879–891. https://doi.org/10.1111/1469-7610.00388

Bishop, D. V. M. (2003). The Children’s Communication Checklist–2 [Measurement instrument]. The Psychological Corporation.

Bishop, D. V. M., & McDonald, D. (2009). Identifying language impairment in children: Combining language test scores with parental report. International Journal of Language & Communication Disorders, 44(5), 600–615. https://doi.org/10.1080/13682820802259662

Bowers, L., Huisingh, R., & LoGiudice, C. (2005). Test of Problem Solving–3: Elementary: A test of reasoning in context [Measurement instrument]. LinguiSystems.

Bowers, L., Huisingh, R., & LoGiudice, C. (2008). Social Language Development Test–Elementary [Measurement instrument]. LinguiSystems.

Bowers, L., Huisingh, R., & LoGiudice, C. (2018). Test of Problem Solving–Elementary, Third Edition: Normative Update [Measurement instrument]. LinguiSystems.

Carrow-Woolfolk, E. (1999). Comprehensive Assessment of Spoken Language (CASL) [Measurement instrument]. American Guidance Service.

Carrow-Woolfolk, E. (2017). Comprehensive Assessment of Spoken Language–Second Edition (CASL-2) [Measurement instrument]. Western Psychological Services.

Carvalho, M. R. M. (2021). Comunicação social e competência social: Um estudo de crianças portuguesas entre os 4 e os 6 anos com e sem perturbação do desenvolvimento da linguagem [Tese de doutoramento, Universidade do Minho]. RepositóriUM. https://repositorium.sdum.uminho.pt/handle/1822/77323

Cummings, L. (2009). Clinical pragmatics. Cambridge University Press.

Cummings, L. (Ed.). (2017). Research in clinical pragmatics. Springer.

Davis, L. L. (1992). Instrument review: Getting the most from a panel of experts. Applied Nursing Research, 5(4), 194–197. https://doi.org/10.1016/S0897-1897(05)80008-4

Dewart, H., & Summers, S. (1995). The Pragmatics Profile of Everyday Communication Skills in Children [Measurement instrument]. NFER-Nelson.

Dias, C. A. (2021). Escala de comunicação para idade escolar (ECIE) – Versão para professores: Um estudo exploratório com alunos com e sem necessidades educativas do 1.º ano do ensino básico [Dissertação de mestrado, Universidade do Minho]. RepositóriUM. https://repositorium.sdum.uminho.pt/handle/1822/74120

Dingemanse, M., Roberts, S. G., Baranova, J., Blythe, J., Drew, P., Floyd, S., Gísladóttir, R. S., Kendrick, K. H., Levinson, S. C., Manrique, E., Rossi, G., & Enfield, N. J. (2015). Universal principles in the repair of communication problems. PLOS ONE, 10(9), Article e0136100. https://doi.org/10.1371/JOURNAL.PONE.0136100

Fortin, M.-F. (2009). Fundamentos e etapas do processo de investigação (N. Salgueiro, Trad.). Lusodidacta.

Fortin, M.-F., & Salgueiro, N. (1999). O processo de investigação: da concepção à realização (1st ed.). Lusodidacta.

George, D., & Mallery, P. (2003). SPSS for Windows, step by step: A simple guide and reference: 11.0 update (4th ed.). Allyn & Bacon.

Gilliam, J. E., & Miller, L. (2006). Pragmatic Language Skills Inventory (PLSI) [Measurement instrument]. PRO-ED.

Guimarães, C., Cruz-Santos, A., & Almeida, L. (2013). Adaptação do inventário parental “Language Use Inventory (LUI)” para crianças entre 18 e 47 meses para o Português Europeu: Estudo Piloto. Audiology – Communication Research, 18(4), 332–338. https://doi.org/10.1590/S2317-64312013000400015

Kimberlin, C. L., & Winterstein, A. G. (2008). Validity and reliability of measurement instruments used in research. American Journal of Health-System Pharmacy, 65(23), 2276–2284. https://doi.org/10.2146/ajhp070364

King, F. (1989). Assessment of pragmatic skills. Child Language Teaching and Therapy, 5(2), 191–201. https://doi.org/10.1177/026565908900500206

Kyriazos, T. A., & Stalikas, A. (2018). Applied psychometrics: The steps of scale development and standardization process. Psychology, 9(11), 2531–2560. https://doi.org/10.4236/psych.2018.911145

Levinson, S. C. (1983). Pragmatics. Cambridge University press.

Levinson, S. C., & Holler, J. (2014). The origin of human multi-modal communication. Philosophical Transactions of the Royal Society B: Biological Sciences, 369(1651), Article 20130302. https://doi.org/10.1098/rstb.2013.0302

Maenner, M. J., Shaw, K. A., Bakian, A. V., Bilder, D. A., Durkin, M. S., Esler, A., Furnier, S. M., Hallas, L., Hall-Lande, J., Hudson, A., Hughes, M. M., Patrick, M., Pierce, K., Poynter, J. N., Salinas, A., Shenouda, J., Vehorn, A., Warren, Z., Constantino, J. N., … Cogswell, M. E. (2023). Prevalence and characteristics of autism spectrum disorder among children aged 8 years — Autism and Developmental Disabilities Monitoring Network, 11 Sites, United States, 2018. MMWR Surveillance Summaries, 70(11), 1–16. https://doi.org/10.15585/MMWR.SS7011A1

Marinho, L. S. T. (2021). Escala de comunicação para a idade pré-escolar (ECIPE) – Versão para educadores: Um estudo exploratório em contextos inclusivos na Região Norte [Dissertação de mestrado, Universidade do Minho]. RepositóriUM. https://repositorium.sdum.uminho.pt/handle/1822/74048

McGregor, K. K. (2020). How we fail children with developmental language disorder. Language, Speech, and Hearing Services in Schools, 51(4), 981–992. https://doi.org/10.1044/2020_LSHSS-20-00003

Newcomer, P. L., & Hammill, D. D. (2009). The Pragmatic Language Observation Scale [Measurement instrument]. Hammill Institute.

Norbury, C. F. (2014). Practitioner review: Social (pragmatic) communication disorder conceptualization, evidence and clinical implications. Journal of Child Psychology and Psychiatry, 55(3), 204–216. https://doi.org/10.1111/jcpp.12154

Norbury, C. F., Gooch, D., Wray, C., Baird, G., Charman, T., Simonoff, E., Vamvakas, G., & Pickles, A. (2016). The impact of nonverbal ability on prevalence and clinical presentation of language disorder: Evidence from a population study. Journal of Child Psychology and Psychiatry, 57(11), 1247–1257. https://doi.org/10.1111/jcpp.12573

O’Neill, D. K. (2007). The Language Use Inventory for Young Children: A parent-report measure of pragmatic language development for 18- to 47-month-old children. Journal of Speech, Language, and Hearing Research, 50(1), 214–228. https://doi.org/10.1044/1092-4388(2007/017)

Parsons, L., Cordier, R., Munro, N., Joosten, A., & Speyer, R. (2017). A systematic review of pragmatic language interventions for children with autism spectrum disorder. PLoS One, 12(4), Article e0172242. https://doi.org/10.1371/journal.pone.0172242

Pereira, T., Ramalho, A. M., Valente, A. R. S., Couto, P. S., & Lousada, M. (2022). The effects of the pragmatic intervention programme in children with autism spectrum disorder and developmental language disorder. Brain Sciences, 12(12), 1640.

Pereira, T., Ramalho, A. M., & Lousada, M. (2024). Current practices of Portuguese speech-language pathologists with preschool-age children with pragmatic impairment: A cross-sectional survey. Journal of Child Language, 52(2), 294–311. https://doi.org/10.1017/S0305000923000764

Phelps-Terasaki, D., & Phelps-Gunn, T. (2007). Test of Pragmatic Language–Second Edition (TOPL-2) [Measurement instrument]. PRO-ED.

Polit, D. F., & Beck, C. T. (2006). The content validity index: Are you sure you know what’s being reported? Critique and recommendations. Research in Nursing & Health, 29(5), 489–497. https://doi.org/10.1002/nur.20147

Prutting, C. A. (1982). Pragmatics as social competence. Journal of Speech and Hearing Disorders, 47(2), 123-134. https://doi.org/10.1044/jshd.4702.123

Rinaldi, S., Caselli, M. C., Cofelice, V., D’Amico, S., De Cagno, A. G., Della Corte, G., Di Martino, M. V., Di Costanzo, B., Levorato, M. C., Penge, R., Rossetto, T., Sansavini, A., Vecchi, S., & Zoccolotti, P. (2021). Efficacy of the treatment of developmental language disorder: A systematic review. Brain Sciences, 11(3), Article 407. https://doi.org/10.3390/brainsci11030407

Shipley, K. G., & McAfee, J. G. (2016). Assessment in speech-language pathology: A resource manual (5th ed.). Plural Publishing.

Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86(2), 420–428. https://doi.org/10.1037/0033-2909.86.2.420

Shulman, B. B. (1986). Test of Pragmatic Skills–Revised [Measurement instrument]. Communication Skill Builders.

Sim-Sim, I. (1998). Desenvolvimento da linguagem. Universidade Aberta.

Sim-Sim, I. (2017). Aquisição da linguagem: Um olhar retrospetivo sobre o percurso do conhecimento. In M. J. Freitas & A. L. Santos (Eds.), Aquisição de língua materna e não materna: Questões gerais e dados do português (pp. 3–31). Language Science Press. https://doi.org/10.5281/zenodo.889417

Siqueira, M., Duarte Junior, S., Pereira, L. B., Ferrari, C. G., & Lopes, N. (2017). Compreensão de expressões idiomáticas em período de aquisição da linguagem. Letras de Hoje, 52(3), 391–400. https://doi.org/10.15448/1984-7726.2017.3.29371

Sua-Kay, E., & Tavares, M. (2006). TALC: Teste de Avaliação da Linguagem na Criança [Instrumento de avaliação]. Oficina Didáctica.

Tager-Flusberg, H., Rogers, S., Cooper, J., Landa, R., Lord, C., Paul, R., Rice, M., Stoel-Gammon, C., Wetherby, A., & Yoder, P. (2009). Defining Spoken Language Benchmarks and Selecting Measures of Expressive Language Development for Young Children With Autism Spectrum Disorders. Journal of Speech, Language, and Hearing Research, 52(3), 643–652. https://doi.org/10.1044/1092-4388(2009/08-0136)

Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach’s alpha. International Journal of Medical Education, 2, 53–55. https://doi.org/10.5116/ijme.4dfb.8dfd

Weir, J. P. (2005). Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. Journal of Strength and Conditioning Research, 19(1), 231–240. https://pubmed.ncbi.nlm.nih.gov/15705040/

Wetherby, A., & Prizant, B. (2001). Communication and Symbolic Behavior Scales Developmental Profile: Infant/Toddler Checklist [Measurement instrument]. Brookes Publishing.

Wiig, E. H., Semel, E., & Secord, W. A. (2013). Clinical Evaluation of Language Fundamentals–Fifth Edition (CELF-5) [Measurement instrument]. Pearson.

Wong, K. H. Y., Lee, K. Y. S., Tsze, S. C. Y., Yu, W. S., Ng, I. H.-Y., Tong, M. C. F., & Law, T. (2022). Comparing early pragmatics in typically developing children and children with neurodevelopmental disorders. Journal of Autism and Developmental Disorders, 52(9), 3825–3839. https://doi.org/10.1007/s10803-021-05261-9