|
Sign In to gain access to subscriptions and/or personal tools.
|
Productivity, Fluency, and Grammaticality Measures From NarrativesPotential Indicators of Language Proficiency?
Janet Tilstra
University of Minnesota, Minneapolis, tils0016{at}umn.edu
Kristen McMaster
University of Minnesota, Minneapolis
The purpose of this study was to identify potential general outcome indicators (GOIs) of language proficiency. Brief narratives were elicited from 45 kindergarten, first-grade, and third-grade children using single-picture scenes and a standardized protocol. Measures of language productivity, verbal fluency, and grammaticality were examined for alternate-form reliability and criterion validity. Two verbal fluency measures, total productive words per minute and total number of words per minute, were reliably obtained for students in all grades, demonstrated moderate criterion validity with a standardized oral language measure, and differentiated third-grade students from those in kindergarten and first grade. Additional standards for GOIs are discussed.
Key Words: language assessment narratives evidence-based practice outcome measures school age children language impairment
References
- American Speech-Language-Hearing Association (ASHA). (1993). National outcome measurement system. Retrieved June 28, 2007, from http://www.asha.org
- Asha. (2006). Introduction to evidence-based practice. Retrieved July 20, 2007, from htpp://www.asha.org/members/EBP/intro/htm
- Aram, D., Morris, R., & Hall, N. (1993). Clinical and research congruence in identifying children with specific language impairment. Journal of Speech and Hearing Research, 36, 580-591.[Web of Science][Medline]
[Order article via Infotrieve]
- Baum, H.M. (1998). Overview, definitions, and goals for ASHA's treatment outcomes and clinical trials activities (What difference do outcome data make to you?). Language, Speech, and Hearing Services in Schools, 29, 246-249.[Abstract/Free Full Text]
- Beitchman, J.H., Wilson, B., Brownlie, E.B., Walters, H., & Lancee, W. (1996). Long-term consistency in speech/language profiles: Developmental and academic outcomes. Child and Adolescent Psychiatry, 35(6), 804-814.[CrossRef]
- Bishop, D.V.M., North, T., & Donlan, C. (1996). Non-word repetition as a behavioral marker for inherited LI: Evidence from a twin study. Journal of Child Psychology and Psychiatry, 37, 391-403.[Web of Science][Medline]
[Order article via Infotrieve]
- Botting, N., & Conti-Ramsden, G. (2001). Non-word repetition and language development in children with specific language impairment (SLI). International Journal of Language and Communication Disorders, 36(4), 421-432.[CrossRef]
- Carrow, E., & Woolfolk, C. (1996). Oral and written language scales: Listening comprehension and oral expression scales. Circle Pines, MN: AGS.
- Catts, H.W., Fey, M.E., Tomblin, J.B., & Zhang, X. (2002). A longitudinal investigation of reading outcomes in children with language impairments. Journal of Speech, Language, and Hearing Research, 45, 1142-1157.[Abstract/Free Full Text]
- Catts, H.W., Hogan, T.P., & Adlof, S.M. (2005). Developmental changes in reading and reading disabilities. In H. W. Catts & A. G. Kamhi (Eds.), The connections between language and reading disabilities. Mahwah, NJ: Lawrence Erlbaum Associates.
- Cirrin, F.M., & Gillam, R.B. (2008). Review of evidence-based practices for school-age children with spoken language disorders: A systematic review. Language, Speech, and Hearing Services in Schools, 39(1), S110-S137.[Abstract/Free Full Text]
- Deno, S.L. (1985). Curriculum-based measurement: The emerging alternative. Exceptional Children, 16(2), 99-104.
- Deno, S.L. (2003). Developments in curriculum based measurement. Journal of Special Education, 37(3), 184-192.[Abstract/Free Full Text]
- Deno, S.L., Mirkin, P.K., & Chaing, B. (1982). Identifying valid measures of reading. Exceptional Children, 49(1), 36-45.[Web of Science][Medline]
[Order article via Infotrieve]
- Dollaghan, C.A. (2004). Evidence-based practice in communication disorders: What do we know, and when do we know it? Journal of Communication Disorders, 37, 391-400.[CrossRef][Web of Science][Medline]
[Order article via Infotrieve]
- Ehren, B.J., & Nelson, N.W. (2005). The responsiveness to intervention approach and language impairment. Topics in Language Disorders, 25(2), 120-131.[Web of Science]
- Finestack, L.H., Fey, M.E., & Catts, H.W. (2006). Pronominal reference skills of second and fourth grade children with language impairment. Journal of Communication Disorders, 39, 232-248.[CrossRef][Medline]
[Order article via Infotrieve]
- Fuchs, D., Fuchs, L.S., Compton, D., Bouton, B., Caffrey, E., & Hill, L. (2007). Dynamic assessment as responsiveness to intervention: A scripted protocol to identify young at-risk readers. Teaching Exceptional Children, 39(5), 58-63.
- Fuchs, L.S. (2004). The past, present, and future of curriculum-based measurement research. School Psychology Review, 33(2), 188-192.[Web of Science]
- Fuchs, L.S., Fuchs, D., & Speece, D. (2002). Treatment validity as a unifying construct for identifying learning disabilities. Learning Disability Quarterly, 25(1), 33-46.[CrossRef][Web of Science]
- Gazella, J., & Stockman, I.J. (2003). Children's narrative retelling under different modality and task conditions: Implications for standardizing language sampling procedures. American Journal of Speech-Language Pathology, 12, 61-72.
- Gillam, R.B., & Gillam, S.L. (2006). Making evidence-based decisions about child language intervention in schools. Language, Speech, and Hearing Services in Schools, 37, 304-315.[Abstract/Free Full Text]
- Gillam, R.B., & Johnston, J.R. (1992). Spoken and written language relationships in language/learning-impaired and normally achieving school-age children. Journal of Speech and Hearing Research, 35, 1303-1315.[Web of Science][Medline]
[Order article via Infotrieve]
- Good, R.H., & Kaminski, R.A. (2002). DIBELS oral reading fluency passages for first through third grades (Technical Report 10). Eugene: University of Oregon.
- Greenhalgh, K.S., & Strong, C.J. (2001). Literate language features in spoken narratives of children with typical language and children with language impairments. Language, Speech and Hearing Services in Schools, 32, 114-125.[Abstract/Free Full Text]
- Hadley, P.A. (1998). Language sampling protocols for eliciting text-level discourse. Language, Speech, and Hearing Services in Schools, 29, 132-147.[Abstract/Free Full Text]
- Hayes, P.A., Norris, J., & Flaitz, J.R. (1998). A comparison of oral narrative abilities of underachieving and high-achieving gifted adolescents: A preliminary investigation. Language, Speech, and Hearing Services in Schools, 29, 58-171.
- Hewitt, L.E., Hammer, C.S., Yont, K.M., & Tomblin, J.B. (2005). Language sampling for kindergarten children with and without SLI: Mean length of utterance, IPSYN, and NDW. Journal of Communication Disorders, 38, 197-213.[CrossRef][Medline]
[Order article via Infotrieve]
- Hughes, D., McGillivray, L., & Schmidek, M. (1997). Guide to narrative language: Procedures for assessment. Eau Claire, WI: Thinking Publications.
- Justice, L.M. (2006). Evidence-based practice, response to intervention, and the prevention of reading difficulties. Language, Speech, and Hearing Services in Schools, 37, 284-297.[Abstract/Free Full Text]
- Justice, L.M., Bowles, R.P., Kaderavek, J.N., Ukrainetz, T.A., Eisenberg, S.L., & Gillam, R.B. (2006). The index of narrative microstructure: A clinical tool for analyzing school-age children's narrative performances. American Journal of Speech-Language Pathology, 15, 177-191.
- Kadaverek, J.N., & Sulzby, E. (2000). Narrative production by children with and without specific language impairment: Oral narratives and emergent readings. Journal of Speech, Language, and Hearing Research, 43, 34-49.[Abstract/Free Full Text]
- Kemp, K., & Klee, T. (1997). Clinical language sampling practices: Results of a survey of speech-language pathologists in the United States. Child Language Teaching and Therapy, 13(2), 161-176.[Abstract/Free Full Text]
- Laing, S.P., & Kamhi, A. (2003). Alternative assessment of language and literacy in culturally and linguistically diverse populations. Language, Speech, and Hearing Services in Schools, 34, 44-55.[Abstract/Free Full Text]
- Law, J., Garrett, Z., & Nye, C. (2005). Speech and language therapy: Interventions for children with primary speech and language delay or disorder. Cochrane Database of Systematic Reviews 3, No. CD004110. Available from http://www.cochrane.org/reviews/en/ab004110.html
- Leadholm, B.J., & Miller, J.F. (1992). Language sample analysis: The Wisconsin guide. Madison: Wisconsin Department of Public Instruction.
- Liles, B.Z., Duffy, R.J., Merritt, D.D., & Purcell, S.L. (1995). Measurement of narrative discourse ability in children with language disorders. Journal of Speech and Hearing Research, 28, 123-133.
- Ling-yu, G., & Tomblin, J.B. (2005, June). Pauses in narratives of English-speaking children with specific language impairment. Poster session presented at the Symposium on Research in Child Language Disorders, Madison, WI.
- Loban, W.D. (1976). Language development: Kindergarten through grade twelve. Urbana, IL: National Council of Teachers of English.
- Luo, F., Timler, G., & Vogler-Elias, D. (2006, November). Narrative skills of school age children with language impairment with and without attention deficit and hyperactivity disorder. Paper presented at the 2006 annual convention of the American Speech, Language, and Hearing Association, Miami, FL.
- Marquardt, T.P., & Gillam, R.B. (1999). Assessment in communication disorders: Some observations on current issues. Language Testing, 16(3), 249-269.[Abstract/Free Full Text]
- Marston, D.B. (1989). A curriculum-based measurement approach to assessing academic performance: What it is and why do it. In M. R. Shinn (Ed.), Curriculum-based measurement: Assessing special children (pp. 18-78). New York: Guilford.
- McMaster, K., & Espin, C. (2007). Technical features of curriculum-based measurement in writing: A literature review. Journal of Special Education, 41(2), 68-84.[Abstract/Free Full Text]
- Miller, J.F., & Chapman, R.S. (2000). Systematic analysis of language transcripts (Version 6.1a) [Computer software]. Madison: University of Wisconsin, Waisman Research Center, Language Analysis Laboratory.
- Miller, J.F., Heilmann, J., Nockerts, A., Iglesias, A., Fabiano, L., & Francis, D.J. (2006). Oral language and reading in bilingual children. Learning Disabilities Research & Practice, 21, 30-43.[CrossRef]
- Miller, J.F., Long, S., McKinley, N., Thormann, S., Jones, M., & Nockerts, A. (2005). Language sample analysis II: The Wisconsin guide. Madison: Wisconsin Department of Public Instruction.
- Miller, R., Gillam, R.B., & Pena, E.D. (2001). Dynamic assessment and intervention: Improving children's narrative abilities. Austin, TX: Pro-Ed.
- Mullen, R. (2004). Evidence for whom? ASHA's national outcomes measurement system. Journal of Communication Disorders, 37, 413-417.[CrossRef][Medline]
[Order article via Infotrieve]
- Naucler, K., & Magnusson, E. (2002). How do preschool language problems affect language abilities in adolescence? In F. Windsor, L. Kelly, & N. Hewlett (Eds.), Investigations in clinical phonetics and linguistics. Mahwah, NJ: Lawrence Erlbaum.
- Nichols, L.E., & Brookshire, R.H. (1993). A system for quantifying the informativeness and fluency of the connected speech of adults with aphasia. Journal of Speech and Hearing Research, 36(2), 338-350.[Web of Science][Medline]
[Order article via Infotrieve]
- No Child Left Behind Act of 2001. Pub. L. No. 107-110, 115 Stat. 1425 (2001).
- Pearson, P.D., Hiebert, E.H., & Kamil, M.L. (2007). Theory and research into practice in vocabulary assessment: What we know and what we need to learn. Reading Research Quarterly, 42(2), 282-296.[CrossRef]
- Pena, E.D., & Gillam, R.B. (2000). Dynamic assessment of children referred for speech and language evaluations. Dynamic Assessment: Prevailing Models and Applications, 6, 543-575.
- Redmond, S. (2005). Differentiating SLI from ADHD using children's sentence recall and production of past tense morphology. Clinical Linguistics & Phonetics, 19(2), 109-27.[CrossRef][Medline]
[Order article via Infotrieve]
- Rescorla, L. (2002). Language and reading outcomes to age 9 in late-talking toddlers. Journal of Speech, Language, and Hearing Research, 45(2), 360-371.[Abstract/Free Full Text]
- Scott, C.M., & Windsor, J. (2000). General language performance measures in spoken and written narrative and expository discourse of school-age children with language learning disabilities. Journal of Speech, Language, and Hearing Research, 43, 324-339.[Abstract/Free Full Text]
- Semel, E., Wiig, E.H., & Secord, W. (1987). Clinical Evaluation of Language Fundamentals- Revised. San Antonio, TX: Psychological Corporation.
- Shinn, M. (1989). Curriculum-based measurement: Assessing special children. New York: Guilford.
- Simon, E., & German, D.J. (1991). Analysis of children's word-finding skills in discourse. Journal of Speech and Hearing Research, 34, 309-316.[Medline]
[Order article via Infotrieve]
- Tomblin, J.B., Freese, P.R., & Records, N.L. (1992). Diagnosing specific language impairment in adults for the purpose of pedigree analysis. Journal of Speech and Hearing Research, 35, 832-843.[Medline]
[Order article via Infotrieve]
- Tomblin, J.B., Zhang, X., Buckwalter, P., & Catts, H. (2000). The association of reading disability, behavioral disorders, and language impairment among second-grade children. Journal of Child Psychology and Psychiatry and Allied Disciplines, 41(4), 473-482.[CrossRef][Medline]
[Order article via Infotrieve]
- Ukrainetz, T.A. (2006). The implications of RTI and EBP for SLPs: Commentary on L.M. Justice. Language, Speech, and Hearing Services in Schools, 37, 298-303.[CrossRef]
- Wayman, M.M., Wallace, T., Wiley, H.I., Ticha, R., & Espin, C.A. (2007). Literature synthesis on curriculum-based measurement in reading. Journal of Special Education, 41(2), 85-120.[Abstract/Free Full Text]
- Wechsler, D. (1991). Wechsler Intelligence Scale for Children: III. San Antonio, TX: Psychological Corporation.
Communication Disorders Quarterly, Vol. 29, No. 1,
43-53 (2007)
DOI: 10.1177/1525740108314866

CiteULike Complore Connotea Del.icio.us Digg Reddit Technorati Twitter What's this?
This article has been cited by other articles:

|
 |

|
 |
 
L. M. Hoffman
The Utility of School-Age Narrative Microstructure Indices: INMIS and the Proportion of Restricted Utterances
Lang Speech Hear Serv Sch,
October 1, 2009;
40(4):
365 - 375.
[Abstract]
[Full Text]
[PDF]
|
 |
|
|
|