NEW! Lexile Measures for Listening, Oral Reading, Vocabulary and Pre-K

A student often has different literacy abilities. Now you can leverage the Lexile scale in your product offerings to identify strengths and weaknesses in listening, oral reading, vocabulary and preliteracy skills. Learn more about these new frameworks, who’s using them and how they can add value for your customers.

Transcript

1. NEW! Lexile® Measures for Listening, Oral Reading, Vocabulary and Pre-K ALISTAIR VAN MOERE, PH.D. Chief Product Officer avanmoere@lexile.com TRILBY BERGER Senior Vice President, Strategic Partnerships tberger@lexile.com
2. 2 Before We Begin Please note: • Slides and recording will be emailed afterward. • At the end of the presentation there will be a Q&A session. • Submit your questions via the “Q&A” box. Welcome to today’s webinar!
3. 3 Meet Our Speakers Alistair Van Moere, Ph.D., Chief Product Officer Alistair drives innovation in assessments and helps organizations make sense of measurement and test scores. Before joining MetaMetrics in 2017, Alistair was president of Pearson’s Knowledge Technologies group, where he managed artificial intelligence scoring services for speaking and writing. He also oversaw development and delivery of standardized assessments for millions of learners. Alistair has worked as a teacher, examiner, director of studies, university lecturer and test developer, in the U.S., U.K., Japan and Thailand. He has an MA in English Language Teaching, Ph.D. in Language Testing, and an MBA. He is frequently invited to speak at conferences and has authored over 20 research publications with a focus on educational technology and language assessments. Trilby Berger, Senior Vice President, Strategic Partnerships Trilby oversees all domestic business development for Lexile products and services. Previously, Trilby launched our global effort including expansion into Korea and Japan where learning the English language are national priorities. Her work has included managing professional development, directing marketing and inking many partnerships ranging from product development, licensing, publisher signings and highly visible marketing partnerships with the likes of Barnes & Noble and Amazon. Prior to joining the organization in 2003, Trilby served as marketing and communications manager for All Kinds of Minds from 1998 to 2003.
4. 4 I. Introduction II. Foundational Reading (Pre-K) III. Oral Reading IV. Vocab V. Listening VI. Q&A Overview
5. What is the Lexile® Framework for Reading? A student’s Lexile® reading measure is her reading ability level. Lexile measures match readers and text on the same scale. 770L Lexile Text Measure 770L Lexile Reading Measure A book’s Lexile® text measure is its reading complexity. 5 Lexile Scale
6. 6 Lexile measurement can be applied to... Reading Listening Oral Reading Vocabulary Pre-K
7. 7 Measuring Literacy & the Lexile Framework The Lexile scale can be used to measure not only reading comprehension and foundational reading skills, but to take a more complete approach to literacy with frameworks for listening and oral reading as well. READING LISTENING ORAL READING WRITING SPEAKING FUTURE READING LISTENING ORAL READING VOCABULARY WRITING SPEAKING OTHER The Lexile® Item Bank has expanded to include test items for foundational reading skills.
8. 8 5 Pillars of Reading PHONEMIC AWARENESS PHONICS READING FLUENCY VOCABULARY FOUNDATIONAL READING COMPREHENSION
9. 9 Example Items 900L 800L 700L 600L 500L 400L 300L 200L 100L 0L BR300L Lexile Scale BR200L BR100L 1200L 1100L 1000L Select the correct word: o hack o enthusiasm o overflow o race
10. 10 Example Items 900L 800L 700L 600L 500L 400L 300L 200L 100L 0L BR300L Lexile Scale BR200L BR100L 1000L BR500L BR400L This is rain. What is the new word if we add a “t” to the beginning? This is a hat. What letter is missing?
11. 11 Example Items 500L 400L 300L 200L 100L 0L BR100L BR200L BR300L BR400L BR700L Lexile Scale BR600L BR500L 600L BR900L BR800L This is a hat. What letter is missing? Which word rhymes with “bug”? dad — bin — mug
12. 12 Foundational Reading Structure
13. Phonological Awareness 13 Anthony, J., Lonigan, C., Driscoll, K., Phillips, B., & Burgess, S. (2003). Phonological sensitivity: A quasi-parallel progression of word structure units and cognitive operations. Reading Research Quarterly, 38(4), 470–487. “Manipulation”
14. Field Test Results 14 Phonological Awareness
15. Field Test Results 15 Phonics
16. Foundational Reading & the Lexile Scale 16 LEXILE TEST ITEMS for Foundational Reading Skills Now you can report Lexile measures for foundational readers: • Use the Lexile Item Bank to offer foundational reading assessments in your program • Link your existing foundational assessment to the Lexile Framework • Match assessment outcomes to your instructional activities in your program
17. 17 5 Pillars of Reading PHONEMIC AWARENESS PHONICS READING FLUENCY VOCABULARY ORAL READING FLUENCY COMPREHENSION Lexile Scale 3rd 2nd 1st K <
18. Requirements: • Ability to capture speech on your platform is required • A gradebook or feedback screen on your platform is required Benefits of Oral Reading 18 It can be a self-guided activity ✓ It only takes a minute ✓ It’s not (just) an assessment – it provides excellent practice ✓ Immediate feedback ✓ Provides accurate data for measuring growth ✓ Can be built into your reading program ✓
19. Read Aloud in Use 1. Student reads for 1 minute 2. Teacher marks up errors 3. Teacher tallies the errors and notes any corrective feedback Here is how some publishers use reading aloud… 19
20. 20 • Reading accuracy, e.g., 94% of words read correctly • Number of words read correctly per minute, or WCPM WCPM is considered most useful for tracking reading ability vs norms. Read Aloud in Use Struggling On track Advanced 2nd Grade 40 WCPM 50 - 70 WCPM 80 WCPM 3rd Grade 60 WCPM 70 - 90 WCPM 100 WCPM EXAMPLE
21. The Problem With WCPM 21 21 • Reading rate varies by text (Samuels et al., 2005; Compton, et al. 2004) • There can be considerable variability in passage difficulty within and between ORF assessments (Toyama, et al., 2018) Oh. 90 WCPM. Hmm. Yay! 120 WCPM. 20km/h 100km/h Hard Passage Easy Passage
22. Text Readability 22 WORD DECODABILITY xylophone plesiosaurus recreationally rough shift dog map pop COMPLEX EASY
23. Student Oral Reading Measures 23 23 “Leveled” or “Pre-normed” text CURRENT APPROACH Student reading performance WCPM % accuracy = + Oral readability of the text LEXILE APPROACH Student reading performance Lexile oral reading measure WCPM % accuracy = +
24. MetaMetrics models the readability of the text, and takes that into account when estimating students’ oral reading ability. Student Oral Reading Measures 24 Reading Performance + Text Readability = Student Lexile Measure
25. The Three-factor Yardstick 25 This new three-factor yardstick is a gift because it lets us see and report growth for all the students we are helping, regardless of whether they are increasing their rate, their accuracy, or the text complexity they can handle. Thank you, MetaMetrics.” Cindy Joban, PhD Principal Academic Lead NWEA https://www.nwea.org/blog/2020/a-brand-new-yardstick-for-measu ring-growth-in-oral-reading-fluency/ Reading Accuracy Lexile oral reading measure “ Text Readability WCPM
26. Student’s Oral Reading Measure & Text’s Oral Readability Measure Like the Lexile Framework for Reading, the Lexile® Framework for Oral Reading places student performance and the complexity of learning content on the same scale. The oral reading framework offers a scale that measures both student oral reading ability and oral readability of text. Two Types of Measures 26
27. Comparing Student Measures 27 • This student is comparatively strong in oral reading. • His teacher need not spend time developing fluency, and can focus on comprehension strategies. Typical students are expected to have similar measures in reading comprehension and oral reading. ORAL READING READING COMPREHENSION
28. 28 How It Works in Your Product We work with all types of companies. Pick the solution that meets your needs.
29. Glow 29 Grow
30. Janet had been waiting all year for this day to arrive. It was the day she got to go to her mom's office. Last year her mother told Janet that she was too young to appreciate the experience. But now that she was seven years old, she was ready for "Take Your Daughter to Work" day. And she was really looking forward to it. She had laid out her clothes the night before. She had picked her favorite blue sweater and her plaid skirt. She even asked her mom if she could. Text that the student read Lexile oral reading measure 480L Advice for Student • Your reading speed was great! • Try a harder reading passage next time! • Remember to take a brief pause at commas and periods. 30 Sample Lexile Feedback Screen Words to Practice You found these words challenging. Practice reading/saying these words: • waiting • young • appreciate • experience • ready • plaid
31. 31 5 Pillars of Reading PHONEMIC AWARENESS PHONICS READING FLUENCY VOCABULARY COMPREHENSION WORDBANK + POWERV
32. Lexile® WordBank IDENTIFY THE WORDS STUDENTS NEED TO KNOW 32
33. 33 As content developers, you need to .... Create grade-level content. Ensure coverage of key vocabularies. Identify academic words across domains. Align vocabulary instruction & assessment.
34. 34 Learning the right words at the right time is the key to building a strong vocabulary foundation. Help students learn the right words at the right time. With the WordBank, that’s possible so you can answer questions like…
35. 35 Limitation With Existing Academic Word Lists List Author Type Source Academic Word List (AWL) Coxhead (2000) General College textbooks Academic Vocabulary List (AVL) Gardner & Davies (2014) General Corpus of Contemporary American English (COCA) Marzano Marzano (2004) Academic State and national standards documents Middle School Academic Vocabulary Lists (MSAV) Greene & Coxhead (2015) General and Academic Middle School textbooks Most are not derived from texts read by K-12 students! The word lists come from word frequency counts as derived from corpora that adults read.
36. 36 The Lexile WordBank List Author Type Source Academic Word List (AWL) Coxhead (2000) General College textbooks Academic Vocabulary List (AVL) Gardner & Davies (2014) General Corpus of Contemporary American English (COCA) Marzano Marzano (2004) Academic State and national standards documents Middle School Academic Vocabulary Lists (MSAV) Greene & Coxhead (2015) General and Academic Middle School textbooks Lexile WordBank MetaMetrics General and Academic Landscape Corpus 144 contemporary best-selling K-12 textbooks in math, science, social studies, and reading/ELA.
37. 37 The Lexile WordBank identifies many words that are not in, or are de-prioritized by, other lists! Word Overlap With Established Lists forecast original essential solution suppose teamwork combination organize explore system percent interpret correspond mental function maintain negative require expand abandon culture sphere generation site establish legislature respond evidence communication conflict Academic Word List, frequency > 25 (Coxhead, 2000) Lexile Academic WordList
38. 38 Solution: Lexile Wordbank - 40,000 words Sneak Peak at WordBank
39. 39 Explore Additional Word Usage Information Sneak Peak at WordBank
40. 40 Top 25 Academic Words By Domain/Grade 4 Science Math Social Studies General Grade 4 substance solar cycle level pole landform whale survive trait human mixture gravity earthquake electrical gram volcano wire fuel melt tornado atmosphere glacier pressure orbit insect gallon subtraction degree symmetry expression cube polygon zero width segment quadrilateral exercise axis output obtuse ton regroup numerator dot negative input remainder perpendicular function algebra revolution invention eastern equator manufacture elect settlement wheat volunteer continent latitude fought battle buffalo british narrator official tax century custom party longitude governor trial global explain form example solve large sentence compare detail below model grow describe vocabulary shape event resource system pattern estimate complete effect during each lesson
41. 41 Top 25 Academic Words By Domain/Grades 6-8 Science Math Social Studies General Grades 6-8 plant energy earth ocean organism scientist material cell temperature soil gas mass planet heat matter environment ecosystem wave diagram chemical liquid particle flow solid climate graph equation function angle area solve data triangle expression measure length variable unit distance probability inequality height exercise ratio divide product equal coordinate sum per state property country unite region war language government history culture strategy king farm explore domain discover capital community trade union political party battle nation civil each example form explain value solve describe below represent solution system term model reason lesson factor compare determine vocabulary large event result sentence complete detail
42. New WordBank Features • Terms & Phrases 42 • Lexile measures for words
43. 43 Terms & Phrases Are Available Too Sneak Peak at WordBank
44. 44 Examples of Lexile Word Measures BR - 200L hide find take 200L - 400L book nine touch 400L - 600L tool balloon firefighter 600L - 800L imagine peep current 800L - 1000L contraction animate mysterious 1000L - 1200L prevention phony despise 1200L - 1400L aggravate periodic solvent 1400L - 1600L navigable vestigial acupuncturist 1700L + laureate circumspection vivacity
45. 45 • Creates a custom vocabulary list (up to 20 words) from analyzed text with challenging words that a student should know. • Available as an API or as an add-on service when submitting text to be measured. For Text Measurement Submissions Lexile® PowerV® Vocabulary Service
46. 46 5 Pillars of Reading PHONEMIC AWARENESS PHONICS READING FLUENCY VOCABULARY COMPREHENSION LISTENING
47. “In a study involving a nationwide sample of thousands of students, listening comprehension in the 5th grade was the best predictor of performance on a range of aptitude and achievement tests in high school, better than any other measure of aptitude or achievement in the fifth grade." From the article Becoming a Nation of Readers Anderson, Richard C., Elfrieda H. Hiebert, Judith A. Scott, Ian G. Wilkinson, Becoming a Nation of Readers: The Report of the Commission on Reading. Center for the Study of Reading, Washington, D.C.: U.S. Department of Education, 1985. eric.ed.gov/PDFS/ED253865.pdf 47
48. 48 • 25% of people now listen to podcasts regularly, versus 10% five years ago. • Audiobooks are the fastest-growing sector within the book publishing industry, according to The Association of American Publishers. • Spotify now hosts 2.2 million podcasts, up from 700,000 in 2019. • There are 4 skills in CCSS/state standards: reading, writing, speaking & listening • Listening is tested in 22 state assessments • ELL exams (e.g. WIDA, ELPAC, TELPAS, AZELLA) all report listening (4.5m students) A Nation of Listeners Listening impacts learning. Eighty percent of what we learn, we learn by listening.
49. 49 The “Simple Model” provides evidence that reading comprehension consists of primarily of decoding and listening comprehension. Understanding Literacy Gough & Tunmer, 1986; Adlof, Catts, &Little, 2006 Decoding Listening Comprehension Reading Comprehension Weak Average “Classic Dyslexic” Average Weak “Poor Comprehender” Weak Weak “Garden Variety” Poor Reader Translating text into pronounceable words Understanding words spoken aloud Understanding text
50. 50 As readers develop, the importance of decoding decreases, and the importance of listening comprehension increases. Evolution of a Reader Variance associated with reading comprehension Catts, Hogan, and Adlof (2005); Garcia & Cain, 2013
51. 51 Lexile® Framework for Listening A Lexile ® audio measure is the listening complexity of a passage. A student’s Lexile® listening measure is his listening proficiency level.
52. 52 Development 1,000 TEST QUESTIONS 75 TEST FORMS 17,500 STUDENTS 750,000 DATA POINTS • Three data collection windows • Ages 6 to 18 • Varied demographics
53. 53 Lexile Listening Item Bank Informational texts Biographies Announcements Current affairs Fiction & non-fiction (audiobook) Academic Domains: English Language Arts Science Social studies Math TEACHER TALKS RADIO REPORTS NARRATIVES DIALOGUES
54. What did Lamar do? go to bed find his pet throw a ball cook a meal Where was the last place Lamar went? the kitchen the yard the living room the bedroom 1st Grade / EFL (CEFR A2) 54 SAMPLE ITEM A B C D A B C D
55. Middle School 55 SAMPLE PASSAGE
56. 56 Lexile® Audio Analyzer Vocabulary Word Sounds Delivery Grammar Acoustic variables: How it is said Content variables: What is said
57. 57 Lexile Audio Analyzer Vocabulary Word Sounds Delivery Grammar Acoustic variables: How it is said Content variables: What is said Are the words frequently occurring, sophisticated, and on-topic? Is the speaker articulating and conveying meaning clearly? Can the listener easily form a mental representation of the words? (e.g. fair, hair, hare) Are there frequently occurring or sophisticated grammar patterns?
58. 58 The top 4 variables are: • Age of acquisition (vocabulary) • Speech-to-pause ratio (delivery) • Mean sentence length (grammar) • Semantic support (vocabulary) Lexile Audio Analyzer
59. 59 Developing the Scale In our data so far, we observe a r=0.77 relationship between listening and reading measures. Generally speaking, better readers are better listeners and vice versa, but individuals vary a lot. Listening measures improve as you go up the grade levels: on average, 3rd graders have higher measures than 2nd graders who have higher measures than 1st graders. Just like reading, the highest-scoring 1st and 2nd graders outperform the lowest-scoring 10th and 11th graders.
60. 60 This table shows norms for students at the middle of the year, in the 25th- 50th -75th percentiles. The norms for Lexile listening measures are the same as for Lexile reading measures. An interactive table, including norms for beginning and end of year for reading measures can be found in the Lexile® Grade Level Charts. Grade Middle of Year Norms 25th – 50th – 75th percentile 1 BL120L – 85L – 290L 2 170L – 355L – 545L 3 415L – 590L – 760L 4 635L – 790L – 950L 5 770L – 925L – 1075L 6 855L – 1010L – 1160L 7 925L – 1080L – 1230L 8 985L – 1140L – 1295L 9 1040L – 1195L – 1345L 10 1085L – 1240L – 1395L 11/12 1130L – 1285L – 1440L This table represents norms (i.e. where students actually are in terms of ability) and not standards (i.e. where they should be according to state standards). See the above link for more info. Recommended Norms hub.lexile.com/lexile-grade-level-charts
61. 65% of students earn reading and listening measures within 250L of each other 100L 200L 300L 400L Difference in measures Variation Between Reading and Listening 61 If a student’s Lexile reading measure is 500L and Lexile listening measure is 750L (or 250L), we may consider this to be “typical” variation.
62. 20% of students earn reading and listening measures within 250L-350L of each other 65% of students earn reading and listening measures within 250L of each other 100L 200L 300L 400L Difference in measures Variation Between Reading and Listening 62 If a student’s Lexile reading measure is 500L and Lexile listening measure is 750L (or 250L), we may consider this to be “typical” variation.
63. 15% of students earn reading and listening measures that are greater than 350L different 20% of students earn reading and listening measures within 250L-350L of each other 65% of students earn reading and listening measures within 250L of each other 100L 200L 300L 400L If a student’s Lexile reading measure is 500L and Lexile listening measure is 750L (or 250L), we may consider this to be “typical” variation. Difference in measures Variation Between Reading and Listening 63
64. Comparing Measures The teacher may want to investigate further with clinical tests, in case he has dyslexia. 64 Benjamin is in 4th grade Lexile reading measure = 350L Lexile listening measure = 800L • His listening measure is on grade, which shows his comprehension skills are good. • But his reading measure is 450L below.
65. Comparing Measures The teacher now knows that Sally may not understand verbal instruction all that well, and should tailor teaching strategies accordingly. 65 Sally is in 3rd grade Lexile reading measure = 250L Lexile listening measure = 280L • Both measures are more typical of 1st graders at this time of the year • The teacher knew Sally struggled with reading, but did not know she struggled with her listening skills, too.
66. Students listen 2 or 3 grades above their reading ability Myth ... 66 Most students in lower grades process information more easily via audio than print. They haven’t learned to read with automaticity yet. Students in higher grades process information more easily via print than audio. They can actually digest more difficult material in print. Reality ... * Specific to first language or U.S. students.
67. 67 Text and Audio Measures • We learn to listen before we learn to read. • Don’t have to worry about decoding words on the page • Early grade students process audio better than they process print. Why is listening easier in the early grades*? Why is listening harder in the later grades? + • Audio is fleeting, ephemeral. • We cannot control the pace; even if the information has not been processed. • We cannot dwell on certain parts, or re-read the previous sentence. • We can get thrown off by an unknown word or garbled phrase. • Lexile Framework measures academic listening: main idea, detail, inference. * Specific to first language or U.S. students.
68. 68 Audio Materials 1. Graded Readers with audio 2. Freely available books online, e.g. Audible 3. MetaMetrics Original Passage O n our roadm ap...
69. 69 Audio “map” Lexile map for reading Similar to the Lexile Framework for Reading map, the Listening Framework map will provide examples of audio that are matched to various points on the Lexile scale. A new Lexile map for listening is in development. O n our roadm ap...
70. 70 Benefits ✓ Optimize student growth by matching students to audio content at their listening level. ✓ Motivate students to read, especially students with different learning styles. ✓ Help students improve listening skills, important for work and life.
71. 71 Get the fuller literacy picture with Lexile measures for: OUR MISSION Bringing Meaning to Measurement Listening Oral Reading Vocabulary Lexile measures for additional literacy constructs on the horizon: Writing + Speaking ✓ ✓ ✓ Pre-K Foundational Reading ✓ Reading ✓
72. 72 FOLLOW UP WITH US: Questions ALISTAIR VAN MOERE, PH.D. Chief Product Officer avanmoere@lexile.com TRILBY BERGER Senior Vice President, Strategic Partnerships tberger@lexile.com
73. This presentation constitutes the confidential information of MetaMetrics, Inc. The trademarks and names of other companies and products mentioned herein are the property of their respective owners. Copyright © 2021 MetaMetrics, Inc. All rights reserved. METAMETRICS, INC. LEARN MORE FOLLOW US ON SOCIAL MEDIA 1000 Park Forty Plaza, Suite 120 Durham, North Carolina 27713 Phone: 919.547.3400 MetaMetricsInc.com Lexile.com Quantiles.com Lexile.Global TWITTER @MetaMetrics_Inc | @Lexile_Quantile FACEBOOK @LexileFramework | @QuantileFramework INSTAGRAM Instagram.com/lexile_quantile/ LINKEDIN Linkedin.com/company/metametrics-inc- Connect With Us