The Data Driven Instruction Cycle Presenter: Mark Adato
Mark Adato High School Science Teacher/Data Coach 2014 joined Illuminate Education
What’s coming up:
Agenda 1. Introduction to the Data Cycle 2. Exploring the Building Blocks of the Data Cycle: Assessment Analysis Action Culture
Introduction to the Data Cycle
React
Why use Data Driven Instruction?
Data as a Guide
One example where Data Driven Instruction made a difference
North Star Middle School
Another example where Data Driven Instruction made a difference
Monarch Academy
What are the fundamental building blocks of DDI?
The Framework
Exploring the Building Blocks of the Data Cycle
The First Building Block:
Assessment
Grade 7, 4.1.A.3: Understand and use ratios, proportions and percents in a variety of situations
Sample Standard-Aligned Questions 1. Identify 50% of 20 2. Identify 67% of 81 3. Shawn got 7 correct answers out of 10 possible answers on his science test. What percent of questions did he get correct? 4. J.J. Redick was on pace to set an NCAA record in career free throw percentage. Leading into the NCAA tournament in 2004, he made 97 of 104 free throws attempts. What percentage of free throws did he make? 5. J.J. Redick was on pace to set an NCAA record in career free throw percentage. Leading into the NCAA tournament in 2004, he made 97 of 104 free throws attempts. In his first tournament game,
Redick missed his first five free throws. How far did his percentage drop from before the tournament game to right after missing those free throws? 6. J.J. Redick and Chris Paul were competing for the best free-throw shooting percentage. Redick made 94% of his first 103 shots, while Paul made 47 out of 51 shots. A. Which one had a better shooting percentage? B. In the next game, Redick made only 2 of 10 shots while Paul made 7 of 10 shots. What are their new overall shooting percentages? Who is the better shooter? C. Jason argued that if Paul and J.J. made the next ten shots, their shooting percentages would go up by the same amount. Is this true? Why or why not?
How should assessments be designed?
Five Core Drivers § Transparent Starting Point: must be written in advance before
the teaching starts, and teachers must see them – they are the road map
§ Common and interim: should apply to all students in a grade level and should occur on a regular interval (e.g. every 6-8 weeks)
§ Aligned to state tests and college readiness: aligned to state tests in format, content, and length, and aligned to the higher bar of college readiness
§ Aligned to instructional sequence: aligned to teachers’
sequence of clearly defined grade-level and content expectations
§ Reassessed: interim assessments should continuously reassess previously taught standards
The Second Building Block:
Analysis
How deep into the data do you go?
Sample Analysis Strand Level Analysis
Ratio-Proportion Results Overall: 70%
Standard Level Analysis
Ratio-Proportion – General (#12, 21): 82% Ratio-Proportion – Rates (#22, 30): 58%
Question Level Analysis
Related Standard: Multiply and divide mixed numbers (#5): 40%
Question #22: 35% Question #30: 80% #22: Jennifer drove 36 miles in one hour. At this rate, how far would she travel in 2 ¼ hours?
#30: If a machine can fill 4 bottles in 6 seconds, how many bottles can it fill in 18 seconds?
How should data by analyzed?
Diving into Data Steps for Data Analysis 1. Review assessment prior to instructional cycle 2. A few weeks prior to testing, predict student outcomes 3. Administer assessment 4. ASAP: Teacher reviews data at claim, standard, question level on their own AND with students 5. Within a week: PLC/collaborative group analyzes data and plans action
Core Concept: Test-in-hand analysis is not one possible way to analyze student error – it is the ONLY way to do effective analysis
Data Analysis Protocol
The Third Building Block:
Action
How do you start making changes to instruction?
Effective Action What makes Creasy’s follow up action so effective? § Explicitly tied to conclusions from analysis § Designed to put those conclusions in practice § Correct analysis § New strategies § Specific time of implementation
Where does the action planned?
Taking Action § Best practices shared with PLC’s/collaborative teams § Observing master teachers § Content-based coaching/ mentoring § External PD § Experimenting in the classroom
Action Plan Protocol
The All-Encompassing Building Block:
Culture
A teacher approaches a principal with a question:
Sample Conversation Teacher: Listen; this data-driven education thing seems interesting and all but...why are we doing it? Principal: Do you watch basketball? T: Sure. P: During a recent high school basketball playoff game, the scoreboard completely malfunctioned midway through the game. So the refs kept score and the time on the sidelines. As it came close to the end of the game, the visiting team was down by two points, but they did not realize it nor how much time was left. The clock ran out before they took the final shot. T: That’s not right! P: Of course not. If the scoreboard had been working, the entire end of the game would have been different. So you’d agree that a working scoreboard is critical for sporting events, correct? T: Of course. P: At the end of the day, data-driven instruction is like fixing the broken scoreboard. Relying on state tests is like covering up the scoreboard at the beginning of the game and then uncovering it at the end to see if you won. At that point, there’s nothing you can do to change the outcome! We use interim assessments to keep the scoreboard uncovered, so we can make the necessary adjustments to be able to win the game.
What’s your mindset?
Growth vs. Fixed 1. You are a certain kind of person, and there is not much that can be done to change that. 2. I often get angry when I get criticized about my performance. 3. Only a few people will be good at sports – you have to be “born with it.” 4. Trying new things is stressful for me and I avoid it. 5. Truly smart people do not need to try hard.
How do you create a strong Data Driven Culture?
Conditions for Success § Build buy in/capacity with district and school leadership § Build buy in/capacity with teacher leaders (both tech savvy and socially influential teachers) § Create a school/classroom calendar that revolves around interims and creates time for analysis/action § Constantly seek out and emulate best practices
How does Illuminate fit into the picture?
DDI in Illuminate Data Cycle with Assessment Reports On the Fly Manual Setup ItemBank
Analysis Assessment
Prebuilt Reports Custom Reports
Summary Assessment
Action Collaborate Intervene Activate
Get in touch
Contact Us Address
6531 Irvine Center Dr, Ste 100 Irvine, CA 92618
Phone
(949) 242-0343
Website
www.illuminateed.com
Email
[email protected]
Mark Adato
[email protected]
