News & Events
December 20, 2018
DDI colleagues will be presenting at the International Congress for School Effectiveness and Improvement 2019 Conference in Stravanger, Norway.
- Amanda Datnow will provide the keynote “Data Use with Purpose: Promoting Equity and Professional Collaboration in School Improvement”
- Kim Schildkamp, Amanda Datnow, and Jo Jimerson will participate in the symposium “Data Use In Education: Filling in the Gaps”
- Ellen Mandinach will serve as discussant for the symposium “Conditions for Data-Informed Decision-Making: Collaboration, Sensemaking, and Distributed Leadership”
- Ellen Mandinach and Kim Schilkamp will facilitate a discussion on “Misconceptions in Data-Driven Decision Making in Education”
- Ellen Mandinach will present “Data Literacy in Teacher Preparation”
- Ellen Mandinach, Kim Schildkamp, Cindy Poortman, and Amanda Datnow will participate in the symposium “Teachers Using Data: Professional Development and Teacher Preparation”
- Diana Nunnaley will participate in the symposium “Effects of Data Feedback on Teaching Quality”
December 20, 2018
A new article explores the nature of the information parents seek to make decisions about their child’s education and provides insight on the characteristics of data displays that would make education information accessible and understandable.
“Parental Educational Decision Making: The Information They Seek and What They Want from Data Systems” will be published in Teachers College Record. The authors (Dr. Ellen B. Mandinach, Dr. Ryan C. Miskell, and Dr. Edith S. Gummer) find parents seek qualitative data sources that supply descriptions of schools and districts. They want not only test scores and school grades but also information that helps them understand the schools: details about the teachers, leaders, and programs offered and information about safety and processes. Parents want the information presented in accessible and understandable formats that include better graphics and more easily understood details.
December 20, 2018
Dr. Ellen B. Mandinach and Dr. Edith S. Gummer have released a new book that addresses the issue of data use in educator preparation programs toward continuous programmatic improvement.
With an aim to increase the rigor in both research and practice in educational administration and teacher education, this volume will analyze the longstanding quality concerns about teacher and leadership preparation and standards for programs and educators, as well as controversies concerning national accreditation and federal efforts to mandate program reporting data. By exploring the policies and practices that influence departments of education, this volume examines the increasing pressures to improve institutional functioning within a complex system of university, state, and national structures and organizations.
- Introduction and Overview
- Landscape View of the Continuous Improvement Process
- Creating a Data Culture in Educator Preparation: The Role of the States
- Building Capacity and Commitment for Data Use in Teacher Education Programs
- Moving Toward Common Measures to Accelerate Improvement: A Roadmap for Educator Preparation Programs
- Connected for Improvement: The Teacher Preparation Data Model and TPP Dashboard
- Learning to Walk the Walk of Continuous Improvement
- Visualizing Data: Necessary but Not Sufficient for Educator Preparation Program Continuous Improvement
- Lessons Learned While Building a Data Use Culture
- Conclusions: Challenges, Opportunities, and Next Steps
June 6, 2018
WestEd, as part of REL Mid-Atlantic, has organized the Maryland State Department of Education Connections Summit in Towson, MD on June 6 and 7. Participants will take part in presentations from local, state, and national leaders on ways to bridge educartion data, research, policy, and practice.
Dr. Elizabeth Farley-Ripple of the University of Delaware will give the keynote speech, “Making Evidence Matter.” Ellen Mandinach of WestEd will speak on data literacy and data use. Ellen Mandinach and Ryan Miskell will speak about parental use of information to make educational decisions.
The WestEd Data for Decisions Initiative is pleased to announce the publication of the Data Literacy Assessments Project. These resources are available to educational professionals, professors and students in college and graduate courses, and to researchers.
The Data Literacy Assessments Project at WestEd, in collaboration with Using Data Solutions, has produced four scenario-based exercises that can be used to measure data literacy. The materials can be used as assessments, as supplemental instructional materials to develop data literacy for educational professionals in professional development or college and graduate courses, and for research purposes. The scenarios are designed to depict typical instances when teachers need to use data to make decisions in the course of their practice or personal experiences. They will allow users to demonstrate a variety of data literacy skills as outlined in the construct Data Literacy for Teachers (DLFT) developed by Ellen Mandinach and Edith Gummer.
The resources are available through the DDI website or by typing the URL into your internet browser: https://datafordecisions.wested.org/data-use-in-action/data-literacy-assessments/
A new book focuses on data use according to the Data Team™ Procedure, which schools throughout the Netherlands have been implementing in a supervised manner since 2009.
Essential to improving teacher quality is ensuring that the right data are available to inform the policy and practice changes needed to continuously improve educator preparation program (EPP) quality, teacher effectiveness, and ultimately student learning. Unfortunately, that data are not uniformly available today.
This paper describes how data sharing among states, EPPs, and K-12 leaders can help ensure quality teaching and learning. The paper:
- Discusses challenges to using data to improve educator preparation
- Presents state policy recommendations
- Profiles policy in action in Massachusetts, Tennessee, and Missouri
WestEd’s Ellen Mandinach served as a member of the working group for this paper, developed collaboratively over one year with a group of national, EPP, and state-level experts.
Ellen B. Mandinach contributed a blog post, which can be found below, on data literacy in early education to the National Institute for Early Education Research (NIEER).
Data have been used in education for many years. Good teachers and administrators have been using data to inform their practice and make decisions. Why is data use important? Because it is no longer acceptable for educators to solely use anecdotes and gut feelings to make decisions. Educators need hard evidence. To that end, there has been a growing emphasis for the past 15 years to make education a more evidence-based and data-driven discipline.
Data have ranged from accountability and compliance data to data for continuous improvement at all levels of education, but one issue that has loomed large is the conflation of data literacy with assessment literacy. The two constructs have been confounded for many years (Mandinach & Gummer, 2016a; Mandinach & Kahl, 2014). When educators and the general public think about data, they typically think about test results and student performance. They fail to think about all the other sources of data that help educators to inform their practice. Until fairly recently, there has been no clear definition of data literacy and certainly no analyses of the skills, knowledge, and dispositions that are needed to use data effectively and responsibly (Data Quality Campaign, 2014; Gummer & Mandinach, 2015; Mandinach & Gummer 2016a, 2016b). The work of Mandinach and Gummer, based on several years of research, has attempted to lay out what it means for educators to be data literate.
A foundation of data literacy is the consideration and use of diverse sources of data, not just the limitation to only student performance data. For educators to have a comprehensive understanding of their students, they must look to behavioral, attitudinal, motivational, medical, attendance, home context, and other kinds of data. Even though measures of teacher readiness such as the edTPA (SCALE, 2013) contain an assessment rubric, it makes clear that teacher candidates must be able use contextual information, “assets,” to inform their understanding of student performance.
Diverse sources of data are particularly important in early childhood education where teachers often must look beyond student performance results to understand a child. As Dwyer (2015) notes, some of the data most relevant in early childhood settings other than assessments (formative, summative, and diagnostic) include screening results, informal check-ins, child characteristics and experiences, attendance, health information, family language/education experiences, family conditions for learning, classroom observations, participation, walkthroughs, and staff experience and education. In workshops conducted across Pennsylvania for early childhood educators, Dwyer, Mandinach, Nunnaley, and Saylor (2015) noted several purposes for data use in early learning:
- Improve child outcomes
- Improve teachers’ skills
- Identify gaps in achievement
- Realign resources
- Facilitate parental engagement
- Improve program quality
- Increase access to high quality programs
- Change adult behavior
Dwyer and colleagues (2015) reflected on why data use is important in early learning settings, recognizing that evidence is important. They noted that there needs to be realistic expectations for how data use can inform and improve daily practice. Through effective data use, educators can:
- Reflect on practice
- Check assumptions
- Get others’ views
- Commit to new actions
- Attend to the effects of changes in practice
- Make practice public
But how does this happen? More than eight years ago, the Institute for Education Sciences (IES) commissioned a comprehensive review of the literature that existed at the time, recognizing that data-driven decision making was only then emerging as a hot topic in educational research (Hamilton, Halverson, Jackson, Mandinach, Supovitz, & Wayman, 2009). Some 3,000 research and implementation studies were identified with only a handful meeting the strict criteria for rigorous research laid out by the What Works Clearinghouse. Five recommendations were noted. For there to be effective data use at any level of education, schools and districts must:
- Make data part of an ongoing cycle of instructional improvement
- Teach students to examine their own data and set learning goals
- Establish a clear vision for schoolwide data use
- Provide supports that foster a data-driven culture within the school
- Develop and maintain a districtwide data system (p. iii)
These five recommendations have stood the test of time. The growing research in data use further confirms the recommendations. Much of the work firmly espouses the need for the introduction of data teaming, leadership, and the creation of data cultures within schools and districts. Data systems have morphed from data warehouses to dashboards and apps that provide real-time data for instructional decision making.
Yet despite having much of the infrastructure in place, particularly the billions of dollars spent on technology at the federal, state, and local levels, attention to the human infrastructure remains problematic. Fulfilling all of the five recommendations from the IES practice guide is an important step forward. However, if educators do not know how to use data both effectively and responsibly, the investment in attaining the recommendations will go for naught. Even though the field recognizes the importance of data use, the delivery of consistent and comprehensive professional development is often lacking and falls below other competing priorities.
As Means, Padilla, and Gallagher (2010) noted, professional development for data use must be ongoing, not sporadic. As Mandinach and Gummer (2016a) note, waiting until educators are in practice to acquire data literacy skills is too late. They must begin to acquire such skills at the earliest stages of their professional careers, that is, during pre-service preparation. Because of this growing need, WestEd and its collaborator, Using Data Solutions, is working toward the development of curriculum materials that can be used in teacher preparation programs to teach data literacy. The objective is for teacher preparation programs across the country to begin to integrate the construct, data literacy for teachers (Mandinach & Gummer, 2016a, 2016b) into their curricula. The ultimate objective is to create a teaching corps that knows how to use data.
The AERA Data SIG Business Meeting will be help on Sunday, April 30 from 6:15 to 7:45pm at the Grand Hyatt San Antonio, Third Floor Bonham C.
Please come and join the session. The session will include local Texas educators talking about how they use data.
An interesting book is now on the best seller’s list about decision making and pertains to all fields, not just education. Michael Lewis of Moneyball fame has written The Undoing Project. It is the story of two psychologists who studied decision making in fields such as medicine and sports. The two psychologists, Daniel Kahneman and Amos Tversky wrote ground-breaking articles on how decisions are made, the assumptions, and fallacies. For example, the hot hand phenomenon in basketball is really a myth. Kahneman was awarded the Nobel Prize for Economic Sciences for this work. A good and interesting read for those involved in decision making.