The Value of Baseline Data: Setting Up for Success
You launch a new program. Teachers are trained. Students log in. Implementation looks strong. Six months later, outcomes are pretty good. Most students are above the benchmark. It feels like success. Then someone asks, “What were students’ starting points?” That question is where rigorous education program evaluation begins. Baseline data is the foundation that determines […]
Understanding Control Groups in Education: What You Need to Know
You review the report and feel cautiously optimistic. Scores are up. Attendance looks better. Behavioral incidents are trending down. By every surface-level indicator, the program seems to be working. Then someone asks an important, unavoidable question: “How do we know this wouldn’t have happened anyway?” That question is why control groups exist. And it’s why […]
Your Dashboard Isn’t Enough: Why District Leaders Stop Trusting Internal Data During Budget Season
You walk into the renewal meeting with a beautiful, color-coded dashboard showing “90% student engagement” and “1,000+ hours logged.” The charts are clean. The trend lines slope upward. The slides feel polished, professional, and ready for a decision. You expect a handshake; instead, you get a cold stare from the District CFO. To them, your […]
Beyond the Glow: 3 Reasons to Question Vendor-Provided Impact Reports
By the time renewal season rolls around, the decision is rarely a clean academic question. It’s a district leader staring at competing realities and trying to make a choice that will hold up under scrutiny. On one screen, there’s a vendor slide deck. Crisp design. Strong headlines. Clean charts that climb politely upward. A testimonial […]
The 4-Step Playbook for Getting School Districts to Say “Yes” to Your Data Request
Whether you’re in EdTech or a nonprofit leader, chances are you’ve struggled to get a solid “yes” on your data request. You decide to do evidence the serious way by getting a real education program evaluation that can hold up in a superintendent’s office, a school board meeting, or a grant review panel. You draft […]
Why an RCT Is an Expensive Way to Get Your Feelings Hurt
The product looks like it’s working. Usage is strong. Teachers are logging in. Students are engaging. The anecdotes are plentiful and sincere. A principal shares a story about a student who finally turned a corner. A district leader mentions fewer complaints this year. A nonprofit sees early indicators moving in the right direction. Then comes […]
When to Use a Pre-Post Design (and Its Limitations)
By the time the renewal conversation happens, the decision is rarely theoretical. You have a vendor update deck open on one screen and a district outcomes dashboard on the other. The vendor slides are polished: implementation steps, usage growth, and a few success stories that sound ready for a conference stage. The district data is […]
The Basics of a Logic Model (And Why It’s Crucial for Proving Impact Fast)
By 4:30 p.m., the conference table is telling the truth again. There are coffee rings, a couple of laptops hanging on at 12%, and three different vendor decks open to three different slides that all say some version of “proven impact.” The curriculum team is thinking about what students actually need. The finance team is […]
When the Data Doesn’t Tell the Story: 5 Pitfalls School Systems and EdTechs Meet in Impact Evaluation (and How to Avoid Them)
By 4:30 p.m., the conference table tells the story of another long day: coffee rings, half-scribbled notes, and a stack of vendor decks claiming “proven impact.” The superintendent wants data for the board packet. The finance chief asks what will justify renewal. Instructional leaders scan spreadsheets, trying to connect logins to learning. Everyone agrees that […]
Why School Districts Need Data-Driven Purchasing Decisions
Picture a director of curriculum at 9:07 p.m., blue light on a spreadsheet that never ends. Tabs stack. Emails ping. Every vendor promises “measurable impact.” Slides glow with smiling students and tidy charts. Tomorrow’s cabinet meeting looms. The superintendent wants a recommendation. The finance chief wants a reason. Teachers want fewer logins and more minutes […]