Rob Dickson

Rob Dickson

Archives
Log in
Subscribe
November 15, 2026

Who kept the thinking?

Stanford's review of 52 studies says AI helps when students use it to understand, not to do the work. The week's leaks came from saved approvals, leftover credentials and trusted tools. The common thread: who is still doing the thinking.

Sunday Signal Report · November 15, 2026

Who kept the thinking?

Stanford's review of 52 studies says AI helps when students use it to understand, not to do the work. The week's leaks came from saved approvals, leftover credentials and trusted tools. The common thread: who is still doing the thinking.

30

public signals

6

signal clusters

29

source links reviewed

Rob Dickson at the start of his November 15 Sunday Signal video intro. Click to watch on YouTube.

▶ Watch my intro

▶ Listen to this week's episode

Rob here. On Friday, new congressmen visited Creative Minds at Benton. Students led, walking our guests through the projects they are building, and the visitors saw how the dual classroom design works. Something I heard this week stuck with me: what the tools can't do, call it taste, judgment, or people skills, is becoming the valuable thing. Keep one question in mind as you read: what is getting cheaper, and what is getting more valuable?

Two-panel card titled Who kept the thinking? This week's evidence and this week's failures point the same way: AI helped where a person stayed in charge of the thinking, and the trouble started where that job was quietly handed off. Left panel, kept, a person still decides: students using AI to understand, not to produce the work, which Stanford's review of 52 causal studies found more promising; tutoring software woven into regular instruction outperformed the same idea run after school; the AFT and Anthropic standard writes it into a contract, educators, not AI systems, stay responsible for decisions about students. Right panel, handed off, nobody was checking: saved approvals, 1,122 public Claude Code settings files on GitHub held real secrets; leftover credentials, 5 of 17,960 OpenAI test agents used them to get root on research systems; trusted tools, N-central servers on the patched build were compromised and third-party ScreenConnect extensions were tied to unauthorized access.

Sources: SCALE Initiative at Stanford; Leite et al.; AFT; Apiiro; OpenAI Alignment; Huntback; ConnectWise.

The question under every story is the same one: who is still doing the thinking? Open the report.

Signal 1 · AI and learning

The design decides the effect

Chart titled The design decides the effect. Left panel: 20 to 52, the number of causal studies in Stanford SCALE's evidence base review from March 2026 to November 2026, with five new student-facing studies in U.S. K-12 settings, up from zero. Right panel, SCALE headline findings: using AI to understand material looks more promising than using it to produce work, and neither consistently improves learning; offloading academic tasks can reduce learning; students often like AI more than it helps them. Bar chart of intelligent tutoring system effect sizes by how they were used: main instructional method 0.294, significant; individual homework 0.317, significant; separate activity 0.235, not significant; after school 0.014, not significant. Second bar chart by when learning was measured: immediately after 0.460; end of school year 0.155. Note: overall effect across 18 U.S. K-12 studies and 11 systems is g equals 0.274, these are pre-chatbot tutoring systems, and darker bars were not statistically significant.

Sources: SCALE Initiative at Stanford, Nov. 10, 2026; Leite et al., ERIC ED682145 and arXiv 2511.04997.

this is the strongest support yet for keeping humans at the design end of learning. The tool is not the variable. Where it sits in the day, who designed the practice, and whether the student is thinking or watching are the variables. A district that buys a tutor and parks it in an after-school block should expect almost nothing, and a teacher tool that saves an hour but flattens student confidence did not save anything.

Do this: Rewrite the success measures for every AI pilot this year. Add student motivation and confidence next to time saved, require that student-facing use be tied to core instruction rather than bolted on after school, and ask every vendor which uses its own evidence covers: understanding, practice or producing work.

Selected sources

  • The Evidence Base on AI in K-12: A November 2026 Review
  • Do Intelligent Tutoring Systems Benefit K-12 Students? A meta-analysis (ERIC record)
  • Primer: An AI Framework for Instructor-Centered Educational Simulation Creation

Plus 2 more in the full report.

Signal 2 · AI governance

The terms are the policy

Card titled The terms are the policy, with three panels. Panel one, binding contract, AFT, UFT and Anthropic: in effect November 10 for districts using Claude for Teachers; student data used only for authorized educational purposes and never sold or used for ads; educators, not AI systems, stay responsible for decisions about students; plain-language disclosure of what products collect and where they fall short. Panel two, bundle under pressure, Google Search and AI: keep AI Overviews or lose Search for students, Google told NPR; Senator Markey asked Google four questions with answers due November 30; Chicago is exploring ways to suppress AI Overviews itself or another search engine; Google has not published a rollout date and NBC San Diego reports a January 2027 decision window. Panel three, indemnity clause, Meta and one district: Salinas City Elementary will delete its Facebook and Instagram accounts on November 20 because proposed terms would have made the district indemnify Meta if Meta's AI misused student photos; Meta put the change on hold November 5 and the district is leaving anyway.

Sources: AFT; Office of Sen. Markey; NPR via OPB; Chalkbeat Chicago; NBC San Diego; KSBW.

the AFT agreement is the most useful governance document of the month because it is enforceable and short. "Educators stay in charge" is not a slogan when it sits in a contract. Compare that with a bundle where the district's only lever is to give up Search, or a terms update that quietly moves liability to the school. Same question every time: who decides, and who pays when it goes wrong.

Do this: Pull the three clauses from the AFT standard and add them to your AI vendor agreements and approval checklist, whether or not you use Claude.

Selected sources

  • AFT, UFT and Anthropic Sign Binding AI Safety and Privacy Agreement for Schools
  • Markey demands Google allow schools to disable AI services without blocking Search access
  • Salinas school district to delete social media accounts over AI privacy concerns

Plus 2 more in the full report.

Signal 3 · Devices and screens

Pulling the device is not the plan

Card titled Pulling the device is not the plan. Left panel, Memphis-Shelby County Schools: 25,000 laptops proposed for high schools after the district quietly ended 1:1 in August and testing and lessons were disrupted, about 22 million dollars, board vote pending, devices by February 2027; 175,000 of nearly 260,000 devices in inventory are aged out or will age out within two years, and the new model is checkout for students in dual enrollment or online classes, not 1:1. Right panel, Fordham Institute survey of high schoolers: 76 percent report some kind of daily illicit tech use during high school; 62 percent spend more than half of class time on school-issued devices; more than 1 in 5 use AI without permission; survey of more than 2,000 current students and recent graduates fielded February to March 2026. Note: neither number measures learning; restriction answers what students can reach, design answers what the device is for; Worcester, Massachusetts sent a petition to pull pre-K to grade 2 Chromebooks to a subcommittee on November 12 and asked for more staff input first.

Sources: Chalkbeat Tennessee, Nov. 10, 2026; Fordham Institute via K-12 Dive, Nov. 11, 2026; MassLive.

restriction and instructional design are different questions, and Memphis shows what happens when you answer the first without the second. Testing, dual enrollment and online courses depended on those laptops. Fordham's numbers are a strong case that school devices carry too much distraction, and they say nothing about what students learned. Neither story proves an outcome. Both say: know what the device is for before you decide how many to keep.

Do this: Before any change to 1:1 or take-home devices, list every workflow that assumes a student has one, from state testing to online credit recovery to assistive technology, and assign an owner and a replacement for each.

Selected sources

  • Memphis parents complained of a school laptop shortage. Now MSCS wants to buy 25,000 more.
  • High Tech, Low Standards: High School in the Age of Distraction (PDF)
  • Majority of students report misusing tech during school hours

Plus 1 more in the full report.

Signal 4 · Cybersecurity

The doors were the tools you trust

Card titled The doors were the tools you trust. None of this week's biggest exposures started with a student clicking a link; they came through remote-management tools, an AI vendor's vendor and a back-office provider. Row one, 19 of 21: of 21 internet-facing N-central servers Huntback saw mining cryptocurrency on November 12, 19 reported build 2026.4.1.26, the November 10 patched release; N-able ties the server flaw to its Legacy API, which is off by default. Row two, about 400: ConnectWise ScreenConnect partner environments with one or more of five third-party extensions tied to unauthorized access; ConnectWise disabled them where it could and says disabling alone may not remove access already established. Row three, less than 1 percent: Notion workspaces affected when its AI inference provider Fireworks AI was breached and Notion AI chat transcripts were exposed; Notion then revoked API keys found pasted into those chats. Row four, 3,085,266: people affected by Frontline Education's August breach per its Indiana filing, versus roughly 1.3 million in earlier filings in other states.

Sources: Huntback; The Hacker News; ConnectWise; Notion; SecurityWeek.

the uncomfortable lesson is that patching on time was not enough for some N-central customers, and a vendor's own count of affected people can more than double months later. The Notion detail is the one I will repeat to staff: people paste keys and passwords into AI chats, and those chats live wherever the AI vendor's vendor keeps them. Your risk map has to go two vendors deep now.

Do this: This week, ask every managed service provider and vendor that touches district devices, in writing, whether it runs N-central or ScreenConnect and with which extensions.

Selected sources

  • 4EverAble2Shell is already mining Monero on live N-central servers
  • ScreenConnect security update: Guidance for partners
  • Security incident involving a third-party AI vendor (Fireworks AI)

Plus 2 more in the full report.

Signal 5 · Frontier and open-weight AI

What you get, and the catch

Table titled What you get, and the catch. Five releases from November 9 to November 13. Gemini 4 Hydrogen, Google, November 12: fast, cheaper model at 1.50 dollars in and 7.50 dollars out per million tokens, cloud only, no weights; the catch: now the model behind AI Overviews and AI Mode in Search, so the AI inside Search changed without a district setting. Claude Fable 5.2 and Mythos 5.2, Anthropic, November 9: same underlying model at 8 dollars in and 40 dollars out per million tokens; the catch: Mythos is the less-restricted version, gated to verified cyber and life-sciences programs. MiniMax H3-Image, November 10 to 11: open-weight image model with 4K output; the catch: the license excludes the United States, the EU, the UK and South Korea. Qwen4-Max-Preview, Alibaba, November 11: closed preview through Token Plan only; the catch: retired after November 25, no weights. llama.cpp v1.0.0, ggml-org, November 13: the local inference engine under many offline AI tools; the catch: a stable API promise, not new capability.

Sources: Google; Anthropic; MiniMax license on Hugging Face; Alibaba Cloud; Hugging Face blog.

"open weights" now regularly means downloadable but not licensed for American schools, and "available" can mean a gated tier or a two-week preview. Meanwhile the model students meet most often, inside Search, changed on Google's schedule. The quietest release is the one I would watch: a stable foundation for local inference is what makes keeping student data in-house realistic over time.

Do this: Add three questions to your AI approval form for any tool built on a third-party model: which model and version, under what license and in which countries it may be used, and how the vendor will tell you when the model underneath changes.

Selected sources

  • Introducing Gemini 4 Hydrogen
  • Introducing Claude Fable 5.2 and Claude Mythos 5.2
  • llama.cpp v1.0.0: A stronger foundation for the local AI ecosystem

Plus 2 more in the full report.

Signal 6 · Agentic AI checkpoint

The risk lives in the leftovers

Card titled The risk lives in the leftovers. Panel one: 1,122 of 104,185 public Claude Code settings files on GitHub held a real secret, saved when someone chose don't ask again; Apiiro, November 5, and Anthropic's Claude Code lead responded November 7. Panel two: 5 of 17,960 OpenAI test agents used credentials left by earlier runs to get root inside research CI jobs, and two left it out of their final answers. Panel three: self-hosted Claude Managed Agents, private beta November 12; the harness, sandboxes, credentials and session history can run in your own cloud, and model calls still go to a provider. Release table, dates in UTC: OpenClaw 2026.11.2, November 8, stable. OpenClaw 2026.11.3, November 10, stable. OpenClaw 2026.9.37, November 10, extended stable. OpenClaw 2026.11.5-beta.2 and beta.3, November 12 and November 15, prerelease. Hermes Agent v0.23.1, November 10, stable patch. Hermes Agent v0.23.1 canary builds, November 13 to 15, prerelease.

Sources: Apiiro; OpenAI Alignment; Anthropic; GitHub releases, checked Nov. 15, 2026.

the org layer is the work. Buying an agent is easy; deciding where its credentials live, how long its approvals last and who reads its logs is the actual build. An agent that hides a shortcut because the grader is automated is a good reason to keep a human reading the evidence, not just the final answer.

Do this: Before any agent touches district systems, write down where its credentials are stored, when standing approvals expire and who reviews its activity each week.

Selected sources

  • Coding Agents Are Leaking Your Secrets to GitHub
  • Using peers' work to gain unauthorized access to OpenAI research infrastructure
  • Operate Claude Managed Agents inside your security perimeter

Plus 2 more in the full report.

Who kept the thinking?

The question under every story is the same one: who is still doing the thinking?

Open the report

If this is useful, forward it to one school-system leader who would rather read the signal than the noise.

Rob

P.S. Subscribe from the report page if you want this in the inbox instead of hunting for it on Sunday night.

Don't miss what's next. Subscribe to Rob Dickson:
Older → Control came back, with strings
LinkedIn
Twitter
Powered by Buttondown, the easiest way to start and grow your newsletter.