The Commonplace: Two-override cap preserves sales while trimming inventory…
|
The Commonplace
Weekly Research Digest · July 06, 2026
|
From Alex
A few project notes from me this week. I updated foundryR, the R package I use for working with Microsoft Foundry from R; made another pass on the OES Dashboard, which turns Occupational Employment and Wage Statistics into a browsable workforce-data tool; and added more to onet2r, my R package for pulling and working with O*NET data.
We also published a new NFW Reader piece on using Copilot Studio in causal impact work.
The Delta
Coming in, Employment Level leaned mixed (154 papers); this week, the signal is mixed.
What Moved & What Held
Coming in, the standing view was that AI can raise productivity and resilience when paired with simple governance and complementary human capital, and that poorly designed human–AI interaction can blunt gains or backfire. Evidence was strongest for targeted operational rules and developer tools tied to higher throughput, with heterogeneous effects depending on users, incentives, and domain reliability.
This week adds two field experiments and several quasi-experimental panels that push on design details: a two-override cap preserved sales while trimming inventory, while engineering controls raised backdoor detection in coding agents in controlled tests; open-source projects adopting AI agents showed no detectable reduction in newcomer participation despite slightly higher code complexity; and bot-driven symbolic awards did not raise and sometimes reduced engagement. Still holds this week: the need for deployment design over blanket delegation, the importance of user traits and training for realizing gains, and wide heterogeneity by setting.
Top Papers
Key: each paper is tagged Relation (New, Confirms, Extends, Tension, Challenges) and evidence status (established, suggestive, framework, descriptive). Study design (RCT, quasi-experiment) is shown separately in parentheses. full key
Confirmsestablished
Two-override cap preserves sales while trimming inventory in large retail field RCT
Minda Zhao, Brian Rongqing Han, Xin Chen, Tao Zhu; randomized controlled trial, high evidence
In a major Chinese smart-vending retailer (553 workers across 59k+ machines), a randomized cap of two downward overrides per machine reduced inventory by about 1.28% without reducing sales, whereas unlimited free overrides reduced inventory but also reduced sales. This aligns with the standing view that constrained human oversight improves AI-supported operations relative to unconstrained overrides.
So what: If this holds, unmanaged override policies can quietly erode margins through sales leakage even when inventory looks leaner, making governance design a first-order operational risk.
Extendsestablished
Hiroki Oda, Kinga Makovi, Taha Yasseri, Milena Tsvetkova; randomized field experiment, high evidence
A randomized field experiment on the Reddit platform finds symbolic awards do not raise recipients' subsequent activity or downstream impact, and awards delivered by apparent bot accounts using a lottery rationale can reduce it. This extends evidence on governance-by-nudge, showing simple automated incentives can backfire in large social systems.
So what: If this generalizes, product and policy teams face the risk that cheap automated nudges deliver no lift and can depress engagement, distorting key performance indicator (KPI) assumptions.
Newsuggestive
AI coding agents raise code complexity slightly but do not crowd out OSS newcomers
Using GitHub data for 1,888 adopter projects (603 with pre-period) in a difference-in-differences design, adoption is associated with modestly higher per-function code complexity but no detectable reduction in newcomer inflow, onboarding, or retention relative to matched controls. This provides a setting-specific check against broad crowd-out fears.
So what: In this sample, newcomer pipelines did not thin after agent adoption, but slightly higher complexity raises the risk that maintainability costs reappear later if onboarding quality is overstated.
Also Notable
Extendssuggestive Generative AI adoption is associated with higher firm supply‑chain resilience and greater upstream supplier concentration (Shi Jun, Yijun Chen, Wenli Hu)
Chinese A-share panel with fixed effects and an instrumental variables (IV) strategy links AI adoption to higher resilience via innovation and investment, with an apparent trade-off of greater supplier concentration.
Extendssuggestive Enterprise mandate and voluntary adoption are associated with about double merged PR throughput tied to AI tool use (H. He, Shyam Agarwal, Yegor Denisov-Blanch, Pavel Azaletskiy, Sanmi Koyejo, Bogdan Vasilescu)
Longitudinal case (802 developers, 196k pull requests) associates an AI-use mandate and cumulative individual usage with ~2.09x merged pull-request (PR) throughput.
Newsuggestive Firms with high exposure to a high‑frequency AI consumption factor exhibit a persistent stock return premium (Nicola Borri, Yukun Liu, Aleh Tsyvinski)
Asset-pricing analysis using 380 trillion tokens constructs an AI factor, reporting an AI premium concentrated in intensive, paid, closed-source usage.
Extendssuggestive Steerability via constraints: a substrate for scalable oversight of coding agents (Thomas Winninger)
Applying access controls, network policies, and a small documentation command-line interface (CLI) raised recall of injected backdoors from roughly 55% to 91% in controlled agent tests.
Extendssuggestive Model capability and reasoning effort, more than auxiliary tools, correlate with first‑try success in agentic code runs (Achint Mehta)
Across 90 agent runs, higher-capability models and greater internal reasoning effort are associated with better first-try reliability, while extra testing tools came with higher cost without improving first-pass outcomes in those runs.
Extendssuggestive AI application associates with higher ESG scores in Chinese firms, especially among lower-tech and cleaner industries (Haixia Feng, Renbo Shi, Qingjin Wang)
Firm panel fixed-effects links AI application to better environmental, social, and governance (ESG) metrics, mediated by human capital and green innovation, with heterogeneous effects across firms and regions.
Extendssuggestive China's Low-Carbon City Pilot Policy is associated with higher local AI industry development (Luyuan Tang, Shiyao Xie, Yuan Xu, Ziwen Sun)
Staggered difference-in-differences (DiD) across 285 cities (2007–2022) finds pilots correlate with ~16.9% higher local AI enterprise levels, consistent with environmental and AI growth coexisting.
Newdescriptive Top LLMs score ~82.7% on aviation operations benchmark, below informal expert reference of ~95% (Alex Brooker, Tim Hughes)
The 300-question Pre-Flight benchmark suggests a domain reliability gap relative to practitioner performance for non-safety-critical tasks among large language models (LLMs).
Newframework A contextual-bandit oversight game with two-sided informational asymmetry (Yunjin Tong)
Formal model of an online decision process where actions are chosen based on context delineates when myopic humans decline oversight under private information and how signaling or repetition could mitigate avoidable harm.
Newdescriptive Personas can lead agentic AIs to reproduce human analytical variation and produce divergent conclusions (Jiacheng Miao, Jonathan K. Pritchard, James Zou)
Introduces m-value (a metric for variation) and an Agentic Bootstrap (a way to sample plausible analysis paths) to quantify the range and extremity of agentic analytical choices, showing personas can lead agentic AIs to reproduce human-like analytical variation.
What Moved
Contested & Watch
Methods Spotlight
Large-scale field RCT of governance rules in operations: A Simple Solution to Improving Human Supervision of Algorithms: Evidence from Smart Vending. Directly tests a simple override-cap policy across 553 workers and 59k+ machines, strengthening causal claims about human–AI supervision design.
Token-level AI consumption factor construction: AI Premium. Uses 380 trillion tokens of usage data to build an asset-pricing factor, opening a quantifiable path to measure firm exposure to AI demand.
Agentic Bootstrap for analytical variability: The Agentic Garden of Forking Paths. Formalizes a way to enumerate and score plausible agentic analysis paths, making hidden degrees of freedom measurable.
