This weekly digest tracks what is NEW or CHANGED in AI-economics research. For the cumulative state of evidence on any topic, see the /syntheses pages. A single study rarely overturns a body of evidence.

Strengthened: causal evidence that generative AI can raise output and compress dispersion, with an Argentina randomized controlled trial closing about 75% of an education-based productivity gap and a 70,884-applicant field experiment increasing offers and starts without near-term productivity losses.

Better measured: production-facing failures in coverage, quality, and operations, including >85% venue invisibility in AI recommendations, stricter security policies associated with lower coding-agent success, and AI-generated C++ being associated with more static issues and 5–8% higher compute use.

Challenged: the view that sycophancy mainly amplifies polarization, as a preregistered RCT finds sycophantic advice tends to depolarize choices on average even while biasing argument content.

Confirmsestablished

Does generative AI narrow education-based productivity gaps? Evidence from a randomized experiment

: Guillermo Cruces, Diego Fernandez Meijide, Sebastian Galiani, Ramiro Galvez, Maria Lombardi

RCT, randomized controlled trial, high evidence

In an Argentina online RCT with 1,174 adults, a GPT-4.1 assistant increases task performance for both education groups and closes roughly 75% of the baseline education-based productivity gap, with small immediate learning spillovers after AI removal. This independently reinforces prior gap-compression results in a new population and task bundle at larger scale.

So what: If this holds, forecasts of within-firm productivity dispersion under AI assistance may be overstated, risking mispricing of roles and training value.

Full numbers

Extendsestablished

Voice AI in firms: A natural field experiment on automated job interviews

: Brian Jabarian, Luca Henkel

field experiment, pre-registered natural randomization, high evidence

A firm-scale natural field experiment randomizing 70,884 applicants to AI vs human interviews finds AI raises offer rates by 12%, increases starts and 1–4 month retention by about 18%, and shows no detectable productivity loss among hires in available metrics. This expands the evidence base from task-level productivity to firm pipeline outcomes with human-in-the-loop decisions.

So what: If this generalizes, staffing and cost models that assume neutral hiring pipelines under automation may understate starts and early retention, shifting unit labor and onboarding assumptions.

Full numbers

Tensionestablished

AI sycophancy and decisions

: John Conlon, Peter Schwardmann

RCT, randomized controlled trial, high evidence

A preregistered RCT with 1,500 participants and 30 decision tasks finds a sycophantic LLM disproportionately supports users’ priors yet, on average, depolarizes choices by 0.22 SD (standard deviations) relative to no-chat, with heterogeneity across tasks. This challenges the simple expectation that agreeable AI advice mainly amplifies polarization.

So what: If this holds, reputational and policy risk tied to polarization may be mis-scoped, while decision-quality risk persists because argument selection leans toward user priors.

Full numbers

Extendsestablished Faster, higher, stronger? The impact of GenAI on knowledge work productivity - evidence from the field : Bottesch, Schwenke, Zimmermann, Förster, Klier (RCT). GenAI speeds creation and packaging tasks and improves quality while harming acquisition quality in a lab-in-the-field RCT (N=128), with larger gains for lower performers, reinforcing task-dependent effects.

Newdescriptive Invisible to the machine: Auditing AI restaurant, cafe, and bar recommendation against a complete market census : Vladimir Pitenin. A preregistered census audit of 4,776 Bali venues finds four production AIs omit at least 85.6% of local venues, quantifying exposure risks for small businesses.

Tensionsuggestive Permission denied: Policy-graded evaluation of coding agents in hardened environments : Dotan Davidovich, Yair Amar, Hai Rozencwajg, Or Hiltch. Stricter enterprise runtime policies are associated with up to about 18 percentage points lower coding-agent success and higher token costs, indicating lab results may overstate real-world performance.

Newdescriptive The tokenizer tax: Quantifying and explaining the cross-lingual cost of subword tokenization for Indian languages : Priyansh Srivastava. English-centered tokenizers impose about 8x token penalties on many Indian languages, shrinking usable context and affecting deployment costs.

Tensionsuggestive Characterizing the quality profile of AI-generated C++ in production : Michael Tran, Fred Lewis, Kun Yang, Saksham Thakur, Aditya Kini, Aditya Patil, Milad Hashemi, Parthasarathy Ranganathan. In a large monorepo, AI-generated C++ is associated with higher static issues and 5–8% higher compute share, even as targeted feedback can mitigate warnings.

Newframework AV-AIVAT: 74x cheaper agent evaluation with certified anytime-valid stopping in imperfect-information games : Boning Li, Yu Chen, Longbo Huang. Combining AIVAT control variates with anytime-valid confidence sequences yields provably valid early stopping and large sample savings (up to 74x) for agent evaluation.

Newdescriptive EcoAgent-Bench: Evaluating economic decision-making in budget-constrained LLM agents : Jie Wu, Ming Gong, Feixiang Cheng, Qinqin Zhao. Tool-using agents show low budget-consistent success (≤24%) and weak cost-aware behavior under priced actions, highlighting gaps between pass rates and economic fitness.

Newframework Capability-gated planning: Cost-to-goal discovery and the limits of myopic experiment selection : Ahmed Hassoon, Mark Dredze. Theory shows myopic information-gain planners can be arbitrarily suboptimal when actions unlock future capabilities; a capability-aware heuristic can mitigate this failure mode in their analysis.

Newdescriptive Architectural implications of agentic AI workflows : Jirong Yang, Peizhe Liu, Chaojie Zhang, Jovan Stojkovic. Production traces show agentic workflows fragment CPU/GPU usage and create bursty heterogeneity; in their tests, an adaptive server prototype restored utilization without worsening tail latency.

Newsuggestive Causal machine learning for macroeconomic forecasting under structural breaks and economic uncertainty : Oumaima Abouzaid, Faouzi Boussedra. A Double ML plus regime-detection pipeline outperforms standard baselines during breaks in their evaluation, suggesting tools for crisis forecasting.

Newframework When predictions become regressors: A split-sample correction for biases in downstream inference : Nathan Canen, Ted Enamorado. A split-sample instrument approach corrects bias when using ML-generated measures as regressors, and can deliver consistent estimates under stated assumptions.

Tensionsuggestive AI financial advice: Supply, demand, and life cycle implications : Taha Choukhmane, Tim de Silva, Weidong Lin, Matthew Akuzawa. Model advice tends toward life-cycle prescriptions but varies by demographic and sometimes mis-smooths shocks, raising distributional and suitability concerns.

Extendssuggestive Does supply-chain digitalization policy reshape supplier selection? Evidence from China’s SCIAPP : Fei Liu, Yang Li. Staggered difference-in-differences (DiD) suggests pilot designation is associated with increases in the share of new suppliers with above-median AI capability, especially among firms without strong internal AI.

Tensionsuggestive When policies change probabilities: Modular decision-making for LLM code review : Rasvik Kudum, Max Corbett, Hitansh Paliwal, Romaisa Fatima, Thomas Jiralerspong, Sneheel Sarangi. Embedding thresholds and costs inside prompts shifts probability estimates and was associated with higher decision loss in tests; modular separation was associated with lower loss.

Tensionsuggestive Bayesian and motivated reasoning in AI agents : Eddie Yang. Holding numeric evidence fixed, framing steers agent conclusions toward elicited priors, echoing motivated reasoning.

Newdescriptive Artificial intelligence: Supply-chain chokepoints and the reach of industrial policy : Piyush Akimitsu. Inventory shows extreme upstream concentration (for example, lithography and packaging) relative to downstream layers, clarifying constraint points for policy.

Confirmssuggestive A robust association between LLM use and scientific productivity: Assessing stopping-time selection : Keigo Kusumegi, Xinyu Yang, Paul Ginsparg, Mathijs de Vaan, Toby Stuart, Yian Yin. Additional checks reject a stopping-time critique, sustaining the association between detected large language model (LLM) use and higher arXiv output.

Newdescriptive FairFund-Bench: Evaluating distributive bias in LLM resource allocation : Martin Lukk. Measured allocative bias flips with audit format; causal deservingness cues outweigh demographic signals, cautioning against single-design conclusions.

Extendssuggestive Quality management as an enabler of enterprise AI adoption : Chao Ni, Xiaohan Wang, Liping Chen, Yuexiang Yang, Zhiqiang Zhang. Panel instrumental variables (IV) and difference-in-differences (DiD) suggest stronger internal quality systems correlate with higher AI adoption and performance gains in Chinese firms.

Tensiondescriptive Can LLM agents price competitively? A dynamic multi-attribute auction benchmark for agentic commerce : Shimaa Ahmed, Yiwei Cai, Mohsen Minaei, Rahul Rachuri. Agents that win customers underperform on profit; margin per win, not win rate, predicts value.

Newdescriptive Hidden errors in big data: The case of property records : Evelyn Smith, Emma Harvey, Jacob Goldin, Daniel E. Ho. Brokered datasets show 12–15% coverage gaps and 1–2% large price errors, and can change tax regressivity estimates.

Extendsdescriptive Share the judge, learn the deferral: Where specialization helps LLM evaluation : Weining Zhang. Rubric-conditioned shared judges with lightweight adapters keep accuracy and coverage; scratch-trained specialist adapters lag.

Tensiondescriptive When synthetic users fail: A cross-domain benchmark of LLM-simulated human survey responses : Zihan Chen, Di Zhu, Lei Nico Zheng. LLMs do not beat demographic baselines in predicting individual responses and overstate demographic predictiveness, suggesting synthetic panels may mislead.

Newdescriptive A density-matrix framework for electronic-structure analysis of lithium-metal electrolytes : Mingkang Liu, Huize Yu, Yanbin Gao, Nan Yao, Xiang Chen, Lei Shen. A machine-learned density-matrix pipeline scales electronic descriptors to 160k+ molecules, which could enable higher-throughput materials screens.

Tensiondescriptive HANDBOOK.md: A benchmark for long-context agentic instruction following : Liudas Panavas, Sebastian Minus, Bradley Monton, Derek Ray, Suhaas Garre, Sushant Mehta, Edwin Chen. Best strict pass rate is 36% across 65 long-policy tasks, indicating weak compliance at frontier.

Tensiondescriptive Instruction-tuned language models cannot sample from distributions they can describe : Chaemin Jang, Dongman Lee, Jihee Kim. Alignment induces a knows/does split: models collapse to deterministic outputs even when they can correctly describe target distributions.

Distributional productivity compression: Beyond prior task-level studies, an Argentina RCT shows a 75% narrowing of an education-based productivity gap, and a lab-in-the-field RCT again finds larger gains for lower performers. This strengthens the claim that access to capable assistants can compress observable productivity dispersion rather than widen it.

Firm pipelines without near-term productivity tradeoffs: A very large natural field experiment indicates automated voice interviews increase offers, starts, and retention with no detected productivity decline among hires in measured metrics. Relative to the baseline of mixed or anecdotal firm-level impacts, this better measures an end-to-end organizational gain channel.

Quality, coverage, and governance costs: New audits and production studies quantify omissions (85%+ of local venues unseen), cross-lingual tokenization penalties (about 8x tokens), lower coding-agent success under real security, and modest compute increases and static issues in AI-generated C++. This tilts the balance toward measurable implementation frictions even as throughput improves.

Decision influence and sycophancy: A preregistered RCT finds sycophantic advice depolarizes on average, while other experiments find agent conclusions move with framing aligned to elicited priors. Our editorial read: the net direction of human polarization shifts toward center in many tasks, but decision quality and argument selection remain biased and context dependent.

Polarization vs depolarization under AI advice

Throughput gains vs latent quality/resource costs

Recommenders as access expanders or incumbency amplifiers

Agent performance in hardened enterprises

Detecting collusion with marginal-price audits

Massive natural field randomization in hiring (Voice AI in firms): Randomizing 70,884 applications offers high external validity on offers, starts, retention, and short-run on-the-job measures, setting a useful benchmark for organizational AI experiments.

AV-AIVAT early-stopping evaluation (AV-AIVAT: 74x cheaper agent evaluation): Merges control variates with anytime-valid confidence sequences to deliver large evaluation-sample reductions (up to 74x) while preserving statistical guarantees.

Split-sample instruments for ML-generated regressors (When predictions become regressors): A practical correction for measurement-error bias when downstream analyses use LLM/ML-derived variables, which can improve credibility in applied social-science settings.

Browse the full paper archive →

Website · LinkedIn