The Project That Broke the Estimates
At RIADVICE, we recently developed a complex, feature-rich application — the kind that coordinates multiple subsystems across a distributed architecture — as a native cross-platform environment targeting mobile and desktop from a single codebase, driven by market requirements that demanded a new implementation. The codebase tells the scale:- 286,662 SLOC (~286 KLOC) spread across 672 source files
- 1,329,399 lines of total churn — 862,488 insertions and 466,911 deletions
- 700 commits over 7 active development days to reach the first alpha ready for testing
- Full internationalization into dozens of locales
- Multiple deeply unrelated subsystems — protocol handling, data management, rendering, and platform integration — all built from scratch for the target environment
What Estimation Models Predicted vs. What Actually Happened
The tool runs every major estimation model in the software engineering literature — COCOMO Basic (Organic, Semi-Detached, Embedded), COCOMO Intermediate (Semi-Detached and Embedded, tuned), COCOMO II Post-Architecture (tuned), Function Points, the SLOC Productivity Baseline, and Putnam/SLIM — calibrated to the project type using published constants from the original source literature.| Estimation model | Predicted effort | Predicted calendar | Speedup vs. actual |
|---|---|---|---|
| COCOMO Basic (Organic) | 913 person-months | 33.3 months | 2,282× |
| COCOMO Basic (Semi-Detached) | 1,696 person-months | 33.7 months | 4,240× |
| COCOMO Basic (Embedded) | 3,200 person-months | 33.1 months | 8,000× |
| COCOMO Intermediate (Semi-Det., tuned) | 1,259 person-months | 30.4 months | 3,148× |
| COCOMO Intermediate (Embedded, tuned) | 2,376 person-months | 30.1 months | 5,940× |
| COCOMO II Post-Architecture (tuned) | 1,703 person-months | 30.3 months | 4,257× |
| Function Points (back-of-envelope) | 17.9 person-months | 7.5 months | 45× |
| SLOC Productivity Baseline (25 SLOC/dev-day) | 573 person-months | 573.3 months | 1,433× |
| Putnam/SLIM | skipped (duration < 30 days; T4/3 explodes) | — | — |
The models disagree with each other — by 50× to 8,000×
These models do not agree with each other. On this same codebase, predictions range from 17.9 to 3,200 person-months — a 178× spread. The SEAA 2013 benchmark of COCOMO II, SEER-SEM, SLIM, and TruePlanning across 51 real projects found MMRE of 50–100%. A 2023 evaluation on the COCOMO NASA dataset found MMRE near 1.0 and PRED(0.25) = 0.0 — not a single project estimated within the 25% error band. The models were never designed for an AI-assisted project. But the size of the gap — even accounting for model inaccuracy — tells us something structural has changed.What the Research Really Says About Agentic AI and Developer Productivity
The 4,240× figure is extreme, and I do not want to oversell it. Greenfield scaffolding inflates churn, and SLOC is a weak proxy for value. So let us look at the peer-reviewed literature. Copilot-style assistants deliver modest, real gains. Peng et al. (2023) found developers using an AI pair programmer completed a task 55.8% faster (95% CI: 21–89%). The Microsoft/Accenture/Fortune 100 RCT (2025) — the largest study to date, n=4,867 — found a 26% increase in completed tasks. Google’s internal RCT (2024) found ~21% reduction in time-on-task. The BIS/Ant Group field experiment (2024) measured a 55% increase in code output for junior staff. The honest summary: 1.26×–1.56× on suitable tasks. Real, but not transformative. Agentic AI operates in a different regime. Cognition’s 2025 review of Devin reported customer results of 10× on ETL migrations, 14× on Java version migrations, ,以及 20× on security fixes. Nubank reported 12× efficiency improvement and 20× cost savings on a multi-million-line refactor previously estimated as a multi-year, thousand-engineer effort. Our port sits squarely in this range — the commit histogram shows dense bursts at 22:00, 00:00, and 01:00, the signature of agent-driven sessions. The counter-evidence is real. Metr.org’s 2025 RCT (16 experienced developers, 246 tasks on mature projects) found AI increased completion time by 19% — it slowed down experienced developers on familiar codebases. A 2026 difference-in-differences study of 807 AI-tool-adopting GitHub repos (He et al., MSR ’26) found a “transient” velocity boost and a “persistent” increase in code complexity that drove a long-term slowdown. The title says it all: Speed at the Cost of Quality. The consensus: AI helps a lot on greenfield and structured development, helps modestly on completion tasks, and can harm velocity on mature codebases. The quality debt is real.Why the Models Break: Three Structural Shifts
None of the cost drivers in classical models have a setting for “the developer has an autonomous agent that never sleeps and holds the entire codebase in context.” Three shifts collapse the duration curve:Models assume a significant fraction of effort is mechanical — boilerplate, scaffolding, repetitive refactors, localization resources, and other structured data. In this port, much of the volume is highly regular text and wiring that an agent can generate or transform in bulk. The hand-crafted code itself — scaffolding, constructors, platform glue — now gets generated in bursts, not typed line by line.
A human switching between the protocol layer, the data layer, and the rendering engine pays a context-loading tax every time. An agent that has read the whole 672-file repository pays it once. That asymmetry compounds quickly on a codebase this size.
Models convert person-months to calendar months via a staffing equation that assumes a human workday. Agent sessions run overnight. The commit histogram shows sustained output from 07:00 through 01:00 — 18 active hours, not 8.
The Empirical, Same-Author Calibration
Parametric models disagree by orders of magnitude, so I also ran an empirical cross-project calibration comparing my own code churn per person-day before and after adopting an agentic AI tool, on three other production repos in the same ecosystem:| Project | Pre-AI churn/dev-day | AI-era churn/dev-day | Multiplier |
|---|---|---|---|
| Project A (load balancer) | 673 | 2,056 | 3.1× |
| Project B (reporting service) | 239 | 2,127 | 8.9× |
| Project C (processing service) | 1,322 | 982 | 0.7× |
| Aggregate (avg / median) | — | — | 4.2× / 3.1× |
What This Means for Project Planning
If you are still estimating software projects with uncalibrated models and a 25-SLOC-per-day baseline, you will be wrong by one to three orders of magnitude on AI-assisted work. Here is what we do at RIADVICE:- Calibrate to your own history. Compare your own code output per person-day with and without AI. It is cheaper, more honest, and produces a 3–9× range you can defend in a project plan.
- Separate greenfield from maintenance. Agentic AI’s multiplier is largest on greenfield and structured development, smallest (sometimes negative) on mature-codebase maintenance. Do not apply one number to both.
- Budget for quality debt. AI velocity comes with persistent increases in complexity. Plan a hardening phase and instrument it — track cyclomatic complexity and run copy-paste detection on every release.
- Estimate the whole curve, not the front of it. A 10× velocity gain that doubles your defect density is not a 10× gain — it is a schedule pulled forward at the cost of a longer stabilization tail.
The Bottom Line
A project that every estimation model says should take 7 months to 47 years reached an alpha version ready for testing in 7 days. The 4,240× median multiplier should not become anyone’s project plan. But it is a clear signal that the duration of complex software development is being recompressed by the same force that is recompressing the effort. The published research shows AI delivering anywhere from a 1.26× nudge to a 20× surge, with a real risk of negative returns on mature codebases and a measurable quality tax. The models that told us this project should take decades are the same models still running in enterprise estimation spreadsheets today. The question is not whether agentic AI changes project duration — the research has answered that. The question is whether your estimation practice has caught up to the evidence. If your numbers still come from a 1981 model calibrated on COBOL and assembly, it is time to recalibrate — or at least to stop believing the calendar it prints out.“There is still significant room for improvement in order to better address the prediction challenges faced in practice.”
🏆 Trusted Engineering & Cloud Expertise
RIADVICE — Your Trusted Partner in Software Engineering
We design, build, and deploy complex software systems with the engineering discipline and tooling to deliver in the AI era — on time, on budget, and on quality.
Learn More About Our Services →📚 Sources & Further Reading
This article draws on peer-reviewed research, randomized controlled trials, and industry field reports on AI-assisted software development productivity and software effort estimation:
- AI Productivity Studies (RCTs and Field Experiments)
- Peng, S., Kalliamvakou, E., Cihon, P., & Demirer, M. (2023). The Impact of AI on Developer Productivity: Evidence from GitHub CopilotarXiv:2302.06590 — 55.8% reduction in task completion time
- Cui, R., et al. (2025). The Effects of Generative AI on High-Skilled Work: Evidence from Three Field Experiments with Software DevelopersMicrosoft Research — n=4,867, +26.08% completed tasks
- Dam, S., et al. (2024). How much does AI impact development speed? An enterprise-based randomized controlled trialarXiv:2410.12944 — Google RCT, n=96, ~21% reduction in time-on-task
- Becker, B., et al. (2025). Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer ProductivityMetr.org — RCT, n=16, 246 tasks; AI increased completion time by 19%
- He, H., Miller, C., Agarwal, S., Kästner, C., & Vasilescu, B. (2026). Speed at the Cost of Quality: How Cursor AI Increases Short-Term Velocity and Long-Term Complexity in Open-Source ProjectsarXiv:2511.04427 — DiD study of 807 GitHub repos; MSR ’26
- Evolver Business Solutions (2026). For a few tokens more — The productivity effect of AI tools on software development tasksReplication finding +13% (non-significant)
- Agentic AI Industry Reports
- Cognition AI (2025). Devin’s 2025 Performance Review: Learnings From 18 Months of Agents At Work10× ETL migrations, 14× Java migrations, 20× security fixes
- Nubank / Cognition. How Nubank refactors millions of lines of code to improve engineering efficiency with Devin12× engineering-hours, 20× cost savings on multi-million-line refactor
- BIS / Ant Group (2024). Field experiment; +55% code output, concentrated among junior staff
- Software Effort Estimation — Foundations and Accuracy
- Boehm, B. W. (1981). Software Engineering Economics. Prentice Hall — original COCOMO
- Boehm, B. W., Abts, C., & Chulani, S. (2000). Software Cost Estimation with COCOMO II. Prentice Hall — calibrated on 161 projects
- SEAA 2013. Accuracy of Contemporary Parametric Software Estimation ModelsCOCOMO II, SEER-SEM, SLIM, TruePlanning across 51 projects; MMRE 50–100%
- Kemerer, C. F. (1993). An empirical validation of software cost estimation modelsCommunications of the ACM
- Nguyen, V., et al. (2019). Determining relevant training data for effort estimation using window-based COCOMO calibrationWindow-based calibration across 341 + 93 projects
- Ahmad, M., & Wani, M. A. (2023). Evaluation of COCOMO Model Accuracy in Software Effort EstimationMMRE ~1.0, PRED(0.25) = 0.0
- Putnam, L. H. (1978). A general empirical solution to the macro software sizing and estimation problem. IEEE TSE — the Putnam/SLIM model
⚡ RIADVICE.com delivers trusted engineering, cloud expertise, and enterprise-grade software solutions — on time, on budget, and on quality.
