producthabits.com

AI broke the defaults

2026-05-11 · 15:01 UTC ·Hiten Shah ·3 min read

Brief

Hiten Shah's newsletter "AI broke the defaults" (May 11, 2026) synthesizes recent research and practitioner notes showing how cheap AI creation is changing defaults across software, content, and organizations. Key findings include an Internet Archive sample estimating ~35% of new sites by mid‑2025 were AI‑generated/assisted (with semantic contraction and a positivity bias), Chicago Booth tests of four detectors on ~2,000 passages that fail for snippets under ~50 words, and a study finding ~380,000 vibe‑coded apps publicly reachable with ~5,000 leaking sensitive data via simple URLs. Shah frames agents as tool‑loop executors, warns Copilot‑style usage creates private learning trapped in loops, and cites Microsoft and survey data (13% rewarded for reinvention) plus Clay’s role‑plasticity as structural advantages in the AI era.

Why it matters

An Internet Archive–based study cited by Hiten Shah estimates that by mid-2025 about 35% of newly published websites were AI-generated or AI-assisted, producing semantic contraction and a positivity shift in web content.

Key details

  • Researchers found roughly 380,000 publicly accessible 'vibe-coded' apps, with about 5,000 leaking sensitive data via simple URL access—highlighting governance gaps as many production apps ship outside engineering/security review.
  • Chicago Booth researchers tested four AI-text detectors on roughly 2,000 passages and report that commercial detectors perform on medium/long text but break down for passages under ~50 words; Shah recommends using a policy cap (acceptable false positive rate) when evaluating detectors.
  • Shah highlights organizational impacts: an agent is usefully defined as 'runs tools in a loop toward a goal'; Copilot-style tools create private, hard-to-share productivity, Microsoft warns agents free humans to direct work but only 13% of workers say they're rewarded for reinvention, and Clay’s advantage stems from role plasticity.
Cleaned source text

Vibe-coded apps are leaking data, and the web is turning into paraphrases.

When you drop the cost of creating software and content, the failure modes change. These links made that feel concrete.

GitHub became the memory of open source

GitHub is where the context lives. Issues, PRs, releases, forks, and old debates stay findable long after a project stops shipping. Git makes code easy to mirror. Preserving the social layer is hard. If GitHub drifts away from maintainers, open source needs a real archive again.

AI is making the internet samey

This study’s punchline is simple. AI repeats. Using Internet Archive samples, the authors estimate that by mid-2025, about thirty-five percent of newly published websites were AI-generated or AI-assisted. They also find semantic contraction and a positivity shift. The internet keeps its accents. It loses range.

Agent is already losing its meaning

Agentic is spreading the same way AI did. The definition worth keeping stays simple. An agent runs tools in a loop toward a goal. Everything else turns into marketing sprawl. When nouns stop resolving, product claims blur and policy debates turn into vibes.

Everyone has AI now. The company still learns nothing.

Robert Glaser nails the pattern. Copilot exists everywhere, but usage becomes private and hard to compare because it lives inside loops like code reviews, incidents, proposals, and prototypes. Leadership sees activity and asks for ROI. Meanwhile, discoveries stay stuck with individuals. Seats create output. Loops create advantage.

AI detectors work until the text gets short

Chicago Booth researchers tested four detectors on about two thousand passages. Commercial tools held up on medium and long text, then fell apart under fifty words. That matters because the fights happen around snippets. The useful idea is the policy cap. Pick the false positive rate you can tolerate, then evaluate tools inside that constraint.

AI agents expand human agency. Most orgs waste it.

Microsoft has a framing I like. As agents take on execution, humans get more room to direct work and own outcomes. The bottleneck is incentives and management behavior. Only thirteen percent of workers say they are rewarded for reinvention even if results are missed. That is how you get private productivity and public stagnation.

Vibe coding is cheap until you touch real data

A one-page site is low stakes. Add logins, forms, bookings, or payments, and you are handling liability. The danger is invisible failures non-devs miss, like plain text passwords, broken auth, leaky integrations, and missing permission checks. Production only cares about the blast radius.

The new S3 bucket is vibe-coded apps

Researchers found roughly 380,000 apps built with vibe-coding tools publicly accessible, with about five thousand leaking sensitive data. The mechanism stays boring. Just typing the right URL. The deeper problem is governance. People ship production apps outside the engineering and security cycle, with no review and no owner until someone emails a screenshot of a leak.

Your career is becoming a context supply chain question

This piece has a blunt framing that sticks. Innovators create context. Marketers sell it. Context carriers move it. AI augments creation and distribution, then automates the middle work that used to move context around inside companies. The squeeze lands on the roles that kept things connected.

Clay’s real advantage was role plasticity

Typically, companies hire you into a box and then measure you against the box. Clay kept reshaping the box to fit the spike. Find spiky talent, build the role around the spike, and let irreplicable work emerge. This is why competitors struggle to copy the output because they lack the person and the structure behind it.

Talk soon,

Hiten =)

Copyright © 2026 Up Advisors, LLC., All rights reserved.

You received this email because you signed up to get emails from Product Habits.

Our mailing address is:

Up Advisors, LLC.13337 South St. #269Cerritos, California 90623

Add us to your address book

Want to change how you receive these emails?