websites.new

What Ships · Evidence

AI code vs human code: what the difference looks like on a live website.

Free assessment01 / 02

Step one · Your website

Which website should we assess?

Public pages only. No login, no code installed, no obligation. The report link is unlisted and emailed once. Three checks per hour per connection. Read the privacy policy.

You are deciding whether AI-written code is acceptable for your site. This page gives you the studies, translated into what you can see on a live page, and a way to check your own site. The assessment reads your public pages only. It does not log in, read analytics, or see who wrote your code. So it has no way to guess.

Two hands laying bricks into one wall under a magnifying lens
The wall does not say who laid which brick. The lens reads the wall.
On this page 11 sections
  1. 00Key takeaways
  2. 01What is the difference between AI-generated code and human code?
  3. 02What do studies say about the quality and security of AI-written code?
  4. 03What does AI-written code look like once it is a live page?
  5. 04Can you tell from outside whether a site was AI-built?
  6. 05Does it matter who wrote the code if the page works?
  7. 06What should you review in AI-written code before it ships?
  8. 07How do you check a site's condition regardless of who wrote it?
  9. 08Questions, answered
  10. 09Check your own site
  11. 10About the author

Key takeaways.

  • The public read judges what your page ships to a browser, not whether a person or a model wrote the code.
  • Studies disagree on the size of the gap, so treat defect and vulnerability rates as risk signals, not verdicts on your site.
  • Request your homepage and read its response headers: in the Tenzai test, none of 15 AI-built applications set any security headers.
  • Run the free assessment on your site: about two minutes, one score out of 100, and evidence behind each of eight pillars.

What is the difference between AI-generated code and human code?

The only difference you can count on is authorship: a model wrote one from a prompt, and a person wrote the other. View your page source and you'll find HTML, CSS, JavaScript and response headers. No byline. No watermark. Your browser can't tell who typed it, and neither can you. (Try it on a page you think you can spot. You'll be guessing.)

You can judge the output itself: your rendering model, script weight, heading order, structured data and response headers. Each traces back to a decision you can inspect. A model decides from your prompt; a person decides from the project. Either one can decide well or badly. And your page shows which.

As you read the studies in the next section, ask what each one means for your pages. A defect rate in a pull request describes a repository, not your site. A missing header on your homepage? That describes your site, and you can fix it. So run the free assessment and see what your pages ship.

What do studies say about the quality and security of AI-written code?

The studies you will find mostly say AI-written code carries more defects and more security findings than human-written code, though the gap changes with the study. CodeRabbit's review of 470 open-source pull requests found 10.83 issues per pull request for AI code against 6.45 for human code, or 1.7 times more defects. Its table put cross-site scripting flaws at 2.74 times higher.

Veracode's 2025 study of 100+ LLMs found a 45% overall vulnerability rate. On cross-site scripting, the failure rate hit 86%. Tenzai then tested 15 applications built with Cursor, Claude Code, Replit, Devin and OpenAI Codex, five different tools, and none implemented CSRF protection or set any security headers. Five tools, one shared blind spot.

Not every result points the same way. One analysis of public GitHub repositories found 87.9% of AI-generated code has no identifiable CWE-mapped vulnerability, and an arXiv study found human code more duplicated, at 25.89% against 18.69%. Read these as risk signals about repositories. They are not verdicts on your site, and a repository is not a page.

What does AI-written code look like once it is a live page?

Once live, your AI-written code is whatever your build sent to the browser: a rendering model, scripts, headers and markup. Request your homepage and read your response headers (your browser's network tab will do). In the Tenzai test, none of the 15 applications set any security headers. Check whether yours did.

The studies cannot show you these, but your page can. View your source and check whether your content is in the HTML or arrives only after your scripts run. Weigh your scripts and images. Read your heading order and look for structured data, then open your robots file to see what crawlers may fetch. And none of this needs a login.

The assessment reads your homepage and up to eight sampled pages for the signals you checked. It cannot see your repository, so you will not learn about duplicated logic or made-up packages. What shipped? That you can learn, and it is the part your visitors meet. The rest stays in your repository, out of reach.

Can you tell from outside whether a site was AI-built?

No, you cannot tell reliably from outside. A public read of your site shows what your pages ship, not who wrote them. Open your page source and look for a pattern such as thin headers, a heavy script bundle or no structured data. But a rushed human build leaves the same marks. The pattern proves nothing about who wrote your code.

Authorship evidence sits in your repository, not your browser tab. GitClear's 2026 report tracks copy-pasted code, which rose from 9.4% of new code in 2022 to 15.7% in the first half of 2026. Count what share of your own new code you pasted. The arXiv study tracks revisits within 30 and 90 days. To see either, you need your commit history (the one thing your browser never receives). That is your blind spot.

If a tool claims to detect AI authorship from your live page, doubt it. Score your rendering model, headers, markup and crawler access instead, and let the result stand whoever typed your code. The free assessment runs that read on your own site and shows you what you ship. Evidence beats a guess about authorship.

Does it matter who wrote the code if the page works?

Not much, if "works" means more than "loads." Your visitors and crawlers judge what your page ships, not who typed it. And your page can render fine in your browser while still shipping no security headers, hiding your content behind scripts, or blocking crawlers in your robots file (it happens more than you'd think). So before you call your site finished, check your headers, your scripts and your robots file.

Author does matter for what happens next, so hold your own review habits against these numbers. Stack Overflow's 2025 Developer Survey found trust in AI tool accuracy fell to 33%, down from 43%. Yours may have dropped too. Second Talent reports that 71% of developers do not merge AI-generated code without manual review, and 66% spend more time fixing almost-right output. Do you review yours that way? LeadDev, citing Google's DORA report, says every 25% of additional AI usage creates 7.2% more instability. So check yours. Would you merge your own AI output unread?

Your visitors and crawlers see only your page, never your author. But if you cannot explain why your code does what it does, you cannot trust your next change. Your page works by luck, and luck runs out (usually on a deploy day). Run the free assessment on your site to see what your page ships to your visitors.

What should you review in AI-written code before it ships?

Check your diff against the core of SiteGround's checklist: your scope, unrelated edits, duplicated logic, new dependencies, and whether you can explain your change. Then decide. Keep it, refactor it, revert it, or escalate. Open your tests first. SpecStory notes that an agent can pass your suite by editing your tests (yes, really), so a green run proves less than you think.

Run your linters, type checker, security scanner and tests, as Real Python's five-step workflow has you do. Then confirm that every method and import in your diff exists, and that every dependency you added is a real, published package. You'll miss made-up APIs and packages by eye, because they read fine. But they fail at install, and they are a common AI failure.

Vibe Coder Blog says Veracode's 45% vulnerability figure drops to under 10% when you apply a structured review process. Treat that as a secondary-source claim, not a guarantee for your team. And code review can't show you what your site sent the browser, so run your page through the public read.

How do you check a site's condition regardless of who wrote it?

Run the free assessment on your site's URL, and you get a score out of 100 whoever wrote your code. It reads your homepage and up to eight sampled pages. Enter your address and your work email. Your report link arrives once, in about two minutes. And you can run three checks per hour per connection, so rechecking after your fix is fine.

Your score weights eight pillars: operational health 16%, architecture 15%, performance 15%, security 12%, search 12%, schema 10%, AI readiness 10% and editorial experience 10%. Each pillar comes with its evidence. So you see which header, script or heading on your pages earned the number.

Your bands show where you stand: 80 to 100 is good standing, 60 to 79 constrained, 40 to 59 at risk, and 0 to 39 legacy condition. The read does not log in to your site, read your analytics, use your field performance data or interview you. It judges your page and leaves the author out of it. If your AI tool wrote your site, you get the same read as if you typed every line (no discount, no penalty).

Questions, answered.

01Is AI-generated code worse than human code?

Studies disagree on how large the gap is. CodeRabbit found 1.7 times more defects in AI-generated pull requests, while one GitHub analysis found 87.9% of AI-generated code had no identifiable CWE-mapped vulnerability. Your own result depends on review. And the page you ship shows the outcome however the code was written.

02Can the assessment tell me if my site was built with AI?

No. The assessment reads public signals such as headers, markup, structured data, headings, script and image weight, and robots and canonical signals. None of them name an author. It scores your site's condition, so the result holds whether a person, a model or both wrote the code. The page is the evidence.

03Does the assessment review my source code or repository?

No. It reads what your site serves publicly: the homepage plus up to eight sampled pages. It does not log in, read analytics, or see your repository, so it cannot judge duplicated logic, made-up packages or test quality. For those, use a code review checklist before you merge. That is a different job (and a different tool).

04What does the free assessment cost and how often can I run it?

It is free and takes about two minutes. You enter your site address and a work email, and the report link is sent once. You can run three checks per hour per connection. So if you fix something, you can recheck within the hour.

  1. 01Website repairDown, hacked or broken: what survives, what to rebuild.
  2. 02Website health checkThe general read, all eight pillars.
  3. 03Next.js SEO auditRendering mode, metadata, hydration cost.

Sources

Facts on this page come from the documents below, checked on 2026-10-25. Figures about the assessment itself describe how it works.

  1. AI-Generated Code Quality Metrics and Statistics for 2026 | Second Talent
  2. AI Code Quality 2026: 70% More Bugs, Trust Falls to 33%
  3. AI-Generated Code Incidents: What the 2026 Data Shows
  4. Security Risks in AI-Generated Code and How to Mitigate Them - SoftwareSeni
  5. Vibe Coding Security: Why 62% of AI-Generated Code Is vulnerable
  6. AI-Generated Code Security Risks - Why Vulnerabilities Increase 2.74x and How to Prevent Them - SoftwareSeni
  7. A Large-Scale Analysis of Public GitHub Repositories
  8. Code maintainability plummets in the AI coding era - LeadDev

About the author.

Gautam Khorana

Gautam Khorana

Web engineer and founder: 12+ years on thousands of websites of every shape and size, from WordPress to the modern web. Built and runs the free assessment this site is made of, and writes What Ships from what sites actually ship.

· LinkedIn · About the assessment

More from What Ships.

  1. 01The best vibe coding tools in 2026, judged by what they ship.Tools · 2026-10-25
  2. 02The best AI website builders, by what their sites score.Builders · 2026-10-25
  3. 03Lovable vs Bolt vs v0: what each one ships.Head to head · 2026-10-25

Two minutes from now

See what your site ships.