My audit method · Yana Yeromina · 2026

An AI that audits like a senior designer. Almost.

This is how I audit, written down so precisely that an AI can follow it. I turned my method into a skill for Claude: it researches who the product is for, walks the key tasks, checks the fundamentals like a QA tester, and writes a report where every finding has a screenshot and a source. Then I tested it the way I'd test any product, and found the part it can't do without me.

AI tooling UX audit method Claude skill NN/g research WCAG 2.2 AA

UX audit · Standard depth · 10 October 2026

The Hacker News: for security practitioners

Site
thehackernews.com
Audience
Security practitioners
Devices
375, 834, 1366, 1920 px
Auditor
Claude, ux-audit skill

Strong reporting, weak wayfinding and trust signals

The journalism serves practitioners well: vulnerability stories give the CVE, severity score, exploitation status and fixed versions, and link the vendor advisory. The site around it gets in the way.

0Catastrophe
6Major
4Minor
4Cosmetic

Top 3 issues

  1. Search sends readers to a Google page, outside the site
  2. Sponsored stories look like news
  3. The newsletter sign-up ticks hidden opt-ins for a lead-generation partner
Role
Designer and product owner
Timeline
10 days, 5 review rounds
Built with
Claude Code, Python, headless Chrome
Grounded in
NN/g research, WCAG 2.2 AA

The short version

A good UX audit takes a senior designer days. Two designers will also find different things.

Understanding the audience, walking the tasks, checking hundreds of details, finding evidence for every claim, and writing it up so product managers and developers act on it: that's the job.

I wanted to see how much of that an AI could do reliably if it had a real method and real research behind it, not just "look at this page and tell me what's wrong".

The skill is a set of instructions, references and small tools that Claude follows step by step. I wrote the method; the knowledge comes from Nielsen Norman Group's published research, summarised in my own words.

The method, in seven steps

  1. ResearchWho the product is for, in its own words (About, Advertise, Pricing pages), its business model and top tasks.
  2. Real screens375, 834, 1366 and 1920 px, not one default size.
  3. Structure firstNavigation, contexts and the main action on each screen.
  4. Walk the tasksAs the real audience, including sign-up and change tasks.
  5. QA pass33 fundamental checks on every audit: every link, search, Back, forms, 404, speed, keyboard.
  6. Rules and evidence275 rules; every finding cites a specific article or WCAG criterion.
  7. ReportSeverity, a marked screenshot for every finding, and a coverage table.

The knowledge base

research articles indexed
1,766
article notes in my own words
418
audit rules in 17 areas
275
QA checks on every audit
33

Guardrails

  • No invented sources. It never cites a source that isn't in the index. A made-up link stops the build.
  • View only. It never submits a form, buys anything or enters credentials.
  • Research and opinion kept apart. Its own rules of thumb are labelled as recommendations, not research.
  • Honest credit. Reports say "Expert review pending" until a person has reviewed them.

I gave the skill one line, "Audit the UX of thehackernews.com", in a fresh session with no hints.

The Hacker News is one of the largest security news sites, read by millions of professionals. The skill researched the audience first, then walked the tasks a security practitioner comes with: see what's urgent today, look up a CVE or a vendor, follow a story to the vendor's advisory.

The result is one report that a product manager can read in ten minutes and a developer can act on: 14 findings, grouped into structure, interaction and surface, sorted by severity, each with a marked screenshot. Its main parts follow.

First, who the site is for

Before auditing, the skill researched the audience. The site's own Advertise page names security researchers, incident responders and DevSecOps teams.

Audience
Security practitioners. The site says it reaches "over 35 million security professionals each year" and names "security researchers, incident responders, DevSecOps teams".
Business model
Advertising and sponsorship, plus lead generation through eBooks and the newsletter. Success means page views and sign-ups; the tension is paid content against reader trust.
Top tasks
  1. See what's new and urgent today
  2. Look up a CVE or vendor
  3. Check whether a story changed
  4. Follow a story to the vendor advisory
  5. Sign up for the newsletter
Conventions
Two competitors skimmed: both keep search on their own site and label paid items "Sponsored".

A score for each of Nielsen's ten heuristics

Showing the 3 weak heuristics.

Nielsen's ten usability heuristics, the status the audit gave each, and why
HeuristicStatusWhy
Visibility of system statusWeakInvisible keyboard focus; story updates undated; a heavy homepage.
Match with the real worldNeeds workPractitioner vocabulary is spot on; paid content isn't called paid.
User control and freedomNeeds workSearch and new tabs pull readers off the site.
Consistency and standardsNeeds workPhone and desktop navigation differ; search works unlike competitors'.
Error preventionWeakPre-ticked hidden opt-ins.
Recognition rather than recallNeeds workTopics hidden on phones; card labels aren't links.
Flexibility and efficiencyNeeds workNo keyboard path to search; no newest-first default.
Aesthetic and minimalist designNeeds workClean cards, but endless motion in the header and thumbnails.
Recognise and recover from errorsWeakThe 404 page is a dead end.
Help and documentationStrongAbout, contact and tip-off routes are easy to find.

Every finding: evidence first, then the fix

Search takes readers off the site to a Google page

3 · Major
  • A04 Search
  • A02 Navigation
  • H3
  • H4
  • Jakob's law
  • Quick win
The Hacker News header at 1366 px, with (1) the search icon marked
Header at 1366 px. (1) The header search. It doesn't search inside the website; it sends the query to Google.
What a search for netscaler opens at 1366 px: (1) a Google Programmable Search page with only a small THN logo, (2) results sorted by relevance
What a search for "netscaler" opens, at 1366 px. (1) cse.google.com: no THN header, sections or footer, only a small logo. (2) Results by relevance: the newest critical NetScaler story (Oct 9) is fifth.
Where
The search icon in the header on every page, desktop and phone
What happens
A normal search ("netscaler") is sent to google.com/cse, and readers land on an external Google page: a different design, a browser tab titled "Programmable Search Engine", no THN menu, sections or footer. The site does have its own search page, but the header search doesn't use it. Results are sorted by relevance, so the Oct 9 story about a CVSS 9.5 flaw comes fifth.
Evidence
<form action='https://www.google.com/cse' id='searchform'>
Why it matters
Search is the practitioner's fastest route to "what's the latest on this CVE". Being dropped onto an unbranded third-party page breaks the sense of place and makes it harder to get back to browsing. Two competitors keep search results inside their own layout.
Fix
Point the header search at the site's own search, Blogger's /search?q=, or embed the Google results inside a THN page with the normal header and footer. Default news results to newest first, with relevance as an option.
Sources
Universal Navigation: Connecting Subsites to Main Sites 2016Search: Visible and Simple 20017 Ways to Improve Your Website's or Intranet's Built-In Search Engine 2016

Coverage: nothing is skipped silently

The 33 fundamental checks run on every audit, whatever the audience. Each one is marked, including the two it didn't get to.

Showing the 15 failed checks.

The 33 baseline checks and the result of each on thehackernews.com
CheckResultNote
B01Every header, nav and footer link lands where its label saysPassAll 14 menu and footer links open the page their label promises. (The Free eBooks site blocked the automated check.)
B02Logo links home from every pagePassClicking the logo always returns home, even from the error page and the Google search page.
B03"Where am I?" on inner pagesPartialSection pages have matching titles, but the menu doesn't show which section you're in.
B04Leaving the site is expected and labelledFailSearch, the newsletter and paid stories take readers to other websites without saying so.
B05New tabs are consistent and markedFailSome links open a new browser tab (“Expert Insights”, paid stories) and others don't. Nothing warns you which will.
B06Back returns to the previous pagePassGoing from a section to an article and pressing Back works. Whether it keeps your place on the page wasn't checked.
B07Footer safety netPassThe footer has About, Contact, Advertise, Privacy and RSS, but no links to the topic sections.
B08Search is visible and keyboard-reachableFailSearch is only a small icon, and it can't be opened with the keyboard.
B09Search results stay inside the siteFailResults open on a Google page without the site's menu or sections, so readers lose their place.
B10Common and top queries find the best match firstPartialOne test search (“netscaler”): the newest critical story came fifth, not first.
B11Typo and pluralNot checkedOnly one search was run, so misspelt and plural words weren't tried.
B12No-results page offers a way forwardNot checkedNot tried: what readers see when a search finds nothing.
B13Sort and filters fit the contentPartialThe Google page has a small “Sort by” option, but it sorts by relevance, not newest first.
B14Dates and update notesFailA headline still says “Unpatched” after fixes came out, and story updates carry no date.
B15No broken bitsPassNo broken images or leftover placeholder text on the pages checked.
B16Ads and paid content are labelledFailPaid stories look like news: nothing says “Sponsored”, and the sponsor's name sits where the date usually is.
B17About, contact, privacy easy to findPassIn the footer and the ☰ menu; the About page gives an email address.
B18Cookie / consent banner is fairN/aNo cookie banner appeared from the test location, so there was nothing to judge.
B19Fields have visible labelsFailThe newsletter field's only hint is grey text that disappears as you type, and the send button is an arrow with no words.
B20No hidden or pre-ticked opt-insFailTwo newsletter checkboxes are ticked in advance and hidden, so readers agree to things they can't see.
B21Form posts to the site or a named partnerFailThe newsletter form sends your email to a lead-generation company, and nothing near it says so.
B22Validation of empty required fieldsPassSending an empty email is blocked by the browser. (The form itself was never sent.)
B23Helpful 404 pageFailA broken link shows a page with no message and no way back to the stories.
B24Empty and loading statesN/aNone of the pages checked had lists that load in or can be empty.
B25Every width: no horizontal scroll or overlapPassNo sideways scrolling or overlapping at 375, 834, 1366 and 1920 px wide.
B26Touch targets on phoneFailOn phones the social icons are about 22 px and close together, so it's easy to tap the wrong one.
B27Sticky elements don't cover contentPassNothing stays pinned over the text; the share buttons sit in the left margin.
B28Speed / page weightFailThe homepage downloads 4.4 MB, mostly one animated ad image. An article is about 0.2 MB.
B29Layout shiftPassPages don't jump around while they load.
B30Keyboard access and focusFailKeyboard users can't see where they are: nothing highlights the focused link, and there's no “Skip to content” link.
B31Automated scan (axe)FailAn automated accessibility scan found errors on articles and on the phone homepage: low contrast, an unnamed link, small tap targets.
B32Page basics: lang, one H1, titles, landmarksPassEvery page declares its language, has one main heading and a unique title, and is split into clear regions for screen readers.
B33Motion: pause and reduced motionFailThe header slogan animates forever, even when the device asks for less motion, and there's no pause button.

Accessibility, WCAG 2.2 AA: 8 criteria failed, mostly for keyboard users

Operable

5 failed

Can people use it with a keyboard, without a mouse, without being rushed?

  • 2.1.1Keyboard: search can't be opened without a mouse
  • 2.4.7Focus visible: nothing shows where focus is
  • 2.2.2Pause, stop, hide: the header slogan animates forever
  • 2.4.4Link purpose: an image link with no name
  • 2.5.8Target size: social icons too small on phones

Perceivable

1 failed

Can people see the content?

  • 1.4.3Contrast: white on light-blue share buttons, 2.82:1

Understandable

1 failed

Is it clear what to do?

  • 3.3.2Labels: the newsletter field's only label is a placeholder

Robust

1 failed

Can screen readers understand it?

  • 4.1.2Name, role, value: the search toggle and menu button are unnamed

The barriers concentrate in Operable: a keyboard user can neither see where they are nor open search. Press Tab on any page to see it.

I re-checked the boldest claims on the site myself. They held.

You can check them too, in about a minute each. As observed on 10 October 2026; sites change.

The Google search page that the site's header search opens

Search leaves the site

How to checkType anything into the search on thehackernews.com: the results open on a Google page, without the site's menu or sections.

The homepage feed with three items marked: a vendor's contributed piece dated like news, and two paid placements with the sponsor's name where the date usually is

Sponsored stories look like news

How to checkScan the homepage feed: some items are paid placements, and nothing says "Sponsored". The vendor's name sits where the date usually is.

The newsletter box with one visible email field marked

The newsletter form has hidden, pre-ticked options

How to checkView the page source and search for opt_001: two checkboxes are ticked by default and hidden from view, and the form sends your email to a lead-generation company.

The main navigation with keyboard focus on Vulnerabilities, and nothing on screen showing it

Keyboard focus is invisible

How to checkPress Tab a few times on any page: focus moves, but nothing on screen shows where it is.

Every report the skill produced was accurate: when I re-checked its claims on live sites, they held.

But accurate isn't the same as good. Each time I reviewed a report as the expert, I found something it couldn't see on its own, and each time I turned that into a change to the method.

Round 1 of 5

What I caughtIt reported a deliberate brand animation and an honest "work in progress" label as defects.

What changedIt now judges motion by its cost to the user, and treats work in progress as a content choice.

The blind test: same site, three runs, one day

Six issues across the three runs. The number on each run is how many of them it found.

Which issues each of three runs found on The Hacker News
Issue on The Hacker NewsRun 1Run 2Run 3
Search leaves the site for GoogleFoundBuriedFound
An ad fills most of the phone's first screenFoundMissedMissed
A floating Share button covers article textFoundMissedMissed
Key facts start below the first screenMissedFoundMissed
Vendor tags are hidden and incompleteMissedFoundMissed
A headline still says "Unpatched" after the patchMissedMissedFound

Each run found 11 to 14 issues. Together they found about 25. A single run catches roughly half of what the skill is capable of finding, and a different half each time.

"It's a good example of how AI can work with an expert, and why it can't stand alone."

The skill

  • Breadth. Every link, contrast in both themes, hidden form fields, four screen sizes, in one run.
  • Evidence. Measured numbers, marked screenshots and a source for every claim.
  • Speed. Hours of checking done in minutes.
  • Discipline. It re-checks surprising results and drops its own false alarms.

The designer

  • Framing. Deciding who the audit is for and which task matters most.
  • Priority. Knowing a buried basic problem outranks a clever specialist one.
  • Noticing absence. What isn't on the page at all.
  • Consistency. Judging whether the report tells the true story, not just a list of defects.

The skill made me faster and more thorough. It never made me unnecessary.

The most valuable thing it produced wasn't a report. It was a clear picture of which parts of a senior designer's work are method, and which are judgement.

What's next

Independent project, not affiliated with or endorsed by Nielsen Norman Group or The Hacker News. Guidance is drawn from Nielsen Norman Group's published articles and the W3C Web Content Accessibility Guidelines 2.2. The research notes and rules are private.