Paul's compliance scanner: use Firecrawl, don't build the crawler
'I had a client that got a demand-letter lawsuit because they were out of compliance with some obscure California law.'
Paul's scanner needs to read a whole site - pixels before consent, ADA issues, licensing - and Claude had drafted a full architecture: React/Vite front end, a containerised Node + Playwright headless-browser worker on Render, a Supabase edge-function proxy, loosely coupled JSON so any check can be swapped. Dileep's second opinion: the crawling half is a solved product. Firecrawl.dev has search, scrape and crawl modes, its own MCP server and APIs, and returns markdown, a summary, a screenshot, the HTML and the links per page - he demoed it on apple.com. Free tier: 1,000 page credits a month; pricing scales for client volume and is 'the best I've seen'. Apify is the alternative MCP. Keep the swappable-checks design; point it at Firecrawl output instead of your own Playwright fleet. Lovable for the front end integrates with GitHub and Supabase - just change fonts, colours and copy when starting from a cloned design.
Paul's own product, with its architecture reviewed on air; the scanner is the Technology On Call compliance offer.





