Download

Web Parser

Website crawler with AI processing on every page. Follows internal links, extracts text, sends it to AI with your prompt. Output in text, JSON or CSV. Pause/resume, queue, spider trap protection.

What you get

1

Structured data extraction

Product catalogs, contacts, job listings — AI pulls the fields you need into JSON or CSV, ready for analysis.

2

Scale without manual labor

The parser crawls thousands of pages automatically — you get results instead of sitting with copy-paste.

3

AI understands context

Unlike CSS selectors, AI extracts data by meaning: "find the price, even if it is in a non-standard format."

4

Pause and resume

A large site with 10,000 pages? Pause, shut down the computer — continue from where you left off tomorrow.

5

Works without AI

The parser collects the text of every page even without an AI provider — useful for content backup or migration.

6

Bypass restrictions

Proxy support lets you parse foreign or protected sites through an intermediate server.

7

Spider trap protection

Spider trap detection prevents infinite crawling of cyclical URLs — the parser never gets stuck.

8

Task queue

Multiple jobs run sequentially — add them to the queue and move on to other work.

9

Speed control

Rate limit is configurable — from a polite 1 req/s to aggressive parsing, depending on the site.

10

Crash recovery

If the app restarts, unfinished jobs resume automatically.