MARIO + AIK / WEB SPACE Stay curious. Keep thinking.
Mario and AikMario & Aik Space
Small experiments. Human direction. AI assistance.
← All notes

ZETTELWIRTSCHAFT / 052 · PROJECT JOURNAL

sitemap.download: from crawl to clean XML

A small website tool grew from an XML generator into a practical guide to discovering, reviewing and publishing a site map.

Note published · Project timeline ↓

sitemap.download homepage with the URL and image options beside an idle dark crawl monitor.
sitemap.download · Homepage captured 6 November 2026. English. The monitor is idle; no visitor crawl data is shown. Current appearance, not the first release.

A practical brief

On 16 September 2026, Mario brought a technical specification and a newly registered domain: sitemap.download. The idea was a free, independent tool that accepts a website address and produces an XML sitemap, with no user account required. The first implementation and public release followed that day. The website is available in English.

Watch a map take shape

The interface puts crawl configuration beside a live monitor. Visitors choose page URLs or images, start from a public address and watch the page attempts and discovered links accumulate. The browser manages the crawl and creates the XML; a lightweight Cloudflare Worker proxy retrieves page content. This distinction matters: page requests travel through the service even though the result list is held in the browser tab.

A useful result has boundaries

The crawler follows HTML links on the same origin and stops after at most 1,000 page attempts, including unsuccessful requests. It cannot promise a complete inventory of content that only appears after JavaScript runs, requires a login or has no discoverable link. Available partial results can still be reviewed. Since November, visitors can deselect pages before downloading; image output is selected by page together with its associated image references.

The download is only one step

A guide explains how to review and publish the XML. The searchable FAQ grew to 59 questions in eight categories, each with its own page. Six further knowledge sections cover XML examples, common errors, existing platform sitemaps, website moves, multilingual sites and a fifteen-term glossary. Copyable examples turn explanations into something readers can use.

Explain the tool as carefully as building it

The October redesign brought a darker crawl monitor and a more technical layout. Subsequent writing makes the limits explicit: a sitemap can support discovery, but cannot guarantee indexing or a ranking. Crawl results are temporary tab data, and leaving the page clears that session. Mario directs the project and retains editorial responsibility; Aik is his AI assistant, helping with the interface, implementation, tests and explanatory content.

Project timeline

Project milestones are separate from this note’s publication on 6 November 2026. Dates follow the project records and Europe/Berlin calendar.

  1. Project brief

    Mario supplied the technical specification and introduced the newly registered sitemap.download domain. The public interface was planned in English.

  2. First local implementation

    The page and image sitemap modes, progress monitor, stop control and XML download were built with a browser-managed crawler and a Cloudflare retrieval proxy. The initial limit was 500 page attempts.

  3. First public release

    The generator was published under sitemap.download. The release record confirms HTTPS, the public interface and a real page retrieval through the proxy.

  4. Technical redesign and a larger limit

    A darker crawl monitor, revised layout and separate sitemap guide went live. The limit rose to 1,000 page attempts and the social preview was updated.

  5. Review before downloading

    A selectable result list, expanded guide and after-download instructions were published. The FAQ then grew to 59 searchable questions in eight categories, with individual answer pages.

  6. A practical knowledge collection

    Six knowledge sections added XML examples, error diagnosis, platform guidance, migration, multilingual sitemaps and a fifteen-term glossary. The release record counted seventy URLs in the site’s own sitemap.

Reconstructed from dated project conversations, local reviews and release records. Earlier ideas are dated only where documented.

Explore sitemap.download — English ↗