Build a correct robots.txt: pick a mode, add disallow rules from presets or your own, and set the sitemap URL — the file assembles as you go.
Runs in your browser — data is not sent to a serverThe file goes in the site root: example.com/robots.txt. An empty Disallow directive means "everything is allowed". Clean-param is understood only by Yandex, so it is moved into a separate User-agent: Yandex section.
Character and pixel counts with a live Google snippet preview.
Word Frequency CounterTop words, bigrams, and trigrams in a text — with a stop-word filter.
XML Sitemap GeneratorPaste your URLs — get a ready-to-upload sitemap.xml file.
Open Graph GeneratorMeta tags for social networks and messengers, with a card preview.
We'll collect and tidy up website data: prices, products, contacts, reviews — in the format and at the frequency you need.