---
title: "BloggedBot"
description: "The crawler that reads public pages on your behalf, what it accesses, and how a site owner can ask to be excluded."
updated: "2026-08-18"
verifiedAgainst:
  - packages/shared/src/competitor-watch.ts
  - workers/lib/robots-policy.ts
  - apps/web/app/bot/page.tsx
---

BloggedBot is the crawler Blogged uses to read public web pages. It identifies
itself in every request:

```txt
BloggedBot/0.1 (+https://blogged.dev/bot)
```

## What it reads and why

<PropertyList>
  <Property name="Your own site, during setup">
    To establish what your product is, how it is positioned, and what it looks
    like. See [Sources](/onboarding/sources).
  </Property>
  <Property name="Approved sources, on refresh">
    To keep the facts behind your writing current. See
    [refreshing knowledge](/knowledge/refresh).
  </Property>
  <Property name="Approved competitor sites">
    To support comparison and [Competitor Blog Watch](/growth/competitor-watch).
  </Property>
</PropertyList>

## What it does not do

It reads pages a visitor could open. It does not sign in, submit forms, or reach
anything behind authentication, and it does not collect personal data from the
pages it reads.

## Limits

Reads are bounded: page budgets per ingest, a response size ceiling, a request
timeout, and cooldowns between runs against the same site. Competitor checks are
rate limited separately from full runs.

## Asking to be excluded

Site owners who would rather not be read can write to
[hello@blogged.dev](mailto:hello@blogged.dev). There is more detail, including
the public statement of what the crawler is for, at
[blogged.dev/bot](https://blogged.dev/bot).