← Quit0 / 0 correct
Web crawler: what component decides which URL to fetch next while respecting per-host politeness?
seed ─▶ URL frontier ─▶ fetchers
▲ (per-host queues) │
│ ▼
dedup ◀─ link extractor ◀─ parser