Practice
Learn
← Quit
0 / 0 correct
System Design
Medium
1 of 20
Web crawler: why cache DNS results inside the crawler?
A
It is required by robots.txt
B
To avoid HTTPS
C
DNS results never change
D
DNS lookups add latency to every fetch and can bottleneck throughput at billions of pages