Practice
Learn
← Quit
0 / 0 correct
System Design
Hard
1 of 535
Web crawler: how do you detect near-duplicate pages (same content, different URLs or small changes)?
A
Exact MD5 of the URL
B
Checking the HTTP status code
C
Comparing URL lengths
D
Content fingerprints such as SimHash/MinHash compared by Hamming or Jaccard similarity