Practice
Learn
← Quit
0 / 0 correct
System Design
Hard
1 of 10
Web crawler: how do you detect near-duplicate pages (same content, different URLs or small changes)?
A
Checking the HTTP status code
B
Content fingerprints such as SimHash/MinHash compared by Hamming or Jaccard similarity
C
Exact MD5 of the URL
D
Comparing URL lengths