Detects duplicate or similar main content between two URLs using shingle-based analysis — filtered for template noise, boilerplate, and navigation text.