I have a webcrawler/scraper that's written in Python using the scrapy framework. I've been trying to use the "last-modified" date to identify the most recent update for each page - but I also collect each HTML file for the pages that are scraped. Is there a more accurate method for collecting the date each page was most recently updated?
与恶龙缠斗过久,自身亦成为恶龙；凝视深渊过久,深渊将回以凝视…
