How to make ARCH datasets from the Wayback Machine

Overview

ARCH can produce datasets from data in the Wayback Machine collection (archive.org/web) by arrangement with Internet Archive staff. 

🙋 Ready to get started? Contact the ARCH team here.

Screenshots of the same archived website in the Wayback Machine (left) and ARCH (right)

Retrieving data from the Wayback Machine collection requires either a URL (example.com) or SURT (com,example) prefix. One or more prefix may be used to curate a custom collection of primary sources. The subsequent ARCH collection may optionally also be constrained by time range and filtered by status and/or MIME.

Please note that data in the Wayback Machine collection may only be available to ARCH for extraction after approximately 6 months, depending upon the location/s. Consult with Internet Archive staff on the most current available data for your needs.