trump-archive-wayback

This repository contains a dataset that maps Trump's tweets to their representations in the Internet Archive's Wayback Machine. It uses the Trump Archive CSV export to look for each tweet in Internet Archive's CDX API. Care is taken to only match tweet URLs while allowing for URLs that use various query parameters. The snapshots directory contains a JSON file for each tweet id which contains all the archival snapshots.

For another approach see this this Jupyter notebook which uses the CDX API to fetch all the tweets independent of the Trump Archive database.

Run

pip install -r requirements.txt
./fetch.py