LibGuides: Scraping Twitter: Example Scripts and Projects

Example Scripts for Scraping Twitter

A collection of sample scripts for use in harvesting Twitter data.

Using Tweepy:

A collection of scripts for various types of data collection
Another collection of scripts
A script to download a Twitter stream
Download all of a user's tweets into a .csv
Friends Scraper
An easy-to-use script to download a user's friends list to a csv.

Using Twython:

A collection of sample scripts for Twython

Studies Involving Twitter Scraping

A brief sampling of peer-reviewed projects involving Twitter scraping.

St Louis, Connie, and Gozde Zorlu. "CAN TWITTER PREDICT DISEASE OUTBREAKS?" BMJ: British Medical Journal 344, no. 7861 (2012): 24-25. http://www.jstor.org/stable/23235660.

Edelman, Benjamin. "Using Internet Data for Economic Research." The Journal of Economic Perspectives 26, no. 2 (2012): 189-206. http://www.jstor.org/stable/41495310.

Boullier, Dominique. "The Social Sciences and the Traces of Big Data: Society, Opinion, or Vibrations?" Revue Française De Science Politique (English Edition) 65, no. 5-6 (2015): 71-93. http://www.jstor.org/stable/revfranscipoleng.65.5-6.71.

Herdağdelen, Amaç. "Twitter N-gram Corpus with Demographic Metadata." Language Resources and Evaluation 47, no. 4 (2013): 1127-147. http://www.jstor.org/stable/42636390.

Sánchez-Querubín, Natalia. "Case Study: Webs and Streams – Mapping Issue Networks Using Hyperlinks, Hashtags and (Potentially) Embedded Content." In The Datafied Society: Studying Culture Through Data, edited by Schäfer Mirko Tobias and Van Es Karin, 95-106. Amsterdam: Amsterdam University Press, 2017. http://www.jstor.org/stable/j.ctt1v2xsqn.11.