Text Data Mining

The Chronicling America API provides access to information about historic U.S. newspapers and millions of digitized newspaper pages and their OCR data is available for bulk download. See the full list of digitized newspaper titles (1836-1922) for more information.

The NOW corpus (News on the Web) has been created by Mark Davies, and it contains 19.4 billion words of data from web-based newspapers and magazines from 2010 to the present time. More importantly, the corpus grows by about 120-140 million words of data each month (from about 250,000 new articles), or about 1.5 billion words each year. Note: full-text data for this corpus is not available.

The Article Search API provides access to headlines, abstracts, lead paragraphs and more (but NOT full-text articles) from the New York Times, 1851 to present.

The datasets used for a deep learning project includes 90,000 CNN articles and over 190,000 Daily Mail articles downloaded from the Wayback Machine and available for bulk download.

API service that allows you to query online news sources from the past month including major publications such as the New York Times, ABC News, and Al Jazeera. Register for a free API key to get started.