Text Data Mining

arXiv, from Cornell University, is an open access research sharing platform open to anyone. arXiv.org hosts more than two million scholarly articles in eight subject areas: physics, mathematics, computer science, quantitative biology, quantitative finance, statistics, electrical engineering and systems science, and economics. Access to bulk data is also open, with certain stipulations.

Develop applications, products or services based on the corpus of searchable research papers.

CORD-19 is a corpus of academic papers about COVID-19 and related coronavirus research. It's curated and maintained by the Semantic Scholar team at the Allen Institute for AI to support text mining and NLP research.

Python tool for downloading/updating/maintaining a repository of all PLOS XML article files. Use this program to download all PLOS XML article files instead of doing web scraping.

Data for Research allows you to download word frequencies, citations, key terms, and ngrams for up to 25,000 JSTOR articles at a time, or to easily submit requests for larger sets of articles. See also:

• Request a Dataset: if you need more documents than Constellate can provide, you can request a custom dataset.
  
• JSTOR DfR in GitHub A number of Python and R packages to work with JSTOR DfR data.
  
• JSTOR's Text Analyzer, a reverse search engine that analyzes documents that you upload (your own, or other articles) to find related materials in JSTOR.
  
• Public domain and OA datasets include full OCR text from early journals and current academic press open access titles.

The General Index is an open-access collection of n-grams (words and phrases) and metadata from over 100 million journal articles to support text mining. Articles include both open access and paywalled content, available here as derived data (not human-readable text).

PubMed Central® (PMC) is a free full-text archive of biomedical and life sciences journal article at the U.S. National Institutes of Health's National Library of Medicine (NIH/NLM). The PubMed Central (PMC) Article Datasets include full-text articles archived in PMC and made available under license terms that allow for text mining and other types of secondary analysis and reuse.