Text and Data Mining: TDM Overview

Text and Data Mining (TDM) is the analysis of large quantities of digital information to identify and analyze patterns and trends. TDM uses tools such as scripts, robots, agents, or other computer programs to extract data.

If your research involves mining content from the library’s electronic resource subscriptions, please contact your Subject Librarian for a consultation. Your Subject Librarian can assist you in determining what resources are appropriate for your research and can ensure that you have permissions to mine the content you need. 

In some cases, the library’s license agreements may prohibit mining of content or may require us to notify the resource provider in advance of any mining activity. Violating the library’s license agreements can cause Rice University to lose access to the resource and could result in your library resource access being suspended.

Contact your Subject Librarian for help locating appropriate and available resources before you begin your research project. For questions regarding TDM permission and access for content licensed by Rice or to obtain or negotiate permission for TDM activities, contact Scott Vieira, Head of Collections and Content Strategy. Sean Smith, Fondren's Data Services Specialist, is also able to consult on TDM methods.

Be aware that some publishers may charge for access to data.

The Text Analysis LibGuide includes a list of available text sources.

This website from Boston College Libraries provides a list of open-access resources that permit TDM.