Text and Data Mining: TDM Overview

Text and Data Mining (TDM) is the analysis of large quantities of digital information to identify and analyze patterns and trends.  TDM uses tools such as scripts, robots, agents, or other computer programs to extract data.

If your research involves mining content from the library’s electronic resource subscriptions, please contact your Subject Librarian for a consultation. Your Subject Librarian can assist you in determining what resources are appropriate for your research, and can ensure that you have permissions to mine the content you need. 

In some cases, the library’s license agreements may prohibit mining of content or may require us to notify the resource provider in advance of any mining activity. Violating the library’s license agreements can cause Rice University to lose access to the resource and could result in your library resource access being suspended.

Contact your Subject Librarian as early as possible in your research process as we may have to contact the resource provider to obtain or negotiate permission for TDM activities. Also, be aware that some publishers may charge for access to data.

This website from Boston College Libraries provides a list of open access resources that permit TDM.