Text and Data Mining: TDM Overview

Text and Data Mining (TDM) is the analysis of large quantities of digital information to identify and analyze patterns and trends. TDM uses tools such as scripts, robots, agents, or other computer programs to extract data.

If your research involves mining any copyrighted content, including library resources, please contact your Subject Librarian for a consultation. Your Subject Librarian can assist you in determining what resources are appropriate for your research and can ensure that you have permissions to mine the content you need. 

While Fondren Library seeks to include text and data mining options in our license agreements, the library's license agreements often require us to notify the resource provider in advance of any mining activity or, in some cases, may even prohibit mining of content. Violating the library’s license agreements can cause Rice University to lose access to the resource and could result in your library resource access being suspended.

Contact your Subject Librarian for help locating appropriate and available resources before you begin your research project.

For questions regarding TDM permission and access for content licensed by Rice or to obtain or negotiate permission for TDM activities, contact Scott Vieira, Head of Collections and Content Strategy, and/or Amanda McClendon, Senior Electronic Resources Librarian.

For questions regarding TDM methods and technical considerations, contact Sean Smith, Fondren's Data Services Specialist.

Be aware that some publishers may charge for access to data.

The Text Analysis LibGuide includes a list of available text sources.

This website from Boston College Libraries provides a list of open-access resources that permit TDM.