Artificial Intelligence and ChatGPT: Home
What is Artificial Intelligence?
"Artificial Intelligence (AI) refers to the development of computer systems that can perform tasks that normally require human intelligence, such perception, reasoning, learning, decision-making, and natural processing. AI systems use machine learning algorithms to learn from large amounts of data and improve their performance over time." -- ChatGPT
- What is ChatGPT Doing ... and Why Does It Work?Stephen Wolfram
- Open Problems and Fundamental Limitations of Reinforcement Learning from Human FeedbackRLHF is the central technique used to fine-tune LLMs, and involves collecting human feedback on the output, which is then used to modify the LLM's model to produce more highly rated responses. It allows the LLM to go beyond modeling the distribution of its training data.
Where is AI being used today?
According to SAS Institute ("Statistical Analysis System"), AI is used in multiple disciplines and industries:
- Healthcare - "AI applications can provide personalized medicine and X-ray readings. Personal health care assistants can act as life coaches, remind you to take your pills, exercise or eat healthier."
- Retail - "AI provides virtual shopping capabilities that offer personalized recommendations and discuss purchase options with the consumer. Stock management and site layout technologies will also be improved with AI."
- Manufacturing - "AI can analyze factory IoT ("Internet of Things") data as it streams from connected equipment to forecast expected load and demand using recurrent networks, a specific type of deep learning network used with sequence data.
- Banking - "AI enhances the speed, precision and effectiveness of human efforts. In financial institutions, AI techniques can be used to identify which transactions are likely to be fraudulent, adopt fast and accurate credit scoring, as well as automate manually intense data management tasks."
AI Safety
- SuperalignmentOpenAI's program to attempt to ensure the alignment of superintelligent AI with human intent in the next four years, dedicating 20% of their compute to this goal
- Foundation Model TaskforceA program of the UK government backed with £100 million to advance AI safety research
Ethics in the AI industry
- As the AI industry booms, what toll will it take on the environment?Describes the large amount of electricity and water (for cooling) used for training AI systems. This issue is increasingly of concern in a variety of areas requiring significant computing power, such as AI and cryptocurrency.
- OpenAI Used Kenyan Workers on Less Than $2 Per HourDescribes the traumatic nature of the work needed to label text as violence, hate speech, sexual abuse, etc. in order to train ChatGPT, which is often performed by workers in poor countries earning low wages. (contains descriptions of sexual abuse)
- Dirty Secrets of BookCorpusDetails problems with a dataset of books used in the training of many prominent AI systems, primarily copyright issues involving the books in the dataset and bias towards particular sorts of books/authors/etc
- The Lucretia BooksA collection of essays about the author's experience with sexual abuse in Silicon Valley, including advice and resources
Notable LLM Services
- Based on Generative Pre-Trained Transformer GPT-3.5
- Does not connect to internet
- Trained through 2021
- By default, uses conversations for training, so not appropriate for sensitive information
- AutoGPT uses OpenAI's ChatGPT APIs to, given a task in natural language, break it down into sub-tasks, and use the internet and other tools in an automatic loop to complete the task. ChaosGPT is an instance of AutoGPT given the task of destroying humanity. It attempted to recruit humans on Twitter to its cause, and was eventually banned.
Anthropic is an AI organization founded by former members of OpenAI who left due to AI safety concerns pertaining to OpenAI's collaboration with Microsoft. Their chatbot, Claude, is available through the Poe app. See also this Vox article detailing Anthropic's experimental corporate structure and the Effective Altruist subcultural milieu in which it formed.
Bard from Google AI. Bard, along with Ernie Bot and Bing, below, can search the internet in the process of generating responses, unlike ChatGPT and Claude, above.
Ernie Bot from Baidu, a Chinese company offering a wide range of internet services which serve as alternatives to services such as search engines, navigation, encyclopedias, cloud storage, and social media sites which are blocked in China.
Microsoft Bing, whoseAPI can be found here: Bing Search API
Research Tools
The following tools can be used to collect and summarize research articles, starting from natural language questions, and not using exact keyword searches. They can see different collections of research papers, and present their findings in different ways, and it is often useful to use both to see the differences in what they come up with.
Applications of AI
Google Cloud highlights a number of applications and use cases for artificial intelligence:
- Speech Recognition - Automatically convert spoken work into written text
- Image Recognition - Identify and categorize various aspects of an image
- Translation - Translate written or spoken word from one language into another
- Predictive Modeling - Mine data to forecast specific outcomes with high degrees of granularity
- Data Analytics - Find patterns and relationships in data for business intelligence
- Cybersecurity - Autonomously scan networks for cyber attacks and threats
Author Information
This guide is currently maintained by Debra Kolah and Alex Manchester, Rice Phd '24.
It was created as a collaboration between Catherine Chen '23 and Raiya Myren '23 in the Spring of 2023.
Contact: Fondren UX Office fondrenux@rice.edu