Generative AI Defined: How it Works, Benefits and Dangers

Source: Tech Republic, 11/04/2024

Table of Contents
What is generative AI in simple terms?
How does generative AI work?
Examples of generative AI
Types of generative AI models
What is ChatGPT?
What is Google Gemini?
Benefits of generative AI
Use cases of generative AI
Dangers and limitations of generative AI
What is the difference between generative AI and general AI?
What is the difference between generative AI and machine learning?
What is the difference between generative AI and regenerative AI?
How big a role will generative AI play in the future of business?

Generative artificial intelligence has rapidly gained traction amongst businesses, professionals and consumers. But what is generative AI, how does it work and what is all the buzz about? Read on to find out.

What is generative AI in simple terms?
Generative AI is a type of artificial intelligence technology that broadly describes machine learning systems capable of generating text, images, code or other types of content, often in response to a prompt entered by a user. Generative AI models are increasingly being incorporated into online tools and chatbots that allow users to type questions or instructions into an input field, upon which the AI model will generate a human-like response.

How does generative AI work?
Generative AI uses a computing process known as deep learning to analyze patterns in large sets of data and then replicates this to create new data that appears human-generated. It does this by employing neural networks, a type of machine learning process that is loosely inspired by the way the human brain processes, interprets and learns from information over time. To give an example, if you were to feed lots of fiction writing into a generative AI model, it would eventually gain the ability to craft stories or story elements based on the literature its been trained on. This is because the machine learning algorithms that power generative AI models learn from the information they are fed - in the case of fiction, this would include elements like plot structure, characters, themes and other narrative devices. Generative AI models get more sophisticated over time - the more data a model is trained on and generates, the more convincing and human-like its outputs become.

Examples of generative AI
The popularity of generative AI has exploded in recent years, largely thanks to the arrival of OpenAI`s ChatGPT and DALL-E models, which put accessible AI tools into the hands of consumers. Since then, big tech companies including Google, Microsoft, Amazon and Meta have launched their own generative AI tools to capitalize on the technology`s rapid uptake. Various generative AI tools now exist, although text and image generation models are arguably the most well-known. Generative AI models typically rely on a user feeding a prompt into the engine that guides it towards producing some sort of desired output, be it text, an image, a video or a piece of music, though this isn`t always the case. Examples of generative AI models include:

ChatGPT: An AI language model developed by OpenAI that can answer questions and generate human-like responses from text prompts.
DALL-E 3: Another AI model by OpenAI that can create images and artwork from text prompts.
Google Gemini: Previously known as Bard, Gemini is Google`s generative AI chatbot and rival to ChatGPT. It`s trained on the PaLM large language model and can answer questions and generate text from prompts.
Claude 2.1: Anthropics AI model, Claude, offers a 200,000 token context window, which its creators claim can handle more data than its competitors.
Midjourney: Developed by San Francisco-based research lab Midjourney Inc., this gen AI model interprets text prompts to produce images and artwork, similar to DALL-E.
GitHub Copilot: An AI-powered coding tool that suggests code completions within the Visual Studio, Neovim and JetBrains development environments.
Llama 2: Meta`s open-source large language model can be used to create conversational AI models for chatbots and virtual assistants, similar to GPT-4.
Grok: After co-founding and helping to fund OpenAI, Elon Musk left the project in July 2023 and announced this new generative AI venture. Its first model, the irreverent Grok, came out in November 2023.
Cohere AI`s Command R: The startup Cohere AI announced in April a new model for enterprise, Command R, which is designed for generative AI adoption at scale. In particular, Command R is optimized for retrieval-augmented generation (RAG). RAG is intended to improve the accuracy of generative AI responses by checking them against a source.

Types of generative AI models
Various types of generative AI models exist, each designed for specific tasks and purposes. These can broadly be categorized into the following types:

Transformer-based models
Generative adversarial networks
Variational autoencoders
Multimodal models

What is ChatGPT?
ChatGPT is an AI chatbot developed by OpenAI. It is a large language model that uses transformer architecture - specifically, the generative pretrained transformer, hence GPT - to understand and generate human-like text.

What is Google Gemini?
Google Gemini (previously Bard) is another example of an LLM based on transformer architecture. Similar to ChatGPT, Gemini is a generative AI chatbot that generates responses to user prompts. Google launched Bard in the U.S. in March 2023 in response to OpenAI ChatGPT and Microsoft`s Copilot AI tool. It was launched in Europe and Brazil later that year.

Benefits of generative AI
For businesses, efficiency is arguably the most compelling benefit of generative AI because it can help automate specific tasks and focus employees` time, energy and resources on more important strategic objectives. This can result in lower labor costs, greater operational efficiency and insights into how well certain business processes are or are not performing. For professionals and content creators, generative AI tools can help with idea creation, content planning and scheduling, search engine optimization, marketing, audience engagement, research and editing, and potentially more. Again, the key proposed advantage is efficiency, because generative AI tools can help users reduce the time they spend on certain tasks and invest their energy elsewhere. That said, manual oversight and scrutiny of generative AI models remains highly important; we explain why later in this article.

Use cases of generative AI
McKinsey estimates that, by 2030, activities that currently account for around 30% of U.S. work hours could be automated, prompted by the acceleration of generative AI. Generative AI has found a foothold in a number of industry sectors and is now popular in both commercial and consumer markets. The use of generative AI varies from industry to industry and is more established in some than in others. Current and proposed use cases include the following:

Healthcare
Digital marketing
Education
Finance
Environment
In terms of role-specific use cases of generative AI, some examples include:

In customer support
In software development
In writing

Dangers and limitations of generative AI
A major concern around the use of generative AI tools - and particularly those accessible to the public - is their potential for spreading misinformation and harmful content. The impact of doing so can be wide-ranging and severe, from perpetuating stereotypes, hate speech and harmful ideologies to damaging personal and professional reputation. The risk of legal and financial repercussions from the misuse of generative AI is also very real; indeed, it has been suggested that generative AI could put national security at risk if used improperly or irresponsibly. These risks haven`t escaped policymakers. On Feb. 13, 2024, the European Council approved the AI Act, a first-of-kind piece of legislation designed to regulate the use of AI in Europe. The legislation takes a risk-based approach to regulating AI, with some AI systems banned outright. Security agencies have made moves to ensure AI systems are built with safety and security in mind. In November 2023, 16 agencies including the U.K`s National Cyber Security Centre and the U.S. Cybersecurity and Infrastructure Security Agency released the Guidelines for Secure AI System Development, which promote security as a fundamental aspect of AI development and deployment. Generative AI has prompted workforce concerns, most notably that the automation of tasks could lead to job losses. Research from McKinsey suggests that, by 2030, around 12 million people may need to switch jobs; with office support, customer service and food service roles most at risk. The consulting firm predicts that clerks will see a decrease of 1.6 million jobs, in addition to losses of 830,000 for retail salespersons, 710,000 for administrative assistants and 630,000 for cashiers.

What is the difference between generative AI and general AI?
Generative AI and general AI represent different sides of the same coin; both relate to the field of artificial intelligence, but the former is a subtype of the latter. Generative AI uses various machine learning techniques, such as GANs, VAEs or LLMs, to generate new content from patterns learned from training data. General AI, also known as artificial general intelligence, broadly refers to the concept of computer systems and robotics that possess human-like intelligence and autonomy. This is still the stuff of science fiction - think Disney Pixar`s WALL-E, Sonny from 2004`s I, Robot or HAL 9000, the malevolent AI from 2001: A Space Odyssey. Most current AI systems are examples of `narrow AI,` in that they`re designed for very specific tasks.

What is the difference between generative AI and machine learning?
Generative AI is a subfield of artificial intelligence; broadly, AI refers to the concept of computers capable of performing tasks that would otherwise require human intelligence, such as decision making and NLP. Generative AI models use machine learning techniques to process and generate data. Machine learning is the foundational component of AI and refers to the application of computer algorithms to data for the purposes of teaching a computer to perform a specific task. Machine learning is the process that enables AI systems to make informed decisions or predictions based on the patterns they have learned.

What is the difference between generative AI and discriminative AI?
Whereas generative AI is used for generating new content by learning from existing data, discriminative AI specializes in classifying or categorizing data into predefined groups or classes. Discriminative AI works by learning how to tell different types of data apart. It is used for tasks where data needs to be sorted into groups; for example, figuring out if an email is spam, recognizing what`s in a picture or diagnosing diseases from medical images. It looks at data it already knows to classify new data correctly. So, while generative AI is designed to create original content or data, discriminative AI is used for analyzing and sorting it, making each useful for different applications.

What is the difference between generative AI and regenerative AI?
Regenerative AI, while less commonly discussed, refers to AI systems that can fix themselves or improve over time without human help. The concept of regenerative AI is centered around building AI systems that can last longer and work more efficiently, potentially even helping the environment by making smarter decisions that result in less waste. In this way, generative AI and regenerative AI serve different roles: Generative AI for creativity and originality, and regenerative AI for durability and sustainability within AI systems.

How big a role will generative AI play in the future of business?
It certainly looks as though generative AI will play a huge role in the future. As more businesses embrace digitization and automation, generative AI looks set to play a central role in industries of all types, with many organizations already establishing guidelines for the acceptable use of AI in the workplace. The capabilities of gen AI have already proven valuable in areas such as content creation, software development, medicine, productivity, business transformation and much more. As the technology continues to evolve, gen AI`s applications and use cases will only continue to grow. That said, the impact of generative AI on businesses, individuals and society as a whole is contingent on properly addressing and mitigating its risks. Key to this is ensuring AI is used ethically by reducing biases, enhancing transparency and accountability and upholding proper data governance. None of this will be straightforward. Keeping laws up to date with fast-moving tech is tough but necessary, and finding the right mix of automation and human involvement will be key to democratizing the benefits of generative AI. Recent legislation such as President Biden`s Executive Order on AI, Europe`s AI Act and the U.K`s Artificial Intelligence Bill suggest that governments around the world understand the importance of getting on top of these issues quickly.