incredible outperformance on goal 3, even though it took awhile:https://t.co/5GpYOlN8HB
— Sam Altman (@sama) September 17, 2024
OpenAI technical goals
June 20, 2016
OpenAI’s mission is to build safe AI, and ensure AI’s benefits are as widely and evenly distributed as possible.
Illustration: Ruby Chen
We’re trying to build AI as part of a larger community, and we want to share our plans and capabilities along the way. We’re also working to solidify our organization’s governance structure and will share our thoughts on that later this year.
Our metric
Defining a metric for intelligence is tricky, but we need one to measure our progress and focus our research. We’re thus building a living metric which measures how well an agent can achieve its user’s intended goal in a wide range of environments.
Goal 1: Measure our progress
The metric will consist of a variety of OpenAI Gym(opens in a new window) environments with a unified action and observation space(opens in a new window) (so a single agent can run across all of them), including games, robotics, and language-based tasks. Our implementation will evolve over time, and we’ll keep the community updated along the way.
Our research
A significant fraction of our research bandwidth is being spent on fundamental research. We’ll always be developing and testing new ideas, especially those that don’t fit neatly into our current worldview. This is important—our current ideas will not be enough to achieve our long-term goal.
We’ve also formed teams around specific projects. The intention isn’t just to solve these problems, but to develop general learning algorithms in the process. These algorithms will, in turn, help us build agents that are more capable according to our metric. These projects are:
Goal 2: Build a household robot
We’re working to enable a physical robot (off-the-shelf; not manufactured by OpenAI) to perform basic housework. There are existing(opens in a new window) techniques(opens in a new window) for specific tasks, but we believe that learning algorithms can eventually be made reliable(opens in a new window) enough(opens in a new window) to create a general-purpose robot. More generally, robotics is a good testbed for many challenges in AI.
Goal 3: Build an agent with useful natural language understanding
We plan to build an agent that can perform a complex task specified by language, and ask for clarification about the task if it’s ambiguous. Today, there are promising algorithms for supervised language tasks such as question(opens in a new window) answering(opens in a new window), syntactic(opens in a new window) parsing(opens in a new window) and machine(opens in a new window) translation(opens in a new window) but there aren’t any for more advanced linguistic goals, such as the ability to carry a conversation, the ability to fully understand a document, and the ability to follow complex instructions in natural language. We expect to develop new learning algorithms and paradigms to tackle these problems.
Goal 4: Solve a wide variety of games using a single agent
We aim to train an agent capable enough to solve any game in our initial metric. Games are virtual mini-worlds that are very diverse, and learning to play games quickly and well will require significant advances in generative models and reinforcement learning(opens in a new window). (We are inspired by the pioneering work of DeepMind(opens in a new window), who have produced impressive(opens in a new window) results(opens in a new window) in this area in the past few years.)
Our projects and fundamental research all have shared cores, so progress on any is likely to benefit the others. Each captures a different aspect of goal-solving, and was chosen for its potential to significantly move our metric.
We’re just getting started on these projects, and the details may change as we gain additional data. We also expect to add new projects over time.
Authors
Ilya Sutskever, Greg Brockman, Sam Altman, Elon Musk
Last edited by @suen 2024-09-17T23:32:57Z