OpenAI and Anthropic Sign Deals with U.S. Government for AI Model Safety Testing
AI powerhouses, OpenAI and Anthropic, have signed agreements with the U.S. government to research, test, and evaluate their AI models. Announced by the U.S. Artificial Intelligence Safety Institute on Thursday, these first-of-their-kind deals mark a significant step in addressing the growing concerns around AI safety and ethical use.
Pioneering Safety Measures Amid Regulatory Scrutiny
These agreements come at a critical time as both companies face increased regulatory scrutiny over the responsible development and deployment of AI technologies. California lawmakers have passed a bill aimed at regulating AI practices within the state.
“Safe, trustworthy AI is crucial for the technology’s positive impact. Our collaboration with the U.S. AI Safety Institute leverages their wide expertise to rigorously test our models before widespread deployment,” said Jack Clark, Co-Founder and Head of Policy at Anthropic, a company backed by tech giants Amazon and Alphabet.
Under the agreements, the U.S. AI Safety Institute will gain access to major new models from both OpenAI and Anthropic before and after their public release. This access allows the institute to evaluate the capabilities of these AI models and assess potential risks.
Setting a Framework for Responsible AI Development
The deals also lay the groundwork for collaborative research aimed at understanding the implications of advanced AI models. According to Jason Kwon, Chief Strategy Officer at OpenAI, this partnership is an opportunity to establish U.S. leadership in responsible AI development.
“We believe the institute has a critical role to play in defining U.S. leadership in responsibly developing artificial intelligence and hope that our work together offers a framework that the rest of the world can build on,” Kwon stated.
Elizabeth Kelly, Director of the U.S. AI Safety Institute, echoed these sentiments, emphasizing the importance of these partnerships. “These agreements are just the start, but they are an important milestone as we work to help responsibly steward the future of AI,“.
International Collaboration and Future Implications
Beyond domestic efforts, the U.S. AI Safety Institute will also collaborate with the U.K. AI Safety Institute to share insights and feedback with OpenAI and Anthropic.
The U.S. AI Safety Institute, part of the U.S. Commerce Department’s National Institute of Standards and Technology (NIST), was established last year following an executive order from President Joe Biden. Its mission is to evaluate both known and emerging risks associated with AI models, aiming to ensure these technologies are developed and deployed responsibly.
A Milestone for AI Safety
The agreements between OpenAI, Anthropic, and the U.S. government mark a pivotal moment for AI safety. As these companies continue to innovate, their collaboration with the U.S. AI Safety Institute will help shape the standards and practices that could influence AI regulation worldwide.
This proactive approach to AI safety sets a precedent for other tech companies and governments, potentially serving as a model for global AI governance. With these partnerships, OpenAI and Anthropic are not only taking steps to ensure the responsible use of their technologies but also contributing to the broader effort of safeguarding the future of artificial intelligence.
Originally posted on OpenDataScience.com
Read more data science articles on OpenDataScience.com, including tutorials and guides from beginner to advanced levels! Subscribe to our weekly newsletter here and receive the latest news every Thursday. You can also get data science training on-demand wherever you are with our Ai+ Training platform. Interested in attending an ODSC event? Learn more about our upcoming events here.
