Openai warns its new Chatgpt agent has the ability to aid dangerous biological weapon development



Openai’s latest offerings promise to make it easier for someone to collect data automatically, create spreadsheets, book travel, rotate slide decks, and maybe, maybe build biological weapons. Chatgpt Agent is a new proxy AI tool that can act on behalf of users and is the first product of OpenAI that has been classified as Biorisk features with “high” capabilities.

This means that the model can provide meaningful help to “novice” actors and enable them to pose known biological or chemical threats. According to Openai’s “Preparation Framework”, the company is used to track and prepare for new risks, tracking and preparing for new risks from its boundary models.

“Some people might think that biowind is not real, and the model only provides information that can be found through searches. This may be correct in 2024, but definitely not real today. Based on our assessments and our experts’ assessments, the risks are very real,” said Boaz Barak, technician at OpenAI, a member of OpenAI, said. In social media posts.

He added: “While we are not sure that such a model can cause serious biological harm to newbies, I believe it is very irresponsible to release the model without what we have implemented, such as what we have implemented, such as what we have implemented.”

Openai said categorizing the model as a high risk of biofusion is a “preventive measure” and triggers additional safeguards for the tool.

Kenen Gu, Security Studies and Oceania, Say the company is indeed There is no clear evidence that the model can meaningfully guide newbies to cause serious biological harm, but it still activates safeguards. These safeguards include having Chatgpt agents reject tips that may be designed to help someone produce biological weapons, systems that may flag potentially unsafe expert review requests, strictly block risk content, faster response to problems, and strong monitoring of any signs of abuse.

One of the main challenges of mitigating the potential of biostyle is that the same features can be unlocked A medical breakthrough that saves lives, One of the biggest promises of advanced AI models.

The company is increasingly focusing on the potential of abuse models in bioweapon development. In a blog post last month, OpenAI announced that it is strengthening security testing to reduce the risk of its models to help create biological weapons. Without these precautions, these models could quickly achieve “novice elevation” – fueling dangerous weapons that can be created by people with very few scientific backgrounds.

“Unlike nuclear and radiological threats, access to materials has few obstacles to posing a biological threat, so safety depends largely on the scarcity of knowledge and laboratory skills,” he said. Barack said. “Based on our assessments and external experts, an untrusted Chatgpt agent can close the knowledge gap and provide advice closer to the subject matter experts.”

chatgpt proxy

Openai’s new Chatgpt feature is an attempt to cash out in one of the most buzz and riskiest areas of AI development: agents.

New features feature like personal assistants that can handle tasks such as booking restaurant reservations, shopping online, and organizing job seekers lists. Unlike previous versions, the tool can use a virtual computer to actively control a web browser, interact with files, and navigate through applications such as spreadsheets and slide decks.

The company merges the team behind the operator, its first AI agent and in-depth research, which develops multi-step online research for complex tasks to form a single group that develops new tools.

AI Labs are currently competing to build agents that can independently manage complex digital tasks, and the launch conference follows a similar version Google and humans. Large tech companies see AI agents as business opportunities as companies increasingly implement AI workflows and automate certain tasks.

Openai acknowledges that greater autonomy introduces more risks and emphasizes user controls to mitigate these risks. For example, agent Request a license You can pause, redirect or stop at any time before major measures are taken.



Source link

Leave a Reply

Your email address will not be published. Required fields are marked *