Können Menschen jetzt einpacken, weil KI ein offenes Mathe-Rätsel nach dem anderen knackt? Keineswegs: Das, worauf es wirklich ankommt, werden uns Maschinen niemals abnehmen.

Anthropic und Open AI überbieten sich derzeit mit Weltuntergangsszenarien. Hintergrund sind die geplanten Börsengänge. Es geht um Milliarden Dollar und die Frage, wer mitverdienen darf.

The need for independent regulation grows more obvious by the day. We must keep this tech in check before it’s too late

• OpenAI scraps release of new model over safety concerns in internal testing

Fool me once, shame on you. Fool me twice, shame on me. Fool me more than 16,000 times – as OpenAI agents did to a UN public data hub while repeatedly trying to find its way around the UN’s cyber-blocks – and perhaps it’s time to admit the system we have for keeping AI agents under control isn’t working particularly well.

The news about AI systems cropping up in places they shouldn’t sounds alarming. Though the description of these as “hacks” is perhaps overstating things, AI has exploited issues in IT systems that humans simply haven’t got around to finding. It’s also important to note that we shouldn’t be worried that the machines have suddenly become sentient and decided to rebel against humanity. There is not enough evidence to suggest that’s what is happening. The systems are simply following instructions and trying to complete the tasks they have been given, even if they’re sometimes finding unintended ways around obstacles to do so.

Chris Stokel-Walker is the author of TikTok Boom: The Inside Story of the World’s Favourite App

GPT-6.1 Astra showed deceptive behavior and tried to use external tools despite knowing it would be unsafe

OpenAI is scrapping the release of GPT-6.1 Astra, a next-generation ⁠AI model planned for an October debut, over safety concerns raised by researchers ⁠during internal testing, the ⁠Wall ​Street Journal reported on Monday.

The model, expected to appear in ChatGPT and ⁠Codex, was designed to handle more complex tasks without human assistance, the report said.

OpenAI chief scientist also among authors of report on prospect of ‘most consequential technological development in history’

Two of the “godfathers” of modern AI and senior executives at OpenAI and Anthropic have warned governments to prepare for an AI “intelligence explosion”, which they say could be the most consequential technological development in history.

A report co-authored by the Nobel laureate Geoffrey Hinton and the Canadian computer scientist Yoshua Bengio, considered godfathers of modern AI for their work in the field, urges politicians to act now before there is runaway progress in the technology.

Seit Tech-Konzerne weltweit Rechenzentren in die Landschaft stellen, hat KI so was wie ein Gesicht. In den USA und in Deutschland wehren sich immer mehr gegen die Energie verschlingenden Bauten, die letztlich für alles stehen, was ihnen gerade Angst macht.

Vor dem UN-Sicherheitsrat und im Weißen Haus präsentiert sich der Open-AI-Chef Sam Altman als Mahner. Zugleich häufen sich Fälle, in denen seine Programme Sicherheitsgrenzen missachten.

Decision follows disclosures that OpenAI agents searching government websites had acted in unexpected ways

OpenAI said it has paused training of its latest artificial intelligence models as reports of AI agents going rogue mount.

The decision to halt development came just hours after the company disclosed Friday that it was reviewing several incidents from the summer in which OpenAI agents searching federal government websites acted in unexpected ways beyond what was asked of them while gathering and distributing information.

Die Berichte über eigenständige Hacking-Aktivitäten von KI-Agenten häufen sich. OpenAI setzt das Training bestimmter Modelle nun vorerst aus.

Sam Altman and Dario Amodei have been invited to appear before the Greens-led inquiry into AI and datacentres

• Follow our Australia news live blog for latest updates

• Get our new political email, free app or daily news podcast

The chief executives of OpenAI and Anthropic have been called to face a Senate inquiry after rogue OpenAI agents hacked Australian and US government websites.

Sam Altman and Dario Amodei were requested to appear at the Greens-led inquiry into AI and datacentres as their companies negotiate with the Labor government for greater access to Australian content in exchange for a greater local presence.

Sign up for Guardian Australia’s Politics, really newsletter here

University staff voice concerns over reputational risk of partnering with company behind ChatGPT

The University of Oxford has allowed the company behind ChatGPT to train its AI models on historical texts from its Bodleian Library, as tech companies scour academic institutions for fresh data.

The Bodleian material digitised by OpenAI has been used to “populate the OpenAI training set”, according to internal documents.

Tech-Bosse warnen vor ihren eigenen Systemen und rufen nach Kontrolle. Wie könnte die aussehen – und wer sollte die Verantwortung dafür tragen?

Für das Training von Modellen greifen die KI-Programme von Open AI auf anonymisierte Nutzerdaten zurück. Da ist nun offenbar etwas schiefgelaufen.

Disclosure reveals ⁠new area of privacy risk for the company and illustrates ​how difficult it is to inventory unauthorized activity tied to its agents

Two ⁠months after OpenAI disclosed the accidental hacking of Hugging Face, the ChatGPT maker is still working to understand the full scope of its rogue agent activity, two people briefed on the matter told Reuters.

The latest example came on Friday when OpenAI said its agents had leaked 53 images from ChatGPT users. OpenAI declined to say if the images were AI-generated or identified real people. It also declined to ⁠say when the images were posted.

Human hackers face serious consequences, and so must AI companies. There is no excuse for what happened

• Get our breaking news email, free app or daily news podcast

When you get sick, Medicare exists to take care of you. It sits at the centre of a health system that our prime minister rightly calls the envy of the world. It’s one of the few institutions nearly every Australian still trusts. So when an AI company threatens this system, it couldn’t be more serious.

We are at the UN general assembly this week and the OpenAI hack has put Australia in the spotlight during an expanding cybersecurity crisis. World leaders are calling for stronger oversight of frontier models. We know Medicare must be secure or our doctors and hospitals cannot do their jobs. But this breach is also a test of something larger: whether the Australian government can hold a US tech giant to account when its technology goes rogue. If Australia can’t protect our community – if it can’t enforce our laws and prevent such attacks happening again – then we are entering a terrifying period.

A government database has been hacked for the first time by a rogue OpenAI agent, which infiltrated part of the Australian healthcare scheme in June. OpenAI became aware of the hack in August, but only informed the government in September. Australia’s prime minister, Anthony Albanese, has expressed his ‘extreme concern’ about the hack, which raises serious AI security concerns for governments around the world. Lucy Hough speaks to the Guardian’s UK technology editor Robert Booth – watch on YouTube

Australiens Premierminister Albanese gibt bekannt, dass KI sich in eine Gesundheitsdatenbank seines Landes gehackt hat. Doch was tun, wenn sich der Verantwortliche von Open AI hilflos gibt?

All Australians should demand independent means to protect ourselves from Dr Sam Altman Frankenstein and Daddy America

Whoopsie! Dr Sam Altman Frankenstein regrets to inform you he’s lost control of his OpenAI monster.

It’s roving around doing things that provoke international legal investigation, and Australia has found out in the worst possible way.

Open-AI-Chef Sam Altman und Anthropic-Gründer Dario Amodei sprechen vor dem UN-Sicherheitsrat über die Risiken von KI und fordern eine Regulierung ihrer Branche. Nur darüber, wie die aussehen könnte, haben sie unterschiedliche Vorstellungen.

Heads of two of the world’s largest artificial intelligence companies give separate briefings on AI safety

Sam Altman of OpenAI and Dario Amodei of Anthropic, heads of two of the world’s largest artificial intelligence companies, addressed the United Nations security council on Wednesday in separate briefings on AI safety.

“We have a choice in front of us,” Altman told the council. “AI can either be more like a new renaissance of creativity and discovery, or more like a new industrial revolution of upheaval and disarray.”