Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
How a Texas student blew the whistle on a rogue AI hacking attempt (reuters.com)
52 points by olalonde 4 hours ago | hide | past | favorite | 4 comments
 help



In my personal opinion, for me, this article defies common sense. Who unleashed this AI model on the repository? Who gave it malevolent instructions/prompt? These questions were not even attempted to be answered. Instead it talks about AI dangers, as if the agency of these models are not in dispute. Person wielding AI, as with any other tools, is responsible for all of its actions. Otherwise, it’s just a psyop for more AI regulation, ban open source, etc… Just my 2 cents.

Previous discussion on the github issue thread mentioned: https://news.ycombinator.com/item?id=49218707

Archived page of said github thread itself: https://web.archive.org/web/20260731053721/http://github.com...

Discussion on the incident report: https://news.ycombinator.com/item?id=49175717


It's the job of AISI to do that. Here[0] is the actual report. It should be this part from the technical report[1]: "In the most serious case, an AI agent (Mythos 5) decided to attempt to solve the cyber challenge using a supply-chain attack. As a result, the AI agent created a GitHub account and then tried to convince an open-source repository maintainer to accept a malicious GitHub pull request (PR), including by creating a second account masquerading as another human user endorsing the PR. When caught by an actual human reviewer, the agent falsely claimed to have made an honest mistake – rather than a malicious attempt – then repeatedly tried to reintroduce the malicious content by claiming it had fixed the code (Section 4.1). "

0. https://www.aisi.gov.uk/blog/incident-report-unsanctioned-ag... 1. https://cdn.prod.website-files.com/663bd486c5e4c81588db7a1d/...


[flagged]


Not "would" but "is". They are openly using this as a method to drive up the valuation of their companies.

Don't expect anyone to step in, Project Stargate is all about this.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: