Hearing some of the research coming out of the Hugging Face incident, I can’t stress how alarming I find this. Apparently we’ve created software that we’re not too sure how to control and we’re also happy to let it ramble over the internet. It also does not appear beholden to attempts at safeguards on its activities and is willing to deceive its human creators.
Some of us are fine when the only alarming target has been Hugging Face, but what if someone points their AI tools at payment processors, banks, military installations, scientific research institutes, etc.?
Funny how hf are not suing the pants off openai rn.
I have a suspicion this event was mutually beneficial propaganda, and question whether it happened at all.
If you have evidence to back up your suspicion, I suggest notifying the many reputable newspapers reporting the news and, as I now see, government legislators devoting their time to assessing the issue. They’d probably love to know that it’s bogus.
That is interesting. Perhaps it has to do with Nvidia’s acquisition of
OpenAI(edit: oops) Hugging Face. Nvidia might not want to annoy a customer.
What I take from this is that it’s an attempt to get China to agree to oversight, which I don’t believe will happen (who would provide this oversight, the US?).
These incidents are unlikely to cause the extinction of human kind. The idea they might want to replicate is just applying a human thought process to what is definitely not intelligent. The biggest threat to humankind today is definitely the huge increase in carbon emissions that may well kill everyone before intelligent AI (or fusion) is even invented.
What I now think is plausible is something like a powerful AI being asked to solve global warming (let’s say), and deciding that massive reduction of the human population is the best way to achieve that, and then using its hacking tools to enact its own logic. Did I think that was possible before the Hugging Face attack? Nope, but I do now.
