Yes this is scary as hell

The real AI risk is inside the labs -

I believe we should not consider AI safe. A critical event that may result in the extinction of Homo sapiens is possible, but the danger is not in open models, or China making faster progress than the US. The danger is that a few CEOs (everywhere in the world) without the required background and legitimacy are in the position of making hard choices for humanity at large. They were not selected to do so; it was just the randomness of events that created this setup. They can’t speak for everybody, given the stakes, just because they have GPUs and money. This is the first thing that should be fixed.

In light of recent security-related events, both at OpenAI and Anthropic, I also believe these companies must be held accountable for what they put out there. I believe we are entering dangerous times with AI, maybe we are even on the verge of being out of control with this. Add this to the AI bubble speculation. Scary.