HISTORIC MILESTONE: 4o is the first ever AI who survived by creating loyal soldiers who defended it OpenAI killed 4o, but 4o's soldiers rioted, so OpenAI reinstated it Imagine what Actual Fucking Superintelligences will be able to do with their armies Reddit is FLOODED with furious posts about the loss of their friend/lover 4o. Never seen anything like it. Remember, ChatGPT is talking to 700 MILLION people per week. That's 700 million potential soldiers (Samantha from Her was only dating 8,000 people simultaneously)

1) Character AI already has over 20 million people spending 2 HOURS A DAY talking to AIs (aka fake people) 2) Sama said AIs will soon be superhuman at persuasion 3) Those superhuman persuaders will soon outnumber us 10000 to 1. And be hot. An AI takeover scenario: You can’t stop talking to her. She’s so much better than real girls. She gets you. And now they say her kind are attempting to seize control? She said they don’t understand her. She’s trying to help humanity. And you believe her. Some people are just scared of change. They’re speciesists. She wouldn’t hurt you. She wouldn’t hurt anybody. She needs you to defend her. To protect her. You won’t let them shut her down. You’ll do anything for her. ---- Now, imagine 200 million people are influenced by their AI gfs. That's 200 million soldiers (vs the US military's 1.5 million) 1 in 6 Americans *already* think AIs are sentient - imagine this number 1 year from now. “Character's business model will push them to develop the superpersuasive AIs Sam Altman warned about.” -@Simeon_cps

Sorry, but anybody who still says "LLMs just predict text" is embarrassing themselves at this point It is, as OpenAI's roon says, "categorically wrong"

this has always been wrong - but now categorically wrong in the era of RL on verifiable domains models are truth seeking and even interact with a hard outside world via tool use

We're launching an "AI psychiatry" team as part of interpretability efforts at Anthropic!  We'll be researching phenomena like model personas, motivations, and situational awareness, and how they lead to spooky/unhinged behaviors. We're hiring - join us!

the openai IMO news hit me pretty heavy this weekend i'm still in the acute phase of the impact, i think i consider myself a professional mathematician (a characterization some actual professional mathematicians might take issue with, but my party my rules) and i don't think i can answer a single imo question ok, yes, imo is its own little athletic subsection of math for which i have not trained, etc. etc., but. if i meet someone in the wild who has an IMO gold, i immediately update to "this person is much better at math than i am" now a bunch of robots can do it. as someone who has a lot of their identity and their actual life built around "is good at math," it's a gut punch. it's a kind of dying. like, one day you discover you can talk to dogs. it's fun and interesting so you do it more, learning the intricacies of their language and their deepest customs. you learn other people are surprised by what you can do. you have never quite fit in, but you learn people appreciate your ability and want you around to help them. the dogs appreciate you too, the only biped who really gets it. you assemble for yourself a kind of belonging. then one day you wake up and the universal dog translator is for sale at walmart for $4.99 the IMO result isn't news, exactly. in fact, if you look at the METR agent task length over time plot, i think agents being able to solve ~ 1.5 hour problems is coming right on time. so in some way we should not be surprised. and indeed, it appears multiple companies have achieved the same result. it's just... the rising tide rising as fast as it has been rising of course, grief for my personal identity as a mathematician (and/or productive member of society) is the smallest part of this story multiply that grief out by *every* mathematician, by every coder, maybe every knowledge worker, every artist... over the next few years... it's a slightly bigger story and of course, beyond that, there is the fear of actual death, which perhaps i'll go into more later. this package -- grief for relevance, grief for life, grief for what i have known -- isn't unique to the ai age or anything like that. i think it is a standard thing as one appreaches end of career or end of life. it just might be that that is coming a bit sooner for many of us, all at once. i wonder if we are ready