Hotnews

Crossposted from my Substack, sofiayab.substack.com. A bit about me: I studied law in Chinese at Fudan University and did an MSc in China in Comparative Perspective at LSE. I am Head of Legal at an AI company, and an incoming Winter Fellow at GovAI (2027). Views in the article are my own. This is the first issue of my monthly series on China’s AI safety regulation. Each following month I will analyse China’s new rules, AI registries published regularly, the Supreme...

lesswrong 21h ago 52°

Below the Frontier: The Battle for Good-Enough AI

What happens to the AI trade when good-enough intelligence does most knowledge work?This piece was originally published on my Substack. I'm around on X / Twitter and LinkedIn.Over the past few weeks, it's become obvious that consumer AI agents have hit an inflection point. Meta launched Muse, a personal agent that runs on its own virtual machine and can shop, schedule, and fill out forms on a user's behalf. Meanwhile, startup Instinct's valuation grew to $10B in a matter...

lesswrong 25h ago 48°

Launching the Hong Kong AI Safety Hub (HASH), a new home for AI safety work in Hong Kong

We’re excited to announce that AI Safety Hong Kong is relaunching as the Hong Kong AI Safety Hub (HASH). As part of this move, all our branding will transition from AISHK to HASH. As the community of people working directly on AI safety in Hong Kong grows, the best way to leverage that is to set up our in-person hub. Hong Kong sits in one of the most important regions for the global trajectory of AI, one the AI safety field has so far neglected. There have been a growing...

lesswrong 41h ago 41°

More people should write basic AI safety explainers

I think people continue to underrate the value of writing the clearest, most basic, simplest possible case for important parts of AI safety. For example, before I wrote my own explainer for the simplest possible case for AI doom, I noticed that all existing explainers, of which there aren't many, had multiple of the six problems below: They have too many extraneous detailsThey appeal to overly complex analogiesThey seem to spend much of their time responding to insider...

lesswrong 8h ago 30°

(Why) we’re launching the next cohort of Generator

TL;DR: The first round of the Generator Residency went very well.Our residents created and ran several large-scale fieldbuilding, talent infrastructure, and operational projects that have already had important impacts on the ecosystem. Six weeks after the program ended, 12 of our 27 residents have been hired to full-time roles at core AI safety orgs, and most have received several offers. Kairos and Constellation are running a second round from January to April 2027....

lesswrong 8h ago 30°

(Why) we’re launching the next cohort of Generator

TL;DR: The first round of the Generator Residency went very well.Our residents created and ran several large-scale fieldbuilding, talent infrastructure, and operational projects that have already had important impacts on the ecosystem. Six weeks after the program ended, 12 of our 27 residents have been hired to full-time roles at core AI safety orgs, and most have received several offers. Kairos and Constellation are running a second round from January to April...

lesswrong 8h ago 30°

(Why) we’re launching the next cohort of Generator

TL;DR: The first round of the Generator Residency went very well.Our residents created and ran several large-scale fieldbuilding, talent infrastructure, and operational projects that have already had important impacts on the ecosystem. Six weeks after the program ended, 12 of our 27 residents have been hired to full-time roles at core AI safety orgs, and most have received several offers. Kairos and Constellation are running a second round from January to April 2027....

lesswrong 45h ago 30°

OpenAI Can't Self-Police Because It Fires the People Raising the Alarm

By Alex Turner, Amber Scorah, and Karl Koch. Op-ed written for Fortune.Giving independent evaluators “employee-like access” is “a great idea”, OpenAI CEO Sam Altman said on September 12th. Two weeks later, OpenAI president Greg Brockman signed the White House Accord on Super Intelligence which outlined the administration’s answer to growing fears about AI: the companies would police themselves. One of the accord’s four commitments, which President Trump called “morally...

lesswrong 21h ago 29°

AI Horizons Forum (Dec 12–13, SF)

Applications for the AI Horizons Forum close November 27. Apply now!The AI Horizons Forum is a new conference which aims to bring together the core AI safety community, establish more of a shared picture of the current risk landscape and help coordinate a stronger response. We also want to help core AI safety organizations grow by connecting them with talented people well-positioned to move into high priority roles.Our speakers include Will MacAskill, Holden Karnofsky,...

lesswrong 41h ago 28°

Research Lessons I Learned at MATS & Redwood

Good empirical safety research is heavily bottlenecked on thinking more clearly. This post shares a few frames and tips I found useful, illustrated with concrete examples.I spent the better part of 2026 in empirical AI safety research apprenticeships. I was mentored by Alex Turner and Alex Cloud as part of MATS 9 Team Shard, where my collaborator and I worked on finetuning-based misalignment auditing. I then interned at Redwood Research, managed by Aryan Bhatt, where I...

1 2 3 4 5