Startups & Technology

Anthropic CEO pledges to slow AI rollout until safety is assured

Anthropic CEO pledges to slow AI rollout until safety is assured

Speaking before the opening bell, Amodei said Anthropic was founded to build powerful technology for humanity’s benefit. He recalled that he and his sister, co-founder Daniela Amodei, lost their father to a disease that became curable a few years later. His own early work in biology, he said, showed him how limited scientific resources can slow progress on treatments.

Amodei argued that AI could help researchers advance medicine by working alongside people. He cited applications including protein folding, drug design, cancer genetics and clinical trial administration, while cautioning that current results are early and experiments and trials still take time. He said sufficiently powerful AI could potentially compress a century of scientific and medical progress into a decade.

He also warned of risks including misuse by individuals or nation-states, economic disruption and loss of control over AI systems. Amodei said those dangers were avoidable with safeguards, alignment work and testing. He referred to Anthropic’s efforts to study and steer model behavior, and said the most difficult safety work still lies ahead.

“We will pace the training and deployment of AI systems, taking as long as is necessary to have confidence that they are safe and will remain under human control,” he said, adding that Anthropic would not bend to business or political pressure. Daniela Amodei echoed the company’s commitment to safety in a CNBC interview, while describing AI’s promise as “incredible.” The article described Thursday’s debut as the largest IPO in history.

Share

Comments (0)

Leave a comment

No comments yet. Be the first!