Decked out in purple and plaid, Gwen Stefani belted her 2002 single “Beneath It All” to a packed convention heart in San Francisco on Tuesday morning—however she was simply the warm-up. On the finish of her efficiency, Stefani shouted “Dreamforce! Let’s go!” right into a checkered microphone earlier than Salesforce CEO Marc Benioff strode into the highlight. Dreamforce is billed because the world’s largest enterprise software program convention however feels extra like attending a megachurch—particularly this yr.
Benioff roamed the viewers whereas delivering his Dreamforce sermon, adopted by a teleoperated digicam on wheels that beamed his face to screens hanging from the cavernous room’s ceiling. Inside minutes, he ordered up a graph of Salesforce’s annual income, which the corporate initiatives will prime $46 billion in 2027, thanks partially to demand for its AI-powered merchandise. The viewers applauded. However hanging over the entire occasion was a darkish query: Is synthetic intelligence actually value risking all our lives for?
Between flashy software program demonstrations of brokers constructing dashboards, conference-goers watched Silicon Valley leaders debate whether or not the AI trade ought to hold barreling forward or if the federal government must sluggish AI progress to forestall catastrophic dangers stemming from the know-how.
Final week, AI researcher Jacob Coxon resigned from Anthropic and publicly warned that corporations racing towards self-improving AI programs have been “playing with our lives.” By the weekend, different Anthropic workers have been echoing his considerations, and CEO Dario Amodei was urging world leaders to assist “tempo the frontier” of AI growth. Different AI CEOs then started endorsing the concept, together with Amodei’s biggest rival, OpenAI’s Sam Altman.
However not everyone seems to be on board with the concept. David Sacks, a White Home AI adviser, dismissed Amodei’s strategies and fears of AI doom as “simply one other bid for regulatory seize.” President Trump went additional this week, calling fears about existential AI danger “a hoax.” Regardless of the difficult political setting, Congress is making an attempt to capitalize on the second and push forward with laws to control the AI trade.
Onstage, 6-foot-5 Benioff towered over Anthropic’s CEO, vigorously shaking Amodei’s hand simply earlier than asking for his newest evaluation of AI progress. Whereas that is undoubtedly Benioff’s present, Anthropic has turn out to be a crucial companion serving to usher Salesforce into the AI period.
“Let’s say you are operating a automobile firm, and one other automobile firm, not yours, they’ve some type of security incident,” Amodei stated, making a not-so-subtle reference to OpenAI’s Hugging Face incident. “Clearly, it is very tempting to assault your competitor,” Amodei added, however the extra accountable transfer is to “arrange the remainder of the trade and say, what can we do to set requirements for everybody?”
However the Anthropic CEO was cautious to notice that pacing the frontier doesn’t imply “freezing the know-how in place,” and naturally, he took a second to plug Claude’s integration with Salesforce.
Moments after Amodei exited, Nvidia CEO Jensen Huang appeared and started downplaying the considerations Anthropic has raised. AI security successfully quantities to an “engineering downside,” Huang argued, and the businesses constructing AI can merely police themselves.
“We do not want any new legal guidelines, we do not want any new regulation,” Huang instructed Dreamforce attendees. “You run as quick as you may, however in the event you really feel that at any given cut-off date, the corporate is uncontrolled or the merchandise are usually not going to be protected, you’re taking a pause.”
The controversy feels a bit heavy for Dreamforce, however then once more, possibly that is the proper venue for it. As tech executives pitched their numerous enterprise AI instruments, I slipped out of the room, passing the plush mascots and vaguely Hawaiian decorations, to take a name from Sayash Kapoor, an incoming laptop science professor at UC Berkeley.
