How Safe Should Superintelligence Be?

How Safe Should Superintelligence Be? Localogy

The whole AI boosters vs. doomers safety debate is a bit tired. I mean the robots that will subjugate us haven’t even been built yet. Or have they?

A key AI figure who has broken away from the pack seems to have had the robots or some other dystopian vision in mind when he conceived his new startup.

Ilya Sutskever is a co-founder and the former chief scientist of OpenAI. He is also one of the people behind Sam Altman’s brief yet chaotic ouster from OpenAI last year. 

So it is no surprise that Sutskever is off doing something else. As the saying goes, if you take a shot at the king, you better not miss. 

The nature of the “something else” that Sutskever is pursuing is what’s most interesting here. 

Is News Corp.- Open AI Deal a One-Off or a Sign of Things to Come?

‘The Most Important Technical Problem of Our Time’

The very presence of Sutskever’s Safe Superintelligence (SSI) appears to be saying the following.

AGI is coming. Maybe sooner than you think. So let’s get ahead of it with a safer approach to building these models. 

Or something like that. 

“Building safe superintelligence (SSI) is the most important technical problem of our​​ time,” Sutskever (and his co-founders) said while announcing the launch on X. “SSI is our mission, our name, and our entire product roadmap because it is our sole focus. Our team, investors, and business model are all aligned to achieve SSI.”

Was It All About Guardrails?

At Open AI, Sutskever led the Superalignment team, which was tasked with making sure AI development was on the right path. The team was dissolved after Sutskever left Open AI. His clash with Altman reportedly involved the degree to which guardrails should be applied to OpenAI’s development efforts. 

Sutskever seems confident there is a business in AI safety. 

So what does SSI do? If you go to what appears to be the SSI Inc. website, all you will find is a letter, dated June 19 and signed by founders Sutskever, Daniel Gross, and Daniel Levy.  It’s the same message that was posted on X. 

Gross formerly led Apple’s AI efforts. Levy is an Open AI alum.

It goes on to say, “We approach safety and capabilities in tandem, as technical problems to be solved through revolutionary engineering and scientific breakthroughs. We plan to advance capabilities as fast as possible while making sure our safety always remains ahead.”

So it seems that SSI wants to make advancements in AI safety that big companies will embrace. Why? Maybe so they can credibly claim that they are using AI safely. Or something like that. 

I often say that the amount of money a company raises is the least interesting thing about it. I am not sure if this statement holds up in this case. It will be very telling to see how much SSI raises, how quickly, and from whom? 

Share Article...

Follow Us...

Stay ahead of the curve and get the latest on Local straight to your inbox.

By submitting this form, you agree to receive communications from Localogy. You can unsubscribe at any time.

Related Resources

Yelp Challenges Assumptions and stereotypes About Gen Z

Yelp Challenges Assumptions About Gen Z

Yelp has released new data that challenges assumptions and stereotypes around the increasingly purchase-empowered Gen Z. The report, coproduced with Angus Reid Group, identifies the generation as more independently-minded and less swayed by influencer marketing than commonly thought. 

SOCi Draws a Straight Line From Online Visibility to Business Expansion

The chain restaurant world is a bit schizophrenic as it navigates various macro factors. Headlines point to Culver’s, Texas Roadhouse, and Nothing Bundt Cakes opening hundreds of new locations while Wendy’s, Papa John’s, and Pizza Hut close hundreds. SOCi has made some sense of what’s going on. 

How Safe Should Superintelligence Be? Localogy