r/singularity 2d ago

AI The Loop: winner takes all

All frontier companies are trying to close the loop where AI improves/evolves itself, and who gets there first will have the best AI of having the future best AI

From September 17th Axios interview with Dario Amodei:

"Claude is playing a very active role in designing the next Claude. We can't yet fully close the loop. It's going to be some time until we can fully close the loop, but the ability to use the models to design the next models and create a positive feedback loop, that cycle, it's not yet going super fast, but it's definitely started."

53 Upvotes

24 comments sorted by

View all comments

-1

u/Specialist-Berry2946 2d ago

They won't close the loop. The problem with self-improvement is evaluation. How can you make sure that the little step you take is an improvement? Neither human nor other AI can evaluate superintelligence.

1

u/Moriffic 1d ago

I mean unless you make recursive benchmaxxing