Unless I'm misunderstanding, calling this RSI seems misleading?
This looks like an optimization of current training methods, and a good one, but not "RSI" in the sense of a system that can perpetually improve itself forever.
Agreed, what I understand from RSI would be models creating new models, or at least upgrading their own weights/architecture. It does not seem to be the case here.
Does RSI actually mean anything specific anymore? RSI, AGI, at this point seem like buzzwords. Sure AGI has definition that are measurable, say "better than 95% of humans on 95% of intellectual tasks" but if we used that definition we already have AGI and almost no one thinks we have achieved AGI. We use AIs to train AIs which we use to train AIs, why is that not RSI? How much human intervention means that is not RSI?
So few terms in AI are well defined. We will get ASI via AGI because of RSI but neither of those three things have any definition except pure vibes.
I struggle with the argument that RSI doesn't already exist like you say, it's existed since before the term LLM (hey, one that can be defined!) was common parlance. Though the biggest use for those is not superintelligence, it's to serve you ads and get your kids addicted to TikTok.
RSI has always being a well defined name, and you can only have RSI if you have an intelligence capable or creating itself.
It has technically existed for a long time (for longer than the name), but only on academical applications for extremely limited intelligences that could only create something like themselves. And that is still the only form that exists today.
It was never powerful enough to optimize ads distribution, and all the claims people are pushing around today are plain bullshit.
The replay simulator from history for off-policy eval is clever - avoids expensive rollouts. Curious how they prevent the policy from overfitting to already-discovered branches and going stale as the search space expands?
I ended up building a simplified version of this as /self-improve in https://github.com/DanMcInerney/orchflows. History is the state ledger, memory and RSI just cite the history as evidence and can be rewritten. I feel like strong immutable state is the missing piece of the puzzle for most of these memory libraries.
I might be wrong but is this really a solution for RSI? I interpret it's as a way to reducing wasted tokens and compute on paths that don't yield better results. It's an optimization. It's a faster way to get to RSI though. what's wrong?
"Across algorithm engineering, mathematical optimization, and GPU kernel engineering, Dream-RSI achieves competitive or improved discovery quality while substantially reducing discovery cost in several settings."
Anyone who seriously believe that and isn’t being hyperbolic for shock purpose is delusional. It’s a pretty standard research paper, you cannot assume any research that contains the terms RSI to be revolutionary
Fairly certain all the labs are doing this (RSI) at this point. It's a question of how public their proclamations are about it and how they're positioning PR etc.
Even today's lighter weight models know how to write kernels and optimize them. I've had DeepSeek 4.1 Flash tune the crap out custom CUDA kernels on my own codebase and it was entirely competent at it. And cheap.
The innovation pieces will be in the harnesses to support this. Which I guess is partially what's going on here.
It's not really RSI if you are just using the AI as a tool to help make it better. It has to be doing it itself, no? Otherwise self-hosted compilers are RSI.
This is a solid and very interesting paper! The authors were kind enough to publish the complete prompt for it (appendix B.1 on page 18), so anyone can try their approach with any LLM and see the results.
It says to read the complete history. Would that be analogous to reading all of one's chat threads, or just the history of the relevant chat thread that it's a part of?
This looks like an optimization of current training methods, and a good one, but not "RSI" in the sense of a system that can perpetually improve itself forever.
I struggle with the argument that RSI doesn't already exist like you say, it's existed since before the term LLM (hey, one that can be defined!) was common parlance. Though the biggest use for those is not superintelligence, it's to serve you ads and get your kids addicted to TikTok.
It has technically existed for a long time (for longer than the name), but only on academical applications for extremely limited intelligences that could only create something like themselves. And that is still the only form that exists today.
It was never powerful enough to optimize ads distribution, and all the claims people are pushing around today are plain bullshit.
I'd say it's much closer to the concept of continual learning, but I'm only a few pages deep and haven't groqued it fully yet.
"Across algorithm engineering, mathematical optimization, and GPU kernel engineering, Dream-RSI achieves competitive or improved discovery quality while substantially reducing discovery cost in several settings."
This is like asking why a paper called “I discovered God. This is the specific proof.” is revolutionary. Just tedious levels of incredulity.
Even today's lighter weight models know how to write kernels and optimize them. I've had DeepSeek 4.1 Flash tune the crap out custom CUDA kernels on my own codebase and it was entirely competent at it. And cheap.
The innovation pieces will be in the harnesses to support this. Which I guess is partially what's going on here.