Skip to content
r/MachineLearning · Communities

Proposal: Use semantic compression as input diffusion to read sessions larger than the context window [R]

I've been trying to come up with a solution for keeping extremely long ai sessions coherent. Sometimes there is too much substance to risk compaction. With so much buzz around diffusion going on it got me thinking, what if we treat the context like a progressive render, blurry>sharp. The practical way to make text "blu