AI & Machine Learning

Speculative decoding promises faster text generation. This preprint measures what happens once real traffic, batching and memory limits enter the picture.

A simulation study tests whether a simple curiosity bonus can help reinforcement learning agents find rewards that appear only once in a long while.

Models advertise windows of a million tokens. A new benchmark asks how much of that window they can really use when it counts.