Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
doctorpangloss
40 days ago
|
parent
|
context
|
favorite
| on:
Speculative KV coding: losslessly compressing KV c...
Multi-token prediction is a good enhancement to training. It isn't necessarily useful for inference. Other speculative decoding like EAGLE is. It is specific to the technology and the authors of these things write about it.
Consider applying for YC's Fall 2026 batch!
Applications
are open till July 27.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: