Posts Tagged "inference"

You Could Have Come Up with Speculative Decoding

Building up speculative decoding from first principles