Fast Inference from Transformers via Speculative Decoding

Yaniv LeviathanMatan KalmanYossi Matias

Supplied bibliography entry.

Summary not yet available.