Speculative Speculative Decoding (SSD)

 (arxiv.org)

24 points | by E-Reverance 2 hours ago

2 comments

  • saagarjha 7 minutes ago
    Yo dawg I heard you liked speculation so we speculated your speculating