Jetson Speculative Decoding (vLLM) Speculative decoding lets a small "draft" model propose tokens that the target model verifies in a single forward pass, reducing per-token latency. On Jetson, the win/loss is dominated by VRAM headroom , not by the draft quality. This skill encodes the parts an LLM won't already know. Purpose Tune an existing Jetson vLLM deployment for faster token generation by appending the right and validating whether it improves single-stream decode speed. When to use - TPOT/ITL is the bottleneck (TTFT is fine, output is just slow). - Workload is single-stream or low-con…