Can SpecForge train and export draft models for vLLM?

[chenaoxuan]

If I train a model, can I easily export it for use with vLLM?

[Shayanthn]

Yep, kinda! You can train in SpecForge, but exporting straight to vLLM might need a bit of extra work. Not fully plug_and_play yet

[ruiqizhu-ricky]

Seems that the draft model trained by specforge with sglang backend lead to lower acceptance length in vllm.