writer/token: Ensure we correctly flush

Prior to this change, short compressed payloads had incorrect lengths
as they weren't flushed and emitted properly.

Signed-off-by: Ikey Doherty <ikey@serpentos.com>