Signal & Noise
Menu

Streaming

Sending tokens to the client as they're generated instead of waiting for completion. The difference between an 8-second wait and a 300ms one, perceptually.

← Back to the full glossary