llama-3.2-3b-instruct-fast
Summarizationby Meta
llama-3.2-3b-instruct-fast is Meta's Llama 3.2 3B Instruct model packaged by ZeroGPU for fast, low-cost summarization on edge GPUs. It shares the 128K context and the summarization pipeline of llama-3.1-8b-instruct-fast and runs on ZeroGPU worker devices with GPU acceleration, falling back to the hybrid inference cloud when no device is available.
Specifications
Parameters
3B
Context length
131,072 tokens
Task
Summarization
Provider
Meta
Billing
Per token
API
OpenAI-compatible
Pricing
Input
$0.05
per 1M tokens
Output
$0.30
per 1M tokens