Live page · Day archive

Ensemble Routing for Prompt-Adaptive Cost-Aware LLM Inference

Read the original at HF Daily Papers

Summary

PISA and PISA-E are prompt-adaptive, cost-aware LLM routers that balance response quality and inference cost across heterogeneous requests.

Carried by: HF Daily Papers. First seen: .