Proxying LLMs via Vercel is expensive

by venkiion 11/14/2023, 6:59 PMwith 1 comments

by leerobon 11/14/2023, 8:36 PM

FYI I noticed an error here. Vercel Edge Functions use net CPU time, not wall time, so it’s not 400 execution units per call. It would just be 1.