Listenly

What is the predicted shift in token consumption patterns between real-time and background workloads over the next several years?

Answered at 6:00 in Ex-NVIDIA Engineer: Why AI Is About to Get 1000x Cheaper · Invest Like The Best

— questions searchable right now

What is the predicted shift in token consumption patterns between real-time and background workloads over the next several years?

This year is expected to end at roughly 50-50 split between background and real-time workloads, but the long-term projection is 90-10 in favor of background tasks, since background processing has no human-in-the-loop constraint and can consume as many tokens as needed.

Unknown on Invest Like The BestAll answers from this podcast →
Full answer and detailsRead the whole answer, key facts and every other question from this episode

In short

This year is expected to end at roughly 50-50 split between background and real-time workloads, but the long-term projection is 90-10 in favor of background tasks, since background processing has no human-in-the-loop constraint and can consume as many token…

Guest · Ex-NVIDIA Engineer: Why AI Is About to Get 1000x Cheaper · Invest Like The Best · answer at 6:00

The full answer · about 1 min

This year is expected to end at roughly 50-50 split between background and real-time workloads, but the long-term projection is 90-10 in favor of background tasks, since background processing has no human-in-the-loop constraint and can consume as many tokens as needed.

More answers from this episode

 ·  All answers from Invest Like The Best →
—
—
0:00
0:00