{"id":5601,"date":"2026-10-15T15:26:17","date_gmt":"2026-10-15T15:26:17","guid":{"rendered":"https:\/\/redmonk.com\/jgovernor\/?p=5601"},"modified":"2026-10-15T15:26:17","modified_gmt":"2026-10-15T15:26:17","slug":"the-best-token-is-one-you-dont-use-spotify-on-llm-usage-as-an-io-question","status":"publish","type":"post","link":"https:\/\/redmonk.com\/jgovernor\/the-best-token-is-one-you-dont-use-spotify-on-llm-usage-as-an-io-question\/","title":{"rendered":"The best token is one you don’t use – Spotify on LLM usage as an IO question"},"content":{"rendered":"

\"Railroad<\/a><\/p>\n

It’s late 2026 so by now we all know that token economics is a big deal. Bragging about token spend was so 2025. Being more efficient about token usage is an individual, team and corporate level question. We all need to be thinking about more efficient use of LLMs from a cost perspective.<\/span><\/p>\n

Using the right model for the job is increasingly the mantra – using a lighter, cheaper model for simple tasks, and an advanced, expensive model for complex reasoning or coding tasks. Frontier model company pricing leans into this. But competition is what causes prices to fall – one obvious answer to cut token spend is to use open weights models, especially as they become more and more capable. Frontier models can cost 10 to 50 times more per token than lightweight or open-source local alternatives. DeepSeek is crushing it right now – spend any time on Hacker News and you\u2019ll see people lauding its models. Kimi from Moonshot AI is also getting a lot of love. For geopolitical reasons many enterprises are hesitant to use Chinese models but some startups are building SaaS companies that use them, and enterprises are happily working with those startups without realising it.\u00a0<\/span><\/p>\n

And then of course there is Jev, the classification model everyone\u2019s going gaga for at the moment. See for example – <\/span>We swapped our LLMs for Jev. It’s 39% cheaper<\/span><\/a>.<\/span><\/p>\n

Model routing is now a product and feature in its own right – see companies and projects such as <\/span>OpenRouter<\/span><\/a>, or <\/span>model router for Microsoft Foundry<\/span><\/a>. And of course Claude Code offers automated model choice, to help developers use the best Anthropic model for the job at hand.\u00a0<\/span><\/p>\n

Another take on the model cost question looks at not overusing LLMs, but instead building deterministic automations that don\u2019t require LLMs in the workflow. Using models to write code that\u2019s repeatable.<\/span><\/p>\n

Spotify recently published a post with a solid approach to reducing LLM costs by Dimitri Mazmanov, Principal Product Manager at Spotify – <\/span>Portal by Spotify cut my Claude Code token usage by 90%<\/span><\/a>:<\/span><\/p>\n

Most of what an AI coding agent does for me isn’t thinking. It’s I\/O.<\/span><\/p>\n

Reading five files to answer a question about one method. Generating a test file that follows the exact same pattern as the twenty test files next to it. Updating docs after a meeting. Thousands of tokens gone and almost zero reasoning. The seat license isn’t what hurts, it’s the tokens. And you’re feeding all of it to a frontier model that’s wildly overqualified. What if you could route the grunt work to something cheaper that handles it just as well, and save the expensive model for the problems that actually need it?<\/span><\/p><\/blockquote>\n

The I\/O take is what I wanted to home in on here. Last traffic, fewer tokens, cost savings.\u00a0<\/span><\/p>\n

The post goes into some detail about the architecture and it’s worth reading in full. It\u2019s not surprising Spotify would be focusing on cost efficiency. We\u2019ve written before about <\/span>cost optimisation baked into Spotify\u2019s Backstage developer platform<\/span><\/a>.<\/span><\/p>\n

According to Mazmanov the use of Spotify Shunt, a model delegation tool, to route some traffic, dramatically cut token spend.<\/span><\/p>\n

Tested against a Java monorepo across four scenarios, measuring tokens Claude would consume reading files directly vs. consuming the bulk-reader’s summary or writing code via the code-writer. Mean bulk-read savings were around a whopping 90%.<\/span><\/p>\n

The code-write scenario is harder to measure in tokens because without shunt, Claude both reads the reference files and generates the output as expensive output tokens. With shunt, the code goes straight to disk, Claude never sees it.<\/span><\/p><\/blockquote>\n

The router works with AiKA (AI Knowledge Assistant), the experimental chatbot in Backstage. Mazmanov points to AiKA modes as the key to the approach\u00a0<\/span><\/p>\n

\u201cThey’re reusable. The same bulk-reader and code-writer modes work across every project and every tool that can shell out to the Portal CLI.<\/span><\/p>\n

They’re shareable. Both modes are public in AiKA. Anyone can use them today without creating their own.<\/span><\/p>\n

They’re composable. You could create a doc-writer mode for documentation, a reviewer mode for code review summaries, a translator mode for <\/span>i18n<\/span><\/a>. Each one is a few clicks away.<\/span><\/p>\n

They decouple the routing decision from the worker. The plugin decides when to delegate. The mode decides how to respond. Swap Gemini Flash for a cheaper model, change the system prompt, add MCP tools – the plugin doesn’t change.\u201d<\/span><\/p>\n

So AI enabled routing with an I\/O or batch automation focus, reducing traffic and use of Claude tokens. Yeah we\u2019re going to see a lot more of this kind of approach.<\/span><\/p>\n

 <\/p>\n","protected":false},"excerpt":{"rendered":"

It’s late 2026 so by now we all know that token economics is a big deal. Bragging about token spend was so 2025. Being more efficient about token usage is an individual, team and corporate level question. We all need to be thinking about more efficient use of LLMs from a cost perspective. Using the<\/p>\n","protected":false},"author":5,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[1],"tags":[],"class_list":["post-5601","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"acf":[],"jetpack_publicize_connections":[],"jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p9wfjh-1sl","jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/redmonk.com\/jgovernor\/wp-json\/wp\/v2\/posts\/5601","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/redmonk.com\/jgovernor\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/redmonk.com\/jgovernor\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/redmonk.com\/jgovernor\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/redmonk.com\/jgovernor\/wp-json\/wp\/v2\/comments?post=5601"}],"version-history":[{"count":1,"href":"https:\/\/redmonk.com\/jgovernor\/wp-json\/wp\/v2\/posts\/5601\/revisions"}],"predecessor-version":[{"id":5603,"href":"https:\/\/redmonk.com\/jgovernor\/wp-json\/wp\/v2\/posts\/5601\/revisions\/5603"}],"wp:attachment":[{"href":"https:\/\/redmonk.com\/jgovernor\/wp-json\/wp\/v2\/media?parent=5601"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/redmonk.com\/jgovernor\/wp-json\/wp\/v2\/categories?post=5601"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/redmonk.com\/jgovernor\/wp-json\/wp\/v2\/tags?post=5601"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}