One month coding with GLM 5.3 Flash | Wagtail CMS   (index.html)                  (The Wagtail CMS Blog) (https://wagtail.org/blog/feed/) (This Week in Wagtail) (https://wagtail.org/newsletter/feed/) (../../static/img/favicons/favicon.ec7386ac84cc.ico) (../../static/img/favicons/favicon.cb835b298f9a.svg) (https://wagtail.org/static/img/favicons/apple-touch-icon.cb3ea619f266.png) (../../static/img/favicons/favicon.0e9ec9254239.webmanifest)   (../../static/css/main.a9d97b9927d3.css)                                                                                                                                                                                 (index.html#main-content) Skip to main content (https://wagtail.org/)       Project    ‹ Back  Project (https://wagtail.org/about-wagtail/)      Why Wagtail? - Why you should choose Wagtail    (https://wagtail.org/features/)      Features - What Wagtail offers    (https://wagtail.org/roadmap/)      Roadmap - Our plans for Wagtail    (https://wagtail.org/wagtail-ai/)      Wagtail AI - Wagtail is AI-ready    (https://wagtail.org/accessibility/)      Accessibility - How we make Wagtail work for everyone    (https://wagtail.org/sustainability/)      Sustainability - How we reduce Wagtail's climate impact    (https://wagtail.org/security/)      Security - How we make Wagtail more secure    (https://wagtail.org/core-team/)      Core team - Our leading contributors      (https://wagtail.org/features/)   Do your best work Check out the very best features Wagtail offers        Explore    ‹ Back  Explore (https://wagtail.org/showcase/)      Wagtail showcase - Explore amazing projects built with Wagtail    (https://wagtail.org/wagtail-ai/)      AI-ready CMS - Power up your content with Wagtail AI    (https://wagtail.org/government/)      Government and public sector - Why Wagtail is great for public institutions    (https://wagtail.org/headless/)      Go headless with Wagtail - Headless or traditional Wagtail? You choose!    (https://wagtail.org/charities-and-nonprofits/)      Charities and nonprofits - Why Wagtail is great for mission-driven organizations    (https://wagtail.org/content-personalization/)      Content personalization - Segmented content that just works    (https://wagtail.org/cultural-institutions/)      Cultural institutions - Why Wagtail is great for museums, libraries, and more    (https://wagtail.org/wagtail-localize/)      Multi-lingual publishing - Publish in multiple languages with Wagtail Localize    (https://wagtail.org/education/)      Education and research - Why Wagtail is great for academic institutions    (https://wagtail.org/agencies/)      Wagtail for Agencies - Why your agency should use Wagtail    (https://wagtail.org/business/)      Business - Why Wagtail is great for businesses      (https://wagtail.org/get-started/)   Try Wagtail Get a working site up in 15 minutes        Developers    ‹ Back  Developers (https://docs.wagtail.org/en/stable/)      Documentation - Read the docs. Learn the code.    (https://docs.wagtail.org/en/stable/getting_started/index.html)      Quick start - Get going with Wagtail    (https://github.com/wagtail/wagtail)      GitHub - Explore the Wagtail codebase    (https://wagtail.org/packages/)      Packages - Extend Wagtail with Packages    (https://github.com/wagtail/wagtail/wiki/Release-schedule)      Release schedule - When you can expect releases    (https://wagtail.org/services/)      Developer training - Wagtail and Django training from the experts      (https://wagtail.org/newsletter/)   Sign up for our newsletter Don't miss the latest Wagtail news, events and releases        Community    ‹ Back  Community (https://wagtail.org/blog/)      Blog - The latest Wagtail news    (https://wagtail.org/newsletter/)      Newsletter - Stay up to date on everything Wagtail    (https://wagtail.org/wagtail-space-2026/)      Wagtail Space - Meet up with other Wagtailers    (https://wagtail.org/events/)      Events - What's New in Wagtail and more    (https://wagtail.org/slack)      Slack - Join our Slack community    (https://wagtail.org/wagtail-space-2025/code-of-conduct/)      Code of Conduct - Our community commitments    (https://docs.wagtail.org/en/stable/contributing/index.html)      Contribute - Contribute your time to Wagtail    (https://wagtail.org/sponsor/)      Sponsor - Help bring new features to life      (https://wagtail.org/newsletter/)   Sign up for our newsletter Don't miss the latest Wagtail news, events and releases        Support    ‹ Back  Support (https://wagtail.org/get-help/)      Get help - Find answers to your Wagtail questions    (https://wagtail.org/services/)      Wagtail services - Get expert help with your Wagtail project    (https://guide.wagtail.org/en-latest/)      Wagtail user guide - How to use Wagtail CMS    (https://wagtail.org/contact/)      Contact - Get in touch with us    (https://wagtail.org/faqs/)      FAQs - The most common Wagtail questions      (https://torchbox.com/wagtail-cms/support/)   Wagtail support Get professional help from Wagtail experts And support Wagtail at the same time                          Project    ‹ Back  Project (https://wagtail.org/about-wagtail/)      Why Wagtail? - Why you should choose Wagtail    (https://wagtail.org/features/)      Features - What Wagtail offers    (https://wagtail.org/roadmap/)      Roadmap - Our plans for Wagtail    (https://wagtail.org/wagtail-ai/)      Wagtail AI - Wagtail is AI-ready    (https://wagtail.org/accessibility/)      Accessibility - How we make Wagtail work for everyone    (https://wagtail.org/sustainability/)      Sustainability - How we reduce Wagtail's climate impact    (https://wagtail.org/security/)      Security - How we make Wagtail more secure    (https://wagtail.org/core-team/)      Core team - Our leading contributors      (https://wagtail.org/features/)   Do your best work Check out the very best features Wagtail offers        Explore    ‹ Back  Explore (https://wagtail.org/showcase/)      Wagtail showcase - Explore amazing projects built with Wagtail    (https://wagtail.org/wagtail-ai/)      AI-ready CMS - Power up your content with Wagtail AI    (https://wagtail.org/government/)      Government and public sector - Why Wagtail is great for public institutions    (https://wagtail.org/headless/)      Go headless with Wagtail - Headless or traditional Wagtail? You choose!    (https://wagtail.org/charities-and-nonprofits/)      Charities and nonprofits - Why Wagtail is great for mission-driven organizations    (https://wagtail.org/content-personalization/)      Content personalization - Segmented content that just works    (https://wagtail.org/cultural-institutions/)      Cultural institutions - Why Wagtail is great for museums, libraries, and more    (https://wagtail.org/wagtail-localize/)      Multi-lingual publishing - Publish in multiple languages with Wagtail Localize    (https://wagtail.org/education/)      Education and research - Why Wagtail is great for academic institutions    (https://wagtail.org/agencies/)      Wagtail for Agencies - Why your agency should use Wagtail    (https://wagtail.org/business/)      Business - Why Wagtail is great for businesses      (https://wagtail.org/get-started/)   Try Wagtail Get a working site up in 15 minutes        Developers    ‹ Back  Developers (https://docs.wagtail.org/en/stable/)      Documentation - Read the docs. Learn the code.    (https://docs.wagtail.org/en/stable/getting_started/index.html)      Quick start - Get going with Wagtail    (https://github.com/wagtail/wagtail)      GitHub - Explore the Wagtail codebase    (https://wagtail.org/packages/)      Packages - Extend Wagtail with Packages    (https://github.com/wagtail/wagtail/wiki/Release-schedule)      Release schedule - When you can expect releases    (https://wagtail.org/services/)      Developer training - Wagtail and Django training from the experts      (https://wagtail.org/newsletter/)   Sign up for our newsletter Don't miss the latest Wagtail news, events and releases        Community    ‹ Back  Community (https://wagtail.org/blog/)      Blog - The latest Wagtail news    (https://wagtail.org/newsletter/)      Newsletter - Stay up to date on everything Wagtail    (https://wagtail.org/wagtail-space-2026/)      Wagtail Space - Meet up with other Wagtailers    (https://wagtail.org/events/)      Events - What's New in Wagtail and more    (https://wagtail.org/slack)      Slack - Join our Slack community    (https://wagtail.org/wagtail-space-2025/code-of-conduct/)      Code of Conduct - Our community commitments    (https://docs.wagtail.org/en/stable/contributing/index.html)      Contribute - Contribute your time to Wagtail    (https://wagtail.org/sponsor/)      Sponsor - Help bring new features to life      (https://wagtail.org/newsletter/)   Sign up for our newsletter Don't miss the latest Wagtail news, events and releases        Support    ‹ Back  Support (https://wagtail.org/get-help/)      Get help - Find answers to your Wagtail questions    (https://wagtail.org/services/)      Wagtail services - Get expert help with your Wagtail project    (https://guide.wagtail.org/en-latest/)      Wagtail user guide - How to use Wagtail CMS    (https://wagtail.org/contact/)      Contact - Get in touch with us    (https://wagtail.org/faqs/)      FAQs - The most common Wagtail questions      (https://torchbox.com/wagtail-cms/support/)   Wagtail support Get professional help from Wagtail experts And support Wagtail at the same time          (https://wagtail.org/get-started/) Get started   Get started    Enter a search term (Search...) Search            Give Wagtail a go (https://github.com/torchbox/wagtail-news-template)      Try the starter kit See if Wagtail is right for you  You can deploy a working Wagtail site in as little as 15 minutes.    (https://docs.wagtail.org/en/stable/getting_started/tutorial.html)      Build your first site Our 10 min install guide  Follow our tutorial to build a brand new Wagtail project.            Enter a search term (Search...) Search               2 Oct 2026  One month on GLM 5.3 Flash 2B tokens later, 🤖 task failed successfully (Thibaud Colas) Thibaud Colas Wagtail core team      Setting a challenge to spend the (https://wagtail.org/blog/open-models-only-adoption-challenge/) whole of September on only one efficient open model felt like a great idea at the time. Turns out not so much in practice. 2B tokens later, here’s how it went. Where tokens went this month Here’s the tokens distribution according to AgentsView, one of our (https://wagtail.org/ai/agentic-engineering-recommendations/) Agentic engineering recommendations to keep tabs on AI usage:   (Screenshot of AgentsView tokens usage for September 2026 over 2B tokens)  Zooming in on the models split specifically: (Tree map of agents token usage over September 2026, with half going to GLM 5.3 Flash) The goal was to spend the whole month on GLM 5.3 Flash pictured in teal. Here’s what went well: Successfully spent the first half of the month on just that model. That model’s usage was well within our budget ($68, about 4kWh of energy use / 365 grams of carbon emissions).  The second half of the month didn’t go so well, with 1B tokens going to other models. Unexpected hurdles The cost of vibe coding We’re pretty transparent that our (https://wagtail.org/blog/experiments-with-mcp-in-wagtail/) experimental Wagtail MCP server is a vibe-coded prototype . Vibe coding isn’t quite what we normally aspire to, but for a prototype it’s spot on. Unfortunately there are still consequences to it. I chose the 'wrong' model for the prototype, and we spent 450M tokens / $150 / 5kWh of energy use almost overnight. The MCP server itself works well and we now have a great demo of the capabilities, so it’s not for nothing: (MCP server in Wagtail - experiments demo)   Nonetheless, it’s a good reminder to be careful with model selection and with agentic patterns. We could have achieved similar results for most likely 5x less cost with not that much more effort. Lessons learned! We need to budget for this, and be more careful. Could have seen it coming, but now we know. Infrastructure woes Another unexpected hurdle was infrastructure availability issues. We’ve written extensively about (https://wagtail.org/blog/comparing-open-weight-ai-models-and-providers/) comparing inference providers . Our choices work really most of the times, but it turns out they’re very popular, and do not have the same capacity as the big labs who hoard all the GPUs. We noted degradation with the performance of GLM 5.3 Flash in particular, most likely because of it being (https://wagtail.org/blog/open-models-only-adoption-challenge/) so high up the Pareto frontier of relevant models for our work. (Scatter plot of AI models, with the drawn pareto frontier, GLM 5.3 Flash in the top left) This meant having to switch to other similar models (DeepSeek V4.1 Flash, Qwen 3.8 Flash). Which is very simple to do, but nonetheless unexpected! The cost of experimentation and R&D Last but not least, beyond using one model for day-to-day engineering, it felt essential to keep experimenting with a wide range of models, keeping up with what providers are releasing. This is particularly essential as we start to benchmark models’ performance on Wagtail tasks, where we need data across a wide range of models. Sneak peek of our benchmark: (Data table of 14 AI models reporting their accuracy as a percentage, energy use in Wh, Cost in $. Top of the table is DeepSeek V4.1 Flash with 95% accuracy and 14.9Wh energy use, $0.09 per task) It’s much easier to guide people towards leaner options with this kind of concrete data. And for us to make those options even more viable with agent skills, or (https://wagtail.org/blog/prototyping-a-cli-for-wagtail/) our new CLI prototype , which is intended to work well with agents. Takeways and what to do next So technically this challenge was a failure. Only 50% usage on the target model, 1B out of 2B tokens. About 35 kWh of energy use instead of 10. But we did learn a lot, which is crucial for the current moment. Reflecting on this for October, here’s what will make it work: Constant, local usage measurement and reporting . Looking not just at tokens but also energy use and spend, and ideally how well this all leads to concrete positive outcomes. Budgeting for experimentation, not just day-to-day tasks . Making more concerted decisions about which prototypes are worth building, and how. Better prompt selection and multi-agent techniques . Orchestrator vs. scout vs. implementer vs. reviewer agents. Bounded goals. Not rocket science but certainly one more thing to learn. Keep pushing for more efficient techniques and models . The Jev-style decision diffusion models look very promising if they can run so efficiently. Latest flagship models also look like a step in the right direction on that front.  For day-to-day developer work, it’s totally viable to focus on one or two flash-tier cheap models. A viable target is probably that the majority of AI inference work should be done with such efficient models, measured in cost or energy use rather than meaningless tokens. That’s the goal for October! You should try it too, you’ll learn a lot in the process.  And come say hi at (https://wagtail.org/wagtail-space-2026/) Wagtail Space 2026 in November to hear how that all pans out!    You might also like (https://wagtail.org/blog/open-models-only-adoption-challenge/)      News 3 Sep 2026  Open models only: back to school challenge Ditch the subscription, spend the whole of September on open weight models   (https://wagtail.org/ai/agentic-engineering-recommendations/) Agentic engineering recommendations Opinionated recommendations for people who want to follow our AI guiding principles as part LLM-assisted software engineering.          Project  Project  (https://wagtail.org/about-wagtail/) Why Wagtail?  (https://wagtail.org/features/) Features  (https://wagtail.org/roadmap/) Roadmap  (https://wagtail.org/wagtail-ai/) Wagtail AI  (https://wagtail.org/accessibility/) Accessibility  (https://wagtail.org/sustainability/) Sustainability  (https://wagtail.org/security/) Security  (https://wagtail.org/core-team/) Core Team        Explore  Explore  (https://wagtail.org/showcase/) Wagtail showcase  (https://wagtail.org/who-uses-wagtail/) Who uses Wagtail?  (https://wagtail.org/government/) Government and public sector  (https://wagtail.org/charities-and-nonprofits/) Charities and nonprofits  (https://wagtail.org/cultural-institutions/) Cultural institutions  (https://wagtail.org/education/) Education and research  (https://wagtail.org/business/) Business  (https://wagtail.org/agencies/) Wagtail for Agencies  (https://wagtail.org/headless/) Headless Wagtail  (https://wagtail.org/content-personalization/) Content personalization  (https://wagtail.org/wagtail-localize/) Multi-lingual publishing  (https://wagtail.org/wagtail-vs-drupal/) Wagtail vs. Drupal  (https://wagtail.org/wagtail-vs-wordpress/) Wagtail vs. Wordpress        Developers  Developers  (https://docs.wagtail.org/en/stable/) Documentation  (https://docs.wagtail.org/en/stable/getting_started/index.html) Quick start  (https://github.com/wagtail/wagtail) Github  (https://wagtail.org/get-started/) Try Wagtail  (https://wagtail.org/packages/) Packages  (https://github.com/wagtail/wagtail/wiki/Release-schedule) Release schedule        Community  Community  (https://wagtail.org/blog/) Blog  (https://wagtail.org/newsletter/) Newsletter  (https://wagtail.org/wagtail-space-2026/) Wagtail Space  (https://wagtail.org/events/) Events  (https://wagtail.org/slack) Slack  (https://wagtail.org/code-of-conduct/) Code of Conduct  (https://docs.wagtail.org/en/stable/contributing/index.html) Contribute  (https://wagtail.org/sponsor/) Sponsor        Support  Support  (https://wagtail.org/get-help/) Get Help  (https://guide.wagtail.org/) Wagtail User Guide  (https://wagtail.org/services/) Wagtail services  (https://torchbox.com/wagtail-cms-services/wagtail-developer-support/) Wagtail developer support  (https://torchbox.com/wagtail-cms-services/wagtail-developer-training/) Wagtail developer training  (https://wagtail.org/faqs/) FAQs  (https://wagtail.org/cookie-policy/) Cookie policy  (https://wagtail.org/privacy/) Privacy policy  (https://wagtail.org/contact/) Contact      (https://wagtail.org/sponsor/)   Sponsor Wagtail Help build Wagtail enhancements and support the long-term health of the project    (https://docs.wagtail.org/en/stable/contributing/index.html#contributing-to-wagtail)   Contribute code 200+ contributors in 2022!     Follow us (https://www.linkedin.com/company/wagtail-cms/)     (https://github.com/wagtail/wagtail)     (https://www.youtube.com/channel/UCXsuEmvisPzuJPaIdpVM0yg)     (https://fosstodon.org/@wagtail)     (https://bsky.app/profile/wagtail.org)       JavaScript is required to toggle light/dark mode..  Dark Light mode Dark mode  Light   This Week in Wagtail Sign up for events, features and adventures on Wagtail (Enter your email address)   Sign up        Wagtail is an open source project by (https://torchbox.com/) Torchbox . © 2026    We use cookies to measure how you use the website. We want our site to be easy for you to use; understanding how you interact with it helps us know that. (https://wagtail.org/cookie-policy/) Find out more .  Opt in    Opt out