Stampede 1.3 released - record load tests in your browser, see inside your app, and test AI chat APIs

Stampede 1.3 is out. It’s the load tester I’ve been building for Phoenix, and this release is about using it on real apps.

What’s new

  • mix stampede.record starts your app, you click through it in a browser, and you get a scenario with your clicks, forms, uploads, channels, navigation and pauses. Signing in works too: it goes through the real form with a fresh CSRF token, and each VU keeps its own session. Passwords become "CHANGE_ME", so they don’t end up in a file you might commit. I tried it in real Firefox on a phx.gen.auth app.
  • --probe app@host shows what’s happening inside your app during a run: scheduler use, memory, processes, run queue and the longest message queues, plus Phoenix, LiveView and Ecto timings measured by the app itself. The app needs no changes, and a --find-limit verdict now says when the server’s schedulers ran out.
  • Stampede.LLM load tests anything that speaks OpenAI’s format, such as Ollama, vLLM or llama.cpp, and records time to first token and the gaps between tokens.
  • Stampede.SSE reads Server-Sent Events from any server, with when each event arrived.
  • Stampede.HTTP keeps cookies with cookies: true, sends forms with form:, and reads a page’s token with csrf_token/1. Stampede.LiveView.connect/2 shares those cookies, so a scenario can sign in over HTTP and then open a LiveView as that user.
  • keep: on Stampede.Channels.connect/2 is for VUs in busy channels that hear far more than they read.
  • There’s a new guide to watching a run in Prometheus and Grafana.

Tested on AWS

On one 4-core, 32 GB machine, with three more running Stampede:

  • Stock Phoenix held 600,000 Channels users, with joins in 31ms and messages in 10ms at p95.
  • A real open source Phoenix product, self-hosted from its official release, held 50,000 users for 10 minutes, with 100 users in each channel, 80.9 million messages and a round trip of 5.71ms at p95.

Everything to rerun them is in bench/million, with every number they produced.

Repo:

Docs: https://stampede.hexdocs.pm

If you try it on your app, I’d love to hear what breaks, in Stampede or in your app.

1 Like