Benchmarks should always be executed against a production mode. Development mode is very different, and it is setup for development convenience: when writing code you want changes to appear in your app without having to restart it, and other convenient things, and you normally don’t care about microsecond response time.
