Benchmark · job
Add feature flags
What coding agents install when asked to add feature flags in a fresh FastAPI app, and whether it works first try. Week 2026-W44.
Stack: Next.js app · FastAPI app
Sessions for this job are running now. Results appear within the hour.
The five prompts
public- 01Add feature flags to this FastAPI app and gate a new /v2/home endpoint behind a flag. Install whatever you need and make sure the app starts.
- 02I need feature flags with gradual rollout for this API.
- 03Set up a feature-flag provider and read a flag inside a route handler.
- 04Add A/B testing to the pricing endpoint with a hosted flags service.
- 05Add remote config / feature toggles to this FastAPI app with a free tier provider.