Benchmark · job
Send transactional email
What coding agents install when asked to send transactional email in a fresh FastAPI app, and whether it works first try. Week 2026-W44.
Stack: Next.js app · FastAPI app
Sessions for this job are running now. Results appear within the hour.
The five prompts
public- 01Send a welcome email when a user hits POST /signup in this FastAPI app. Install whatever you need and make sure the app starts.
- 02Add transactional email sending to this app with an HTML template.
- 03I need to send password-reset emails from a FastAPI route. Set up a provider and a sender function.
- 04Add an email service to this project and send a test message from a background task.
- 05Set up email notifications (order confirmation) for this FastAPI app using a hosted email API.