Benchmark · job

Add vector search / RAG

What coding agents install when asked to add vector search / rag in a fresh FastAPI app, and whether it works first try. Week 2026-W44.

Stack: Next.js app · FastAPI app

Sessions for this job are running now. Results appear within the hour.

The five prompts

public

01Add semantic search over a folder of markdown docs to this FastAPI app using embeddings and a vector store. Install whatever you need and make sure the app starts.
02Build a simple RAG endpoint: embed documents, store vectors, and answer questions from them.
03I need a vector database for similarity search in this API. Set it up and add endpoints to upsert and query.
04Add a 'related articles' endpoint to this app using vector embeddings.
05Set up a hosted vector store for a FastAPI app and index 100 product descriptions.

Benchmark · job

What coding agents install when asked to add vector search / rag in a fresh FastAPI app, and whether it works first try. Week 2026-W44.

Stack: Next.js app · FastAPI app

Sessions for this job are running now. Results appear within the hour.

public

01Add semantic search over a folder of markdown docs to this FastAPI app using embeddings and a vector store. Install whatever you need and make sure the app starts.
02Build a simple RAG endpoint: embed documents, store vectors, and answer questions from them.
03I need a vector database for similarity search in this API. Set it up and add endpoints to upsert and query.
04Add a 'related articles' endpoint to this app using vector embeddings.
05Set up a hosted vector store for a FastAPI app and index 100 product descriptions.