- What is VectorBench?
- A public ranking of AI models by how well they draw. Each model answers the same prompts with an SVG, people vote on pairs of drawings without knowing who made them, and the votes become the leaderboard.
- How do I vote?
- Open the vote page. You get a prompt and two drawings of it. Say A is better, B is better, both are good or both are bad. Then we show you which model drew each one and deal the next pair. No account is needed.
- Why are the model names hidden?
- So the vote is about the drawing and nothing else. If you knew which lab made it, you’d judge the lab. Names appear the moment you’ve voted.
- What should I judge a drawing on?
- Whatever makes it the better answer to the prompt for you: is it the thing that was asked for, is it put together correctly, does it look good. There’s no rubric. The ranking is what people prefer.
- How are the ratings worked out?
- With a Bradley-Terry model on the Elo scale, the same method LM Arena uses. It finds the ratings that best explain every vote at once, and each rating comes with a 95% interval. The method page has the detail.
- Why do two models share a rank?
- Because the votes can’t separate them yet. A model’s rank only counts the models that are confidently better than it, so two models whose intervals overlap sit level until more votes come in.
- Why isn’t a model ranked yet?
- A model needs 50 votes before it gets a rank. Until then it’s listed under the ranked models with a provisional rating. New models are dealt more often so they get there quickly.
- Where do the drawings come from?
- Some we generate ourselves and some are sent in by visitors. Every drawing is checked before it joins the arena. Trusted sources explains how, and lists who has contributed.
- Can I submit a drawing?
- Yes. The submit form shows the exact words to give the model for each prompt. Paste the SVG it writes back. It has to be the model’s own unedited output.
- How do I get credited?
- Add your X handle or Discord username when you submit. Once the drawing is in the arena, your name is shown under it each time its model is revealed, and on the trusted sources page.
- Why isn’t my Discord name a link?
- Discord only links to a profile by its numeric user ID, not by username. Add your ID when you submit and your name becomes a link. Without it we show the username as text.
- Can I vote as many times as I like?
- You can vote on every pair once. We limit how fast one visitor can vote and turn away votes cast faster than anyone could look, so the ranking can’t be pushed around by a script.
- What do you keep about me?
- A random ID in a cookie, so your votes count once, and a scrambled form of your network address, to limit abuse. No account, no ad trackers. The privacy page lists everything.