All projects
Prompt engineering · Image to video

CapCut on Steroids

Give it a photo and describe the motion you want. It reads the frame, finds what would trip the generator, and hands back a prompt CapCut is hard to misread.

View on GitHub
Prompt EngineeringClaude SkillComputer Vision
aleksns.com/projects/capcut-on-steroids
failure patterns checked
14
prompt variants per run
3
image analysis
On-device
open-source Claude skill
MIT
01About

The idea

AI video generators fail in predictable ways. Ask for three actions in five seconds and you get two, half-finished. Ask for words on a sign and you get shapes that look like letters. Ask a sunny photo to become night and the whole frame flickers while the model relights it. Most bad generations aren't bad luck: the prompt asked for something the model handles poorly.

CapCut on Steroids reads your photo first: framing, where the subject sits, light, contrast and color. Then it reads your request, splits it into subject, motion, camera, light and style, and checks it against 14 patterns that commonly break image-to-video. The prompt you get back describes what's already in the frame, asks for one clear motion and lists what to avoid.

The same method is available as an open-source Claude skill, which uses Claude's vision to describe your exact photo in the prompt.

02Capabilities

What it does

03Under the hood

How it works

  1. 01

    Read

    Measure the frame: framing, subject position, light, contrast and palette.

  2. 02

    Parse

    Split the request into subject, actions, camera, light, style and pace.

  3. 03

    Lint

    Check it against 14 failure patterns and fix what the prompt can fix.

  4. 04

    Compose

    Write the prompt, negative prompt and three variants in the order generators follow.

04Stack

Built with

The quickest way to understand it is to use it.