AI video

Auto reframe

Auto reframe in short

Auto reframe is an automated crop that converts a horizontal video to a vertical or square frame by detecting the subject and keeping it in view as it moves, rather than applying a fixed centre crop that can cut the speaker out of the shot.

The technique combines face or subject detection with a smoothed camera path. Software finds the subject in each frame, decides where a vertical window should sit to contain it, then smooths that path over time so the crop glides rather than jittering with every small movement. Shot changes are detected separately so the window can jump cleanly at a cut instead of panning across it.

It matters because almost every long form source is horizontal and every short form feed is vertical. A fixed centre crop loses two thirds of the width and routinely pushes a speaker who sits off centre half out of frame. Manual keyframing works but costs minutes per clip, which does not scale to a daily posting schedule. Auto reframe makes the conversion a one click step.

The nuance is in the hard cases. Two people in one shot force a decision between a split layout, switching between them, or a wide crop that keeps both small, and the right answer depends on who is talking. Fast motion, screen shares, text on screen, and subjects with no face can confuse detection, and over eager tracking produces a frame that swims. Good tools expose the choice of layout and let the path be corrected.

In practice the workflow is reframe first, then caption, because text has to be placed against the final vertical frame. Checking the result on a phone sized preview catches the moments where the crop lands on the wrong person or clips a gesture, and a speaker aware reframe that follows whoever is talking removes most of those corrections.

Examples

  • A podcast wide shot reframed so the guest fills the vertical frame while they answer.
  • A two person interview rendered as a stacked split screen with each speaker in their own panel.
  • A stream with webcam and gameplay reframed to put the webcam on top and the game below.
Do this in Crayo with AI ReframeTake a look

FAQs

Frequent questions

It detects the subject in each frame, computes where a vertical window should sit to keep them in view, smooths that path over time so the crop does not jitter, and jumps rather than pans when it detects a shot change.

A crop is a fixed window applied to the whole clip. Auto reframe moves the window to follow the subject, so a speaker who leans, stands, or sits off centre stays in frame without manual keyframes.

Yes, with a layout decision. Common options are a stacked split screen, a switch to whoever is speaking, or a wider crop that keeps both. Speaker tracking is what lets the switch happen on the right person at the right time.

The tracking is following small movements too closely. Increasing smoothing, locking the frame during steady shots, and only moving on larger shifts fixes most of it. Shot changes should trigger a cut in the crop rather than a pan.

Still have questions?

Contact our 24/7 support team for any concerns or inquiries.

Get in touch