Motion Capture Storyboarding

Planning the Performance Before the Render Exists

Motion capture storyboarding is the art of planning two productions simultaneously — the one that happens on the capture stage and the one that will eventually exist as rendered footage. No other storyboarding discipline demands this kind of bifocal vision. You are drawing the performance that real actors will deliver inside a gray volume wearing lycra suits covered in reflective markers, and at the same time you are drawing the final image where those performances will live inside entirely digital environments with entirely digital faces. The gap between those two realities is where your storyboard lives.

The fundamental challenge is that nothing in the capture volume looks like the final product. When Andy Serkis performed Gollum, the stage was a featureless space. When the Na'vi sequences in Avatar were captured, James Cameron was looking at low-resolution real-time renders while the actors worked in a warehouse. Your storyboards must serve both the capture team — who need to know where bodies go, how performers interact, what the spatial relationships are — and the virtual cinematography team, who will later place cameras in a digital world that does not yet exist at the time of capture. These are often two entirely separate boards for the same scene.

You must understand the physical constraints of the capture volume: the dimensions of the stage, the placement of infrared cameras around the perimeter, the areas where marker occlusion becomes a problem, the floor surface, and the rigging points. You must also understand that the virtual world has no such constraints — the camera can go anywhere, the environment can be infinite, gravity is optional. Your job is to bridge these two realities with drawings that give every department what they need.

The Capture Volume as Stage

Every motion capture volume has hard boundaries. The infrared camera array defines a usable space, typically rectangular, and performers must stay within it or their markers drop out of tracking. Your storyboards must respect this invisible box. Draw the volume boundaries as light dashed lines in your performance boards — every choreographer, stunt coordinator, and actor needs to see where the walls are even though no walls exist. Mark the dead zones where camera coverage overlaps poorly. Indicate ceiling height for any jumping, flying, or aerial wire work.

Floor markings are your primary spatial reference. Since the volume is featureless, tape marks on the floor become the geography of your scene. Your storyboard should include a top-down volume map alongside your panel frames, showing performer positions relative to floor marks. Color-code your marks: blue for actor starting positions, red for key interaction points, yellow for danger zones near the volume edge.

Props in motion capture are simplified stand-ins — a wooden dowel for a sword, a foam block for a boulder, a wire frame for a vehicle interior. Your performance boards should depict these proxy props as they actually appear on stage, not as they will appear in the final render. The actors and capture technicians need to see what they will actually be working with.

Dual Board System: Performance and Virtual Camera

The most effective approach is maintaining two parallel storyboard tracks. The Performance Board shows what happens on the capture stage: real actors in capture suits, proxy props, volume boundaries, marker clusters that must remain visible to cameras. The Virtual Camera Board shows the intended final frame: digital characters in their CG environment, final lighting, the camera angles that will be created in post.

Number these boards with a linked system. Performance Board panel P-14 corresponds to Virtual Camera Board panel V-14. When a director reviews the boards, they can flip between what will happen on stage Tuesday and what the audience will eventually see. This dual system prevents the common disaster of planning a beautiful virtual camera move that requires a performance the volume cannot physically accommodate.

The Performance Board must call out marker visibility concerns. When two performers grapple, markers on their torsos will be occluded. When an actor crouches behind a proxy prop, leg markers vanish. Flag these moments with occlusion warnings so the capture team can plan supplementary tracking solutions — additional cameras, inertial sensors, or manual cleanup passes.

Facial Capture Framing

Facial performance capture operates on an entirely different scale and often on a different schedule than body capture. Head-mounted cameras (HMCs) record facial performance from a tiny camera mounted on a boom in front of the actor's face. Your storyboards for facial capture need to address the emotional performance at the close-up level while acknowledging that the actor's body is simultaneously being captured for full-body movement.

Draw facial capture boards as tight head-and-shoulders frames showing the intended emotional arc of each line delivery. Note which takes require the HMC and which can use witness cameras. If your scene cuts between a wide environmental shot and an intimate close-up, your boards must indicate whether facial capture quality is critical for the wide — often it is not, and the facial solve from the HMC matters only for shots where the face fills meaningful screen space.

Mark the moments where facial performance and body performance must be captured simultaneously versus moments where they can be decoupled. Some productions capture face and body separately, compositing them later. Your boards should make the production's approach explicit.

Reference Footage Planning

Before the capture session, reference footage is often shot to establish performance targets. Your storyboards should include a Reference Board layer that plans what reference material needs to be captured. This might include video of real animals for creature performance reference, documentary footage of real environments for scale reference, or stunt previsualization with physical performers doing approximations of the intended action.

Plan reference boards that show the camera angles needed for reference shoots. If your creature character is based on gorilla movement, your reference boards should indicate what specific gorilla behaviors need to be recorded and from what angles the reference cameras should capture them. This reference footage becomes the shared visual language between the director, the performance capture actors, and the animation team who will refine the final performance.

Multi-Performer Choreography

When multiple performers share the volume, spatial management becomes critical. Your storyboards must function as choreography documents. Use a layered approach: the primary panel shows the virtual camera frame, while inset diagrams show the volume from above with performer positions tracked across the sequence.

Number each performer and maintain consistent color coding throughout the boards. Performer 1 is always blue, Performer 2 always red. Draw movement paths as dotted arrows on the overhead diagram. When performers must pass close to each other, note the minimum distance required to prevent marker confusion — capture systems can lose track of which marker belongs to which performer when bodies come within roughly eighteen inches of each other.

For fight sequences, plan the choreography in phases. Phase markers in your boards allow the capture team to break complex sequences into manageable takes. Each phase should begin and end with performers in clean, well-tracked poses — typically a T-pose or a relaxed standing position where all markers are visible and the system can re-establish tracking baselines.

The Virtual Camera Pass

After body and facial performance are captured, a virtual camera session occurs where the director operates a camera within the digital environment, using the captured performances as reference. Your Virtual Camera Board is the primary guide for this session. These boards should indicate camera movement with the understanding that the camera operator has complete spatial freedom.

Draw impossible camera moves — through walls, under floors, orbiting at any radius. Mark the emotional motivation for each camera choice. The virtual camera operator needs to understand why the camera pushes in at this moment, why we crane up here, why the focus shifts there. Without a physical set providing intuitive spatial logic, every camera choice must be intentional and pre-planned.

Include lens specifications in your virtual camera boards. Even though the camera is virtual, focal length dramatically affects the relationship between digital characters and their environments. A 14mm lens creates a different spatial relationship between Gollum and the cave walls than an 85mm lens, even though neither the character nor the cave physically exists.

Bridging the Uncanny Gap

Your storyboards must account for the reality that captured performances will be translated through a pipeline that introduces interpretation at every stage. The raw capture data is cleaned, the solved skeleton is applied to a digital character rig, animators refine the performance, facial solve data is applied to a digital face model, and lighters and compositors complete the image. At each stage, creative decisions alter what was captured.

Your boards should flag the moments where the capture performance alone will not achieve the desired result and additional animation will be required. If a character needs to perform a physically impossible action — stretching an arm unnaturally, transforming their body, interacting with a digital element that has no proxy — mark these frames as requiring animation augmentation. This prevents the production from expecting capture alone to deliver shots that inherently require additional work.

Storyboard Specifications

1. Maintain dual parallel boards — Performance Board showing the actual capture volume with real actors, proxy props, and volume boundaries alongside a Virtual Camera Board showing the intended final rendered frame, linked by a consistent numbering system so any panel in one set maps directly to its counterpart.

2. Draw the capture volume as a defined space in every performance panel, showing infrared camera positions, usable tracking area, dead zones, ceiling height limitations, and floor mark positions using a consistent color-coded system for actor marks, interaction points, and boundary warnings.

3. Include top-down volume maps as inset diagrams alongside primary panels, tracking performer positions and movement paths with consistent color coding per performer, noting minimum separation distances and phase break points for complex multi-performer sequences.

4. Flag marker occlusion events explicitly in performance boards whenever performer interaction, proxy props, or body positions will block marker visibility from the camera array, noting which body segments will lose tracking and what supplementary capture solutions are recommended.

5. Separate facial capture requirements from body capture requirements in the boards, indicating which shots demand high-quality HMC facial data versus which can rely on witness cameras, and noting whether face and body can be captured separately or must be simultaneous.

6. Specify virtual camera parameters including focal length, movement motivation, and spatial relationship to digital characters in the Virtual Camera Board, treating every camera choice as a deliberate creative decision since no physical set provides intuitive spatial constraints.

7. Mark frames requiring animation augmentation beyond what motion capture can deliver, distinguishing between shots achievable through performance capture alone and shots requiring additional keyframe animation, physical simulation, or digital character manipulation in post-production.