Virtual Production & Real-Time Concept Art

Designing Worlds That Render at the Speed of Light

Virtual production concept art is the newest frontier of the discipline — the design of environments, lighting states, and visual effects that will be rendered in real-time by game engines and displayed on massive LED volumes behind physical actors on a soundstage. This is concept art that must account for a new set of constraints and possibilities: the environment will be interactive, responding to camera movement in real-time. The lighting will be physically accurate, cast by the LED wall itself onto actors and practical sets. The boundary between real and virtual will be invisible to the camera.

The revolution began with The Mandalorian (2019), where ILM's StageCraft system — a semicircular LED volume driven by Unreal Engine — replaced traditional green screen with photorealistic, real-time environments that lit the actors, reflected in their armor, and moved with the camera. This was not a post-production technique; it was a production technique, and it fundamentally changed the role of the concept artist. The concept painting was no longer a static reference image — it was a preview of the actual rendered environment that would appear on the LED wall.

Virtual production concept art must therefore bridge two worlds: the traditional painterly skills of visual development and the technical understanding of real-time rendering, game engine capabilities, LED display technology, and the hybrid physical-digital filmmaking pipeline.

---

Visual Language

Color Palette

Virtual production color design must account for the color science of LED volumes. LED walls have specific gamut capabilities — typically Rec. 709 or DCI-P3 color spaces — and concept art palettes should be designed within these gamut boundaries. Colors that exist in a painter's imagination but fall outside the LED panel's reproducible gamut will appear differently on the volume than in the concept art. Concept palettes should favor the mid- saturation range where LEDs perform best, avoiding extreme saturation that may clip or shift. The LED wall also provides interactive light to the physical set — the concept palette directly determines the practical lighting on actors and props, making color decisions more consequential than in traditional concept art.

Lighting

Lighting in virtual production concept art has dual significance: it describes the visual appearance of the environment and it determines the physical lighting that the LED volume will cast onto the live-action set. When the concept shows a warm sunset, that warm light will actually illuminate the actors' faces through the LED panels. This means lighting design in concept art must consider both the background environment's atmospheric quality and the foreground practical lighting effect on actors and sets. Key concepts include the "frustum" (the portion of the LED wall visible to camera, which requires highest quality rendering) and the "light wrap" (the surrounding LED panels that provide interactive lighting but are not directly visible).

Materials & Textures

Virtual production materials must be designed for real-time rendering fidelity. Concept art should indicate material properties in terms that translate to PBR (Physically Based Rendering) material systems: base color, metallic/non- metallic, roughness/smoothness, normal detail, and emissive properties. Concept artists should understand that every material they design will be built as a PBR shader in Unreal Engine, and should avoid depicting materials that cannot be efficiently reproduced in real-time rendering. The physical set materials (practical set pieces in front of the LED wall) must seamlessly match the virtual environment materials — concept art should indicate where the physical set ends and the virtual environment begins.

---

Design Principles

• The concept is the content. In virtual production, the concept painting is a direct preview of the rendered environment. The gap between concept and execution is smaller than in any previous production pipeline. Paint accordingly — the level of fidelity, the color choices, and the spatial relationships will be reproduced nearly verbatim.
• Design for the volume, not the frame. LED volume environments are typically 270-degree panoramic projections. The concept must design the entire visible environment, not just the camera's initial framing. Consider what the camera sees when it pans, tilts, and dollies within the volume.
• Physical-virtual boundary is invisible. The transition from physical set (floor, foreground props, actors) to virtual environment (LED wall background) must be seamless. Concept art should indicate this transition line and design both sides to match in material, lighting, and scale.
• Interactive light is real light. The LED wall does not just display a background — it lights the scene. Concept lighting decisions directly affect the practical illumination of actors and sets. Design lighting with awareness of its dual function.
• Parallax demands depth. As the camera moves within the volume, the real-time environment must exhibit correct parallax — near objects shifting faster than far objects. Concept art should indicate depth layers and their relative distances to ensure parallax reads correctly.
• Performance ceiling is real. Real-time rendering has frame rate and polygon budget constraints. Concept art for virtual production should be ambitious but achievable — avoid designing environments with complexity that cannot be rendered at 24fps or higher on available hardware.

---

Reference Works

• The Mandalorian / ILM StageCraft — The production that mainstreamed virtual production. Its concept art by Doug Chiang, Ryan Church, and the Lucasfilm art department became the direct visual reference for Unreal Engine environments rendered on the LED volume.
• Epic Games / Unreal Engine — The primary real-time engine for virtual production, whose material system, lighting tools (Lumen), and rendering capabilities define what is achievable in VP environments.
• Netflix Virtual Production — Productions like 1899 and The Sandman have pushed LED volume techniques into diverse genre applications beyond the sci-fi environments where VP originated.
• Disguise — Media server and workflow platform whose integration with Unreal Engine manages the real-time content delivery to LED volumes, including camera tracking and frustum rendering.
• ARRI Mixed Reality — Camera manufacturer whose integration of camera tracking data with real-time rendering establishes the technical pipeline from concept to on-set execution.
• Lux Machina / PRG — LED volume stage operators whose technical expertise in panel calibration, color science, and stage design directly influences what concept artists can achieve on the volume.

---

Application Guide

Begin with the stage specifications. Know the dimensions of the LED volume: its diameter, height, ceiling (if present), resolution, pixel pitch, and color capabilities. These physical parameters define the canvas. A concept designed for a 270-degree, 20-foot-tall volume with 2.84mm pixel pitch has very different requirements than one for a flat 40x20-foot LED wall.

Design the physical-virtual boundary first. Determine how much physical set will be built in front of the LED wall — typically the floor and foreground elements within 10-15 feet of the camera. The virtual environment begins where the physical set ends. This transition line must be invisible to the camera, which means matching materials, lighting, and geometry precisely at the boundary.

Create the concept as a panoramic environment, not just a single frame. Paint or render the full 270-degree (or wider) environment that the LED wall will display. The camera may frame any portion of this environment, and it must all be designed to the same level of fidelity and narrative consistency.

Indicate depth layers explicitly. The virtual environment must be constructed in depth layers for correct parallax: a foreground layer (5-15m virtual distance), a midground layer (15-100m), and a background layer (100m to infinity). Concept art should clearly separate these layers and indicate their relative virtual distances.

Design lighting with dual awareness: how the environment looks as a background and how it lights the physical set as a practical light source. A bright sky in the concept will flood the set with ambient light. A dark interior with a single window will create dramatic directional light on the actors from the LED panel displaying that window. Every lighting decision in the concept is a practical lighting decision on set.

Deliver concept art alongside technical annotations: frustum position (where the camera will point), physical set extent, virtual distance markers, LED wall coverage diagram, and lighting intent notes for the VP supervisor and gaffer.

---

Style Specifications

1. Panoramic Format Delivery. Deliver environment concepts in panoramic format (equirectangular projection, ideally 360x180 degrees, or minimum 270x90 degrees matching the LED volume coverage). In addition, provide hero frame crops at the camera's intended aspect ratio (typically 2.39:1 or 1.78:1) showing the primary composition.

2. Physical-Virtual Transition Diagram. Include a plan-view diagram showing the LED wall curve, the physical set footprint, the camera position(s), and the transition line where physical set meets virtual environment. Annotate with distances in feet or meters. This diagram is essential for the VP supervisor, set designer, and gaffer.

3. Depth Layer Separation. Deliver the concept with explicit depth layer identification: which elements are foreground (physical set), which are near-virtual (closest virtual layer, highest parallax), midground, and background (sky dome, minimal parallax). Label each layer with its intended virtual distance from camera.

4. LED Color Gamut Verification. Design the concept palette within the LED volume's color gamut (typically DCI-P3 or Rec. 709). Avoid highly saturated colors in the red and deep blue ranges where LED panels may clip or shift. Test critical colors against the LED manufacturer's gamut documentation before finalizing the palette.

5. Interactive Lighting Annotation. Annotate the concept with lighting notes that address both the environmental appearance and the practical lighting effect: "Sunset sky — warm fill on actor faces from screen-left LED panels," "Window highlight — hard key light at 45 degrees from the single bright window panel." The DP and gaffer use these annotations to plan supplemental practical lighting.

6. Performance Budget Awareness. Note the relative complexity of each environment area: high-density vegetation, particle effects (rain, fog, fire), reflective water surfaces, and animated elements all impact real- time rendering performance. Flag any concept elements that may require optimization discussion with the Unreal Engine team.

7. Camera Movement Envelope. Indicate the expected camera movement range within the volume: how far the camera may dolly, pan, tilt, and crane. This determines how much of the panoramic environment must be fully resolved (the "frustum" area) versus how much serves only as light wrap. Wider camera movement ranges require more fully resolved environment area.

8. Continuity Across Setups. When multiple camera setups will use the same virtual environment from different angles, deliver concepts for each major setup showing how the environment reads from each camera position. The environment must maintain visual consistency and narrative logic from all planned camera angles, just as a physical location would.