AR Suite
...
AR Workflow
Compositing: Legacy Composure ...

Step 7 - Configuring the Composure Stack

16min
create a composure comp and add the film input once the camera has been set up the composure composite can be created start by opening the composure window from the virtual production tab of the window menu right click within it to create a new empty composure comp shot video configuration without a keyer this step should only be completed if the "video" input configuration option was chosen when running the workflow wizard and therefore no keyer is required once the comp has been created it's input needs to be connected to the media bundle texture that was configured during step 3 add media bundles docid\ loebmyzp8 nepiwdgizce do this by selecting the comp and expanding the "input" section within it's property panel add a new input to the "inputs" array by clicking on the "+" button expand the list of inputs and set the type of the new input pass to be a "texture input" make it reference the "t video bc" asset before finally setting the pass' name to "film" video configuration using the composure keyer this step should only be completed if the "video with composure keyer" input configuration option was chosen when running the workflow wizard becuase the video requires keying the "video with composure keyer" input configuration option within the ncam workflow wizard generates a bp mediaplatecompelement within the scene that is automatically connected to the input media device it can be used to remove green/blue screen from the input video as it has already been configured just move it into the comp composure stack configure the amount of overscan overscan is required to correctly render lens distortion when using the legacy composure pipeline it allows the bp ncamcgcapture media layer to capture additional pixels (expressed as a percentage of the resolution) to account for the lens distortion requirements the amount of overscan that is used is managed from the project settings and a value of 1 2 , which is the default, is typically a good starting point this value might need to be increased when particularly extreme lens distortion is present add an ncam distortion map layer element a “bp ncamdistortionmap” media plate layer must be added to the stack to apply any lens distortion to the cg capture create it by right clicking on the comp and selecting "add layer element" followed by "bp ncamdistortionmap" name the new layer as "distortion" add an ncam cg capture layer element unlike standard composure composite stacks this workflow requires the use of a special cg layer called a "bp ncamcgcapture" this layer captures the cg but with an additional amount of overscan so that the lens distortion layer can be correctly applied just as before, create it by right clicking on the comp and selecting "add layer element" followed by "bp ncamcgcapture" name the new layer as "cg" the minimum composure stack required is shown below where comp the comp which includes the film media input distortion bp ncamdistortionmap layer element cg bp ncamcgcapture layer element add the optical offset transform pass in order to crop and apply the optical offset to the cg (effectively removing the overscan) you need to add an “ optical offset pass ” to the composing element, this should sit before the actual compositing material add the optical offset pass by first selecting the comp and navigating to the "transform passes" section and clicking on the "+" button change the type to "optical offset pass and ensure that the "cg" layer element is the input set it's name to "opticaloffset" so that the following compositing pass can easily reference it create and add the compositing pass the material used for the compositing transform pass will differ depending on how the various elements are being layered together usually an augmented reality composite is created in one of two ways either the cg is overlaid onto the video to create the illusion of a virtual object existing within a real scene or the inverse is achieved where a masked element is placed into a virtual scene both setups are explained in the following two sections follow the one which is appropriate for your scenario virtual overlay composite (cg over video) in this example we will illustrate a "virtual overlay" composite where the cg is overlaid onto the video this material is provided as part of the ncam ar suite lite plug in and can be found in the "ncam ar suite lite content/composure" content folder it is illustrated in the image below note that the "scaleuv" node is required to correctly sample and apply the lens distortion texture parameter to the cg add the compositing element material pass to the comp in a similar way to the optical offset pass make sure that the type is set to "compositing virtual element material pass" and the material is set to "virtualoverlaycomposurematerial" the cg input needs to be connected to the output of the optical offset pass the complete stack of transforms is illustrated in the image below virtual studio composite (keyed video over cg) in this example we will illustrate a "virtual studio" composite where the video which has been keyed (to remove the green/blue screen) is overlaid onto the cg scene this material is provided as part of the ncam ar suite lite plug in and can be found in the "ncam ar suite lite content/composure/" content folder it is illustrated in the image below note that the "scaleuv" node is required to correctly sample and apply the lens distortion texture parameter to the cg add the compositing element material pass to the comp in a similar way to the optical offset pass make sure that the type is set to "compositing virtual element material pass" and the material is set to "virtualstudiocomposurematerial" the cg input needs to be connected to the output of the optical offset pass and the film input connected to the output of the keyer the complete stack of transforms is illustrated in the image below set and configure the output of the comp this step will only work successfully if an output device was added during when running the ncam workflow wizard the final step is to output the result of the comp over the sdi this stage requires that the ncam workflow wizard was run with at least one output device specified in the list of outputs to connect the output of the comp to one of those output devices first select the comp from within the composure window scroll through it's properties to locate the section called "output" click the "+" button to add a new output to the "outputs" list change the type of the output "compositing media capture output" this type allows the comp to write it's output to an existing media capture device via a media proxy in this case we want to connect it to one of the two possible devices created when running the ncam workflow wizard for each device there exists a proxy asset which should be chosen for the comp's "capture output" attribute for example, "outputproxy0" will write the output of the comp to the first device and "outputproxy1" to the second device if it exists these steps are illustrated in the image below