Selecting a Workflow

there are a number of ways that ncam data can be used with the unreal engine for example to drive an led volume using ndisplay or to render a virtual studio by replacing a green screen with a cg background the ncam ar suite plug in doesn't force a particular workflow on the user and instead aims to simplify and support however they wish to work there are multiple ways to composite ar content together with the unreal engine but regardless of the workflow there are always a few necessary or common components media inputs and outputs, camera tracking data, lens data and a way to synchronize it all building and configuring all of these components together can be time consuming, inflexible and error prone the ncam workflow wizard aims to streamline this process by automating the generation and configuration of these assets for the user once created, a method of compositing can be chosen and implemented this guide aims to illustrate the various workflow options available to the user, how to choose one and the pros and cons of each livelink subjects the camera tracking data provided by ncam reality using it's two sdks (the standard and lite versions) is made available to the unreal engine via livelink each livelink subject provides different data which changes their capabilities and consequently the what workflows they support this is illustrated in the table below livelink subject camera and lens tracking fiducial tracking wireless camera tracking anamorphic lenses ncamlens x x ncamcamera x x ncammarkers x the choice of ncam sdk effects which livelink subjects are available the standard ncam sdk enables the ncamlens, ncamcamera and ncammarkers livelink subjects the ncam lite sdk only enables the ncamlens livelink subject this and the capabilities of each should be considered when selecting which to use compositing workflows once the supporting assets have been created by the workflow wizard a method of compositing the cg with the film needs to be chosen the two main solutions for this are to either use the ncam ar suite rendering pipelines or unreal's composure framework composure with livelinklens compatible livelink subjects ncamcamera, ncamlens the latest version of composure adds support for lens distortions through the livelinklens plug in this allows for a simpler set up than the legacy composure workflow at the cost of support for anamorphic lenses because it supports the ncamlens livelink subject it can be used with the ncam sdk lite legacy composure compatible livelink subjects ncamcamera the older, legacy composure workflow is a little more complicated to set up than the "composure with livelinklens" workflow however it has fewer restrictions on the type of lens that is used one consideration is that it can't be used with the ncamlens livelink source ncam ar suite compatible livelink subjects ncamcamera the ncam ar suite is designed to be a plug n play solution for rendering virtual overlay and virtual studio composites requiring only a camera to be dropped into the scene, it is easy to set up it includes a range of useful rendering features such as hold outs (shadow receivers) and 3d garbage mattes one consideration is that it can't be used with the ncamlens livelink source selecting a workflow the flow chart below aims to break down the options and highlight the documentation that you should read for each set up configure ndisplay workflow docid\ qqmioxn0mgks0re9yx pj configure ar workflow docid\ yorg8osrcxwoskgk1y2yp compositing ar suite docid\ umxjtgrzk7yzsjdz7nyue composure legacy guide docid\ ijniyzyfryl1dfytorjdn compositing composure with livelinklens docid\ hbmv637bpxuyk6dwxkcp