How Do I Replace Objects in 3D Camera-Tracked Shots in Fusion?

Part 3: Camera projection, aligned 3D planes, and a displacement trick – all without leaving DaVinci Resolve.

This is the third and final Insight in this series on 3D camera tracking. In Part 1 and Part 2, we built a robust camera solve and organized our point cloud for compositing. Now comes the real payoff – and the trickiest challenge yet: replacing a door in the background of our tracked shot, entirely inside Fusion.

The challenge here is real.

Reflections from the door make it hard to find clean tracking points, and a beam crosses in front of it. But that’s exactly the kind of situation you’ll face on actual projects, and this Insight walks through how to work with what you’ve got.

You’ll learn to align a Shape3D plane to imperfect tracking data, set up a camera projection, mask out foreground elements, and add depth using displacement – all without ever leaving Fusion’s 3D environment.

“We can do things in 3D in Fusion without even going through a 3D application just by positioning image planes, transforming them, putting them in the right place… If you get good tracking information in the right place, or can somehow extrapolate where those planes are, then you can get quite far with this.”

Bernd Klimm, Compositor

Key Takeaways

By the end of this Insight, you should understand how to:

Related Mixing Light Insights

Mentioned Resources