In Night at the Museum: Secret of the Tomb, Ben Stiller reprises his role as night guard Larry Daley, and sets out on an international odyssey to restore the powers of a magical Egyptian tablet that brings the museum exhibits to life. Without the tablet’s sorcery to sustain them, the various characters who have become Larry’s friends will return to their former lifeless states.
Shaun Levy returns as director for this third film in the popular series, with Erik Nash taking on the role of production visual effects supervisor. Under Nash’s guidance, the task of breathing life into the film’s many and varied characters fell to a collective of visual effects facilities scattered as far across the globe as Larry and his companions.
VFX supervisors from four of these facilities – MPC, Digital Domain, Cinesite and Method Studios – are here to share their experiences on the film, in this extended VFX Q&A.
MPC – VFX Supervisor, Seth Maury
How many shots did MPC deliver for the show, and how was the work divided between the different offices?
MPC delivered 250 shots in total. I was personally working on the show for about ten months.
The way MPC works is that all asset work – models, texture, rigging and so on – is centralised in London and Bangalore. From look-dev onwards, most of the work then happens in Vancouver. On Night at the Museum: Secret of the Tomb, Bangalore also animated some sequences and lit some shots; MPC are bringing up the Bangalore division to be able to do those things.
How did you get involved with the show?
I got the call back in February 2014, when I was finishing up working on Maleficent. I was really interested in the show, because I like doing character work. Also, my eight year-old son loves the movies. So I said, “I’ll do it!”
So you were primarily involved with character work?
Yes. The first time I met the production VFX supervisor, Erik Nash, he asked, “How’s your fur pipeline?” It kind of cascaded from there.
From the previous movie, we recreated animals including an antelope, a boar, a moose, a mammoth, an ostrich, a rhino and an oryx. For the British Museum scenes, we had a whole host of statues that come to life. Before I came on the movie, the production art department had worked with the British Museum to see what pieces they had that we could make digital versions of. They had some cool little turtles, and some small ceramic elephants that we made life-sized. We also made these pretty metal peacocks – for those we started with the shape of one of the museum pieces, then brought in our own colour and texture.
Natural History Museum – original plate
Natural History Museum – final composite
In revisiting the original animals, did you repurpose existing assets or create new ones?
We were given the final look-dev turntable models of some of the original characters. We also took a bunch of stills from the previous two movies for reference. A lot of times, that was a good starting point, but essentially we started from scratch, because of the way our character pipeline works and the way we do fur. Technologically speaking, a couple of years between movies is quite a long time. The modelling’s done in Maya and ZBrush. Then we use bunch of in-house plugins that run off Maya.
Did the sculptural nature of the British Museum creatures bring a different set of challenges?
Yes. The first thing we did was faithfully re-create the actual museum pieces, because we didn’t know how much latitude we had per asset. As we went along, we established which ones we could change.
One challenge was that a lot of the pieces – the ceramic elephants, for instance – were just a couple of inches long. When we scaled them up to life-size, we realised the textures didn’t look quite right. So there was a lot of translation from small to large. Erik was great about that. We would show him work in progress – an early model, then stuff at 50% and 75%. He might look at the feet on the turtles, for instance, and say, “Look at the way those feet are carved – if they’d been carved by hand at this size, the edge would be sharper.”
British Museum – original plate
British Museum – final composite
What about the animation? Presumably a ceramic elephant moves in a different way to a flesh-and-blood elephant?
A lot of the style came from the first two movies. If something was made of a material like ceramic or metal or jade, the director, Shaun Levy, definitely wanted it to move as if it were made out of that material. It’s a fine line between making that work and not having it look like bad animation!
So, for example, while the ceramic elephant moves relatively stiffly, he can swing his trunk and swish his tail, just not with the amplitude or speed that a real elephant would do it. When he takes a step, his foot has a little squash to it, but not as much as a real elephant. So you get a subtle impression of all those things you’re used to seeing in a real animal.
So do your CG models have the same skeleton and musculature as their flesh-and-blood counterparts?
By default, our rigging team put ribcages inside these creatures, so that when muscles fired or when they took a big breath you would see the impression of ribs. I would have to say, “No, actually we don’t want that, because they don’t have that inside.” It was a delicate balance: putting in a certain amount of realism, but taking out what wouldn’t actually be there.
Which sequence gave you the most challenges?
At one point in the show, there are five or six shots of the monkey, Dexter, doing an acrobatic aerial silks routine, hanging from two strips of fabric suspended from the ceiling. We created a digital monkey for that. We worked on the sequence pretty much from the beginning of the project to the end.
On-set, they had the cutest little monkey called Crystal. In the first two movies, they’d also used a digital monkey for some medium and wide shots. When we started out, we had the same agenda. We were told: “We’re going to have a digi-double, but you won’t see it in close-up.” But we decided to future-proof the asset, just in case we needed a tight shot, because it’s easier to build it high-res in the beginning than to go back and upgrade everything later.
And did those tight shots actually materialise?
Yes. Sure enough, a couple of those shots ended up being a medium to tight shot on our digital face.
We’d done a photo acquisition of Crystal, and our CG supervisor, Mo Sobhy, worked with look-dev to make the digital double work, refining the textures and so on. It’s that fine line again – mostly in the animation: “How would a real monkey do it versus a human? How can we bring monkey traits to it, but still have it look graceful?” For example, a monkey doesn’t point its toes when it’s hanging upside-down.
Can you talk about the planetarium sequence, where all the constellations come to life?
They built a beautiful planetarium set at Burnaby, near Vancouver – I haven’t seen a set that big in quite a while. They built the first floor of the planetarium up to about sixteen feet, and put a huge translight around the outside to re-create the New York environment . Our first job was to top up the set to the roof.
Hanging from the roof is a huge sphere – it looks kind of like Saturn – and then there’s a circular walkway that goes up around the outside, with all the constellations displayed. We re-created that, minus the support structures that hold the sphere up. I feel like we did a really good job with that – it’s pretty seamless.
The next thing we had to do was to bring these five constellations to life: Leo Major, Leo Minor, Orion, Scorpio, and Cancer. As the show opens, these characters made of stars kind of float up in the higher regions of the planetarium and do a little performance.
How did you go about breathing life into what’s essentially just a pattern of stars?
The first reference we got from Erik was a picture of the Orion nebula. He said, “I like the essence of this. See what you can make of it.” So we started playing with modelling some characters, and got the effects team working on what this thing might look like. Is it transparent? Semi-transparent? Do I see nebulae swirling inside? Does it have a hard shell? How well can I read each form, or is it just made up of stars? That went round and round for a while, because it really could be anything.
We put a few different ideas forward, and what we got back from Shaun Levy was: “I really want it to be made of stars.” So Erik and I worked back and forth refining that idea. We ended up with a character that’s pretty transparent, but has a subtle surface impression of nebulae and galaxies. It’s pretty cool, actually.
The constellations come to life – original plate
The constellations come to life – final composite
Given that Night at the Museum: Secret of the Tomb is the third film in a series, did it feel as if you were covering old ground?
It’s funny, it didn’t feel like ground we’d covered before. That’s the great thing about Erik and Shaun – those guys were up for fresh ideas and bringing either a new look to something, or having characters act in a different way. I think that permeated the whole project. We didn’t have to just dogmatically match what had been done before.
For me personally, I had a lot of fun with the Dexter acrobat sequence. I’d just come off Maleficent, which has a very atmospheric look, so for the Dexter sequence I enjoyed playing with light beams and spotlights to bring atmosphere to the shots, which I don’t think we’d seen in other parts of the movie. Plus, at the end of the day it’s just silly, and I know my son’s going to laugh at it!
Cinesite – VFX Supervisor, Zave Jackson
What was Cinesite’s involvement in the show?
We were tasked with the enhancement of the golden tablet – both look-dev and execution – showing the progression of its corrosion and the green glowing edge detail. We also created the golden glowing tablet shots. To do that, we referenced the first two Night at the Museum films to get an idea of the series’ vibe. We also looked at time-lapse footage of various metals corroding, and explored imagery of rust patterns and different types of tarnished metals. We delivered 87 shots over the course of about five weeks.
What happens during the corrosion sequence?
As the damaged tablet starts to corrode, the magic keeping the museum exhibits alive starts to die. There’s a close-up shot of the golden tablet on the wall of the museum, in which we see the corrosion texture crawling over its surface. The camera flies down on to the surface of the tablet to an almost macro-photography distance, then follows the decay as it advances. This establishes that the tablet is “dying” from this disease-like corrosion.
How did you go about creating the corrosion shots?
We began by building an accurate CG model of the practical tablet used on set: a golden slab with nine square sections engraved with Egyptian hieroglyphics. The squares rotate on spindles, like an ancient abacus. We knew we’d need to get extremely close to the model, seeing the fine scuffing of the polished gold surface and the more complex detail of the corroded parts, so we went through a detailed texturing process. Additional texturing work was required for the corroded version.
Next we created the intricate, organic movement of the corrosion’s green, glowing edge as it progresses over the tablet’s surface. The animated leading edge was created in 2D, using fractal noise tools. We turned the resulting animation into masks that were UV-mapped back on to the geometry. We also used the masks to displace the geometry in the 3D render, giving volume and depth to the edge of the corroded section of tablet.
For shots which didn’t need to be animated, our solution was to object-track the tablet used in the shot. We created a predetermined set of directional lighting passes, texture passes and utility passes based on a generic lighting set up and rendered using V-Ray. It was then up to the compositors to balance the lights to make the new corroded tablet fit into each shot.
Did working on Night at the Museum: Secret of the Tomb teach you anything new?
We learned that, given a body of shots that were quite similar and by using the right methodology, it’s possible to deliver a fairly large number of shots with just one person handling the lighting, and a small compositing team.
Method Studios – VFX Supervisor, Chad Wiebe
How did you get involved with the show, and how many shots did Method Studios deliver?
I’d worked with Method’s VFX producer, Genevieve West, on several Fox films prior to this, so we were confident we’d be the right fit for the Fox team, including the production VFX supervisor, Erik Nash. We delivered 209 shots, over an eight-month post schedule, with a crew of around 70 people.
Watch Method Studios’ VFX breakdown reel from Night at the Museum: Secret of the Tomb:
What was your main contribution to the film?
Our animation supervisor, Erik de Boer, has extensive experience with creature animation – he worked on Life of Pi and The Maze Runner – so we were interested in continuing to build our animation and creature repertoire. For that reason, we focused on the sequence where the lion statues in London’s Trafalgar Square come to life, and the scene in which Larry Daley (Ben Stiller) and his gang battle Xiangliu, a nine-headed snake creature. We also contributed shots involving Jed and Octavius (Owen Wilson and Steven Coogan), including the scene in the ducts, and where they’re watching kittens wrestling on YouTube.
How did you go about bringing the lions of Trafalgar Square to life?
During the London shoot, we were able to photograph the actual lion statues in many different lighting and weather conditions. This gave us texture and modelling reference, which proved immensely helpful. Together with what was shot on the day using the production’s Red cameras, that got us off to a fast start in building the lion assets.
What was your approach to animating these huge statues?
It was an interesting challenge. We wanted to respect their original scale and weight, but for shots where they chase a flashlight and wrestle, they also needed to have a kitten-like appeal and playfulness. So we keyed off the YouTube kitten clip, as well as a ton of real lion footage. To preserve the sculpted look of the animals, we skipped dynamic and harmonic skin sims for a more controlled blendshape approach in the face and body. By doing this, we matched the look established in the previous movies.
The lions’ manes needed a custom deformation toolset, created by James Jacobs and his creature team. By simulating underlying strips of geometry representing the mane, we were able to have sections sliding over top of each other and driving the deformations of the single mesh, creating more complex deformations than traditional weighting would have allowed.
Trafalgar Square lions – original plate
Trafalgar Square lions – model
Trafalgar Square lions – final composite
Did you take a similar approach with the Xiangliu?
There was a physical build of the nine-headed snake coiled in a sleeping pose. This was scanned and used as the basis for our CG build. It was also used in-shot, which proved to be extremely useful lighting reference.
From an animation standpoint – as well as visual – we wanted a creature that not only stayed true to its statuesque origin, but also fully reflected the real-world attributes that make snakes such amazing creatures.
How did you choreograph the action?
The sequence was extremely well-thought out – we were provided post-vis which was very close to what the director wanted from a blocking standpoint. Using this as reference, our animators were able to move full steam ahead with a clear target, pushing out some amazing animation in a very short amount of time.
From there, our lighting team got a very clear indication of where our creatures would be in the environment. This was a big plus, due to the challenges associated with trying to light nine reflective, tubular shapes all competing for screen space. For example, we noticed very early on that the most minor position change of one snake would have a dramatic impact on the lighting and reflections of all the others.
Animating nine heads simultaneously must have been quite a challenge.
The key for the snake animation was finding the balance between managing the shapes with animation controls, and maximising the usability of the rig for the animators – making sure it didn’t become too heavy or counter-intuitive. We wanted strong, broad shapes with solid, serpentine motion, and a real sense that the heads were driven and lifted all the way back from the tail, which was connected to the sculpture’s base. Our creature TD, Paul Jordan, created a very successful rig for this that allowed us to design the overall motion on one level, and to twist and sculpt on several lower layers.
Tell us more about the rig.
The big challenge was creating a rig which would allow extreme poses and actions without compromising the look of the snake or overly distorting its geometry. We also had to come up with a way to have the snakes’ scales behave in a realistic manner. Paul developed a follicle system that would allow each scales to slide over the next. That way, they stayed as true as possible to their original size and shape.
Did you bring anything new to the miniature characters of Jed and Octavius?
One interesting new bit of technology we employed was “focus stacking”, which created a much more realistic marriage between Jed and Octavius and their full-size environment.
When shooting macro-photography with traditional cameras, you typically have a very narrow depth of field. When compositing actors, this can typically result in a visual mismatch. For Night at the Museum: Secret of the Tomb, we created our background plates by shooting footage in which we racked focus from a locked-off camera. We then compiled all the in-focus areas into one image. This allowed us to do something that’s traditionally not possible in miniature photography: create an infinite depth of field, and then adjust it to taste.
Jed and Octavius – original greenscreen plate
Jed and Octavius – final composite
By this process of focus stacking, we were able to control and match the two opposing elements, allowing us to make the backgrounds look as though they’d been shot through tiny cameras in scale with our miniature characters. It also allowed us to preserve all the great detail you get from shooting real-life objects instead of building giant props, which can create its own visual challenges.
Digital Domain – VFX Supervisor, Lou Pecora
How many shots did Digital Domain deliver, and which sequences do they feature in?
Digital Domain executed around 340 shots. I started on the show after principal photography had wrapped in late summer, so we did this volume of work between August and November.
We were lucky enough to get the Escher Tablet Pursuit sequence, the Pompeii diorama eruption, the Greek statue encounter, and a smattering of complex 2D split screens with double the Stiller!
Let’s begin with the volcanic eruption. How close to reality did you stick?
For Pompeii, we studied lots of real volcano eruption footage to figure out which parts we could keep and which we had to lose. For instance, most of the real oozing lava we studied didn’t flow nearly fast enough to be as threatening as the sequence required, but the eruptive elements spewing out of the caldera were more true to life.
Many films have used the splitscreen trick to duplicate actors. How did you go about twinning Ben Stiller?
For the “Ben and Ben” splitscreen work, we went back and watched Multiplicity. There’s some phenomenal work in there – work that definitely still holds up today.
The scenes where there are multiple Michael Keatons in the shots at the same time that don’t interact were really good; however, two shots in particular stood out to me. The first is where Michael Keaton’s character takes a cigarette out of a clone’s mouth, who then blows smoke back at him. The second is the scene where the original Doug keeps refilling clone #4’s glass with Coke. These shots where they interact with each other, and interact with the same objects, were the most impressive, so that’s what we aimed for.
We have a few places where Ben’s Larry character and his Laa character touch each other – patting each other on the back, touching faces, and so on. That really sells the effect, and it definitely was as difficult to execute as you would imagine.
Can you describe the Escher Tablet Pursuit sequence?
The whole process of bringing this piece to life was one of the more interesting challenges I’ve faced in my career. In the sequence, three live-action characters end up in the M.C. Escher lithograph called “Relativity”. In this world of multiple gravities, a chase ensues with the characters all trying desperately to lay their hands on the tablet.
How did you set about transferring M.C. Escher’s mind-bending artwork on to the screen?
We studied the original artwork and other Escher pieces to make sure that the etch treatment we put on the photographic elements was authentic to his style. Taking a static piece of lithography and turning it into a cinematic experience brought all kinds of things into consideration – things one would never think about. For instance, how would we deal with motion blur, depth of field, and moving shadows? These were all design details that required lots of trial and error.
Then, based on solid previs from Proof, our VFX supervisor, Swen Gillberg, shot all of the action on a small greenscreen stage in Burnaby, Vancouver.
How did you make your CG set look like the original lithography artwork?
We came up with complex shaders that dynamically resized the pattern density based on factors such as distance to camera and size in frame. Our CG supervisor, Tim Nassauer, devised a very clever way to achieve this by using multiple interlocking patterns that would increase the density and fidelity of the etch lines as the surface moved closer to camera.
Studying the Escher artwork taught us that shadows aren’t just darker areas due to light being occluded, but rather a more dense arrangement of the lithographic pattern that’s present in surrounding areas. This led us to render a full set of the denser pattern to be revealed through shadow mattes; these were either generated in the scene, rotoscoped or keyed from the plate photography. Our compositing department, supervised by Francis Puthanangadi, was ultimately tasked with blending these various density passes to attain the appropriate line density and fidelity.
It sounds like a highly technical challenge. Did you also have to make a lot of artistic judgement calls?
VFX always involves a balance of technical acumen and artistry. This sequence definitely provided its share of technical challenges, but most of the journey was spent making artistic decisions and creative calls.
The etch treatment applied to the photography, for example, was very finicky and sensitive, depending on how large or small something was in frame. There was no real formula for it, only artistic instincts on what looked right: pattern angles; how many different sections we would need; how fine or coarse the pattern should be; how heavily the effect should be printed in. These would all have to be dialed in on a case-by-case basis, sometimes animating them throughout a shot if we were going from wide to close or vice versa.
Did the same apply to more conventional effects such as motion blur?
Dealing with motion blur, depth of field, and so on is usually very straightforward. In this case, however, we had to make a lot of artistic calls on how they should be handled. Do we put the etch on before the defocus and let the lines get blurry? Do we let the etch treatment get motion blurred, or do we put the motion blur on before the treatment? There were many variables and decisions to make along the way and our comp lead, Brian Rust, and look-dev artist, Joe Spano, ran through the gamut of these variables – and many more – to achieve what ultimately became the look for the sequence.
For the most part, there’s some semblance of reality that one can use as a metric to see if an effect looks “right”. The design-oriented nature of this work made that more difficult, as we had to rely so much more on our far less concrete artistic intuitions. In the end, that was what made it so satisfying as it all came together.
What new personal challenges did this show set for you?
The bulk of my experience is in compositing – I was a compositing supervisor for years before becoming a VFX supervisor. So I never had much exposure to animation – particularly character animation. This show gave me a lot more experience in that arena.
Working closely with our animation director, Phil Cramer, and animation lead, Frankie Stellato, I was exposed to both traditional keyframe hand-animated work, as well as Digital Domain’s new cutting edge Direct Drive facial animation system. This was a fantastic learning opportunity for me that I took full advantage of.
I was extraordinarily lucky to be a part of the fantastic team that put this film together. Across the entire spectrum – the executives and internal team at Fox, director Shawn Levy, production VFX supervisor Erik Nash, the entire team at Digital Domain, and our counterparts at other VFX facilities – I was lucky enough to get to work with old friends … and make some new ones as well. For me, the most important part of a show is the team of people I’m working with on a daily basis. We spend most of our waking lives at work in this business, and long weeks away from home, and to be surrounded by people who are supportive, collaborative, creative and downright fun to be around makes going to work every day a thoroughly enjoyable and satisfying experience.
Special thanks to Jonny Vale, Karl Williams, Adam Brown, Melissa Knight, Ellen Pasternack and Rita Cahill. Night at the Museum: Secret of the Tomb photographs TM and © 2014 Twentieth Century Fox Film Corporation. All rights reserved. Not for sale or duplication.