Real-time face tracking + Projection Mapping = Face Hacking

Japanese producer and projection mapping specialist Nobumichi Asai colaborated with make-up artist Hiroto Kuwahara along with French digital image engineer Paul Lacroix to create this awesome video art installation entitled Omote. The title refers to the mask used in the traditional Japanese musical drama of Noh. Using real-time face tracking and projection mapping the team created a virtual mask on the face of a live mode..

The woman wears no makeup. Instead her face is covered in tiny sensors for 3D laser scanning of her features and the projection of a perfectly accurate three-dimensional facial replica making her appear as though her eyes are open when they’re really closed and that she’s wearing makeup:

Or undergoing surreal transformations straight out of anime or science fiction:

Welcome to the marvelous world of face hacking:

Watch Omote to get the full effect of this stunning project.

Then click here for even more of Nobumichi Asai’s awesome face hacking projects. We can’t wait to see how this fascinating technology is used in future.

[via Business Insider, RocketNews24 and WebUrbanist]


Behind the Scenes: The Chemical Brothers ‘Wide Open’

A look at the process from The Mill shows how they put together the latest video for the Chemical Brothers directed by Dom&Nic, using 3D scanning and rendering to produce that ‘how the hell did they do that convincingly’ transparent one shot effect:

… Teaming up with Efficacy4D, we captured a LIDAR scan of the set and then used the scan to ensure that we had a very accurate track. Matching the dancer would’ve been a whole lot harder if we couldn’t trust the camera track.  We used the scan to project HDRI images for accurate lighting, which was also incredibly useful for making clean plates.

… By far the most labour intensive part of the project was the 3D tracking (matchmoving). Our team of animators had to position each limb so that it exactly matched Sonoya’s pose on all 6,798 frames. This is one of the most complicated things that we do in VFX and is a highly intricate and skilled job. How did we overcome this? Patience, lots of patience.

Not only was this the longest shot we have ever tracked, we incorporated a range of new procedural modelling techniques, human body scanning, lidar scanning, motion capture, an extremely complex rig, animated lighting, cloth simulation and a huge amount of cleanup work. These combined added up to an extremely complex blend of techniques.

More Here


Home Sweet Home

Usually plastic and the environment do not go hand in hand, but artist Aki Inomata uses plastic to create an environment for her little pet hermit crabs in “Why Not Hand Over a “Shelter” to Hermit Crabs?” (2009, 2010-2013).

With the help of CT scanning to render a three-dimensional model of an empty shell, Inomata creates her base and then builds houses atop these shell renderings. These architectural wonders mimic the style of popular dwellings, from Tokyo house-style to Paris apartments. 

With these plastic hermit crab habitats, Inomata wanted to explore not only the hermit crab’s adaptability to new surroundings, but how we adapt as well. Immigration, relocation, even acquiring a new identity or nationality is more or less the human version of growing out of a shell, and finding a new one to call ‘home’.

Not only is this series an amazing symbolic representation of our will to adapt, but also a fun way to learn more about the life and physiology of the hermit crab, as the dwellings are completely see-through. Have you ever wondered what a hermit crab’s body looks like inside its shell?

A video of both the hermit crabs in action and how the artist came about designing the shells can be found here.

-Anna Paluch


More images of bones that were 3D printed from a CT scanned cheetah (photos of that process here).

Anthropologist and conservationist JP Brown modeled and rendered this skeletal for an upcoming exhibition about biomechanics, opening in March. This will be incorporated with an exterior model, the end result revealing a partial skeleton. Museums utilizing new technology in this way means we can share our research outside of our walls without having to worry about obtaining permits for protected species remains, or risk damaging permanent collections items. 

And, you know, it’s a printed cheetah.

Smithsonian Creates the First-ever 3D Presidential Portrait

The portraits of President Barack Obama were created based on data collected by a Smithsonian-led team of 3-D digital imaging specialists and include a digital and 3-D printed bust and life mask. They used 50 custom LEDs and 14 cameras to compile a detailed topography of the president’s head and upper torso.

See more about the process in this video:

[read more] [Official White House Photo by Pete Souza]


Archaeological Data visualized with HTC Vive Dev Kit in UE4

Proof of concept demo from David Finsterwalder is a virtual reality immersive dataset of an archaeological dig featuring photorealistic 3D scanning and augmented data points (and created in a week!):

Walking around in a 3D scanned cave and a visualization of the Database of the paleolithic excavation.

The Database consists of ~17000 single measurements from several excavation campaigns over 10 years and is visualized with a different 3D Symbol per Artifact category. Showing all 17000 Symbol Meshes at once is made possible through instancing (and thus reducing draw calls to ~300). Through this method the whole scenes with all Artifacts shown runs in rock solid 90fps on a GTX 970 and i7 4770K.

More Here


Bravely Second screens, art ⊟

I can’t get enough of Akihiko Yoshida’s art – the close-up of Agnès comes from a scan of Famitsu’s recent issue. See the full piece here.

Few items we’ve learned about the game recently:

  • Sales for Bravely Default (including the original version released in Japan), crossed one million units, 600,000 of those from the West
  • Supercell’s ryo will provide new music for Bravely Second instead of Default’s original composer Revo
  • Producers Tomoya Asano and Shinji Takahashi, aided by Souki Tsukishima, will take over writing duties from Naotaka Hayashi
  • Classes shown so far: Valkyrie, Performer, Red Mage, and Time Mage
  • One of the cities featured in the game, Guatelatio (shown above), serves as the Crystal Orthodoxy’s headquarters, and “sits at the entrance to the highway that leads to the Temple of Earth and the Holy Land,” according to details from the official site translated by Gematsu

Scan is via @ExeForce87, screens are from Famitsu.

BUY Bravely Default, upcoming games

First 3-D Printed Ribcage Successfully Implanted

It’s a story Wolverine would appreciate. A 54-year-old Spanish man suffering from a cancer of the chest wall has received a 3-D-printed implant made of titanium alloy to replace his sternum and a section of his ribcage. 

The patient’s surgical team at Salamanca University Hospital in Spain scanned his chest using high-resolution CT. From that they were able to develop a precise plan to remove the chest wall sarcoma and the portion of bone that it had invaded. The question was what they would replace it with. Learn more and see a video below.

Keep reading


Glitches and Mistakes of 3D Scanning | ScanLAB Projects | Via

ScanLAB Projects provides 3D scanning services for architects, engineers, developers, museums, scientists and designers using various technologies including LIDAR and bespoke software to convert the data generated into accurate point-cloud models for generating 2D drawings and 3D models.

But the final images produced for clients do not show all of the data captured by the machines, which also record a layer of digital “noise” – visual data sometimes attributed to particles of dust, weather conditions and changes in light.



Music video for track by ibeyi put together by ScanLAB uses industry standard 3D scans for visuals - recommended to watch in HD:

The official music video for OYA by amazing french-cuban twins ibeyi on XL Recordings. We have been collaborating ever since creating this their first ever music video in 2014. Most recently we completed their worldwide tour visuals. 



Sophie Kahn

The fragmented surfaces of artist Sophie Kahn’s sculpted bodies are created using the precise 3d print and scanning technology to capture the dynamic motion of our bodies, as they serve as a reflection of our history, identity and the space and world that we occupy. 

  1. Reclining Figure of a Woman (five years of sleep), 3d print from 3d laser scan, life size, 2013
  2. Torso of a Woman (shards), 3d print from 3d laser scan, life-size, 2013
  3. Woman, Head Thrown Back, 3d print from 3d laser scan, life-size, 2013
  4. Laura: RGB, 2011, full color 3d print, life size, 1/5
  5. Torso VIII, 2012, archival chromogenic print, 24" x 40", 1/5
  6. L: Clay (Fragment), 2012, glazed stoneware (cast from 3d print), life-size, 1/1
  7. Laura: RGB, 2011, full color 3d print, life size, 1/5, images posted with permission of the artist. 

Website | Twitter | Tumblr

See more on:
iheartmyart | facebook | twitter | instagram | flickr | mail list | pinterest | soundcloud

See more Sophie Kahn on iheartmyart.
See more sculpture on iheartmyart.