Texture Replacement On Cloth

by

Ali Lakhia
Tony Lobay
Sabrina Merchant

Motivation

• Replace texture on clothing midway through a movie shooting
• Writing slogans on texture (e.g. Mountain Dew on Cheetah)
• Preview virtually any texture on clothing before buying

What We Did

• Shot footage with polka dot dress
• Wrote Matlab code to:
• Find each dot
• Calculate foreshortening on dot
• Apply same foreshortening on replacement texture element (or texton)
• Overlay texton on dot
• Ran Matlab code on each single frame and recombined to make new movie

Original

After Replacement

Future Improvements

• Reconstruct cloth surface geometry
• Track textons from frame to frame in order to apply different textons to different dots (e.g. letters)
• Apply a continuous texture (e.g. plaid texture)