Check out this delightful demo:

By combining @pika_labs Pikaframes and @freepik, I now have the magical ability to jump through space and time and in this example, music becomes a transformative element teleporting this woman to a new location. This is how it’s done. 1/6 

The videos below are fully narrated… pic.twitter.com/06WtgI50ZV

— Travis Davids (@MrDavids1) March 3, 2025

Individual steps, as I understand them:

• Generate image (in this example, using Google Imagen).
• Apply background segmentation.
• Synthesize a new background, and run what I think is a fine-tuned version of IC-Light (using Stable Diffusion) to relight the entire image, harmonizing foreground/background. Note that identity preservation (face shape, hair color, dress pattern, etc.) is very good but not perfect; see changes in the woman’s hair color, expression, and dress pattern.
• Put the original & modified images into Pika, then describe the desired transformation (smooth transition, flowers growing, clouds moving, etc.).