Back to WUpedia

WORKFLOW

MJ Trend Video

Create a character sheet

Not sure how to create an effective character sheet? Follow this tutorial:

How to Create an Effective Character Sheet

Go to Higgsfield

Open Higgsfield using this link:

Open Higgsfield

The Higgsfield homepage.
The Higgsfield homepage. Select the image to enlarge it.

Open the Genjutsu tab

In Higgsfield, open the Genjutsu tab.

Open the Genjutsu tab.
Open the Genjutsu tab. Select the image to enlarge it.

Open the reference project

Open my project using this link:

Open MJ Trend Video project

The MJ Trend Video project.
The MJ Trend Video project. Select the image to enlarge it.

Select Recreate

Select the Recreate button on the project page.

Select the Recreate button.
Select the Recreate button. Select the image to enlarge it.

Keep Motion Transfer and the reference video

Make sure Motion Transfer is selected and keep the existing reference video.

Select Motion Transfer and keep the reference video.
Select Motion Transfer and keep the reference video. Select the image to enlarge it.

Replace the character references

Replace the reference images with images of the characters you want to use.

Replace the reference images with your chosen characters.
Replace the reference images with your chosen characters. Select the image to enlarge it.

Adjust the prompt and reference tags

Adjust the prompt so its reference tags match the images you have uploaded. Check that every image tag and the video tag point to the correct assets.

Adjust the image reference tags in the prompt.
Adjust the image reference tags in the prompt. Select the image to enlarge it.

Prompt I use

The character from @[Image 1] performs the exact same movements as the main person singing in @[Video 1], matching every motion, timing and rhythm smooth grounded movement, consistent lighting, camera and framing follow @[Video 1], no identity drift, change all the extra people to characters from @[Image 2] @[Image 3] @[Image 3] @[Image 5]

IMPORTANT NEGATIVE INSTRUCTIONS:
Do not change the person's identity.
Do not generate a different face.
Do not make the face more handsome or more stylized.

Choose the quality and generate

Choose 1080p for the best visuals, or 720p to use fewer credits. I do not recommend 480p. Then select Generate!

Choose the video quality and select Generate.
Choose the video quality and select Generate. Select the image to enlarge it.

Important note

This video includes many additional characters, and the source reference video is relatively low resolution. Some parts did not turn out well on the first generation.

I generated the video several times, then edited together the sections I was happy with.

6 generations, edited into one final video

I generated a total of six versions. The final video I posted on Instagram is an edited result, not a complete output from a single generation.

I edited it in CapCut. You can use any editing software you are comfortable with.