Back to WUpedia

WORKFLOW

Shaolin Soccer Club Video

Create two character sheets

Create a character sheet for each of the two new characters you want to use in the video.

Not sure how to create an effective character sheet? Follow this tutorial:

How to Create an Effective Character Sheet

Go to Higgsfield

Open Higgsfield using this link:

Open Higgsfield

The Higgsfield homepage.
The Higgsfield homepage. Select the image to enlarge it.

Open the Genjutsu tab

In Higgsfield, open the Genjutsu tab.

Open the Genjutsu tab.
Open the Genjutsu tab. Select the image to enlarge it.

Open the reference project

Open my project using this link:

Open Shaolin Soccer Club Video project

The Shaolin Soccer Club Video project.
The Shaolin Soccer Club Video project. Select the image to enlarge it.

Select Recreate

Select the Recreate button on the project page.

Select the Recreate button.
Select the Recreate button. Select the image to enlarge it.

Keep Motion Transfer and the reference video

Make sure Motion Transfer is selected and keep the existing reference video.

Select Motion Transfer and keep the reference video.
Select Motion Transfer and keep the reference video. Select the image to enlarge it.

Replace the character references

Replace the two reference images with images of your chosen characters.

Replace the reference images with your chosen characters.
Replace the reference images with your chosen characters. Select the image to enlarge it.

Adjust the prompt and reference tags

Adjust the prompt, reference tags and character descriptions to match your own characters. Make sure the green-guitar and blue-guitar descriptions identify the correct people, and that each tag points to the correct asset.

Adjust the image reference tags in the prompt.
Adjust the image reference tags in the prompt. Select the image to enlarge it.

Prompt I use

Change the fat main character with green guitar in @[Video 1] into the man with green guitar in @[Image 1], change the thin main character with blue guitar in @[Video 1] into the man with blue guitar in @[Image 2]. Keep the audio and movements the same as the main characters in @[Video 1], just want their apperances to change to the two new man.

IMPORTANT NEGATIVE INSTRUCTIONS:
Do not change the @[Image 1] @[Image 2] identity.
Do not generate a different face from @[Image 1] @[Image 2].
Do not make the face more handsome or more stylized.

Choose the quality and generate

I use 720p to save credits. For better visuals, choose 1080p. I do not recommend 480p. Then select Generate!

Choose the video quality and select Generate.
Choose the video quality and select Generate. Select the image to enlarge it.

Note 1 — Choose long sleeves

For better results, dress your characters in long-sleeved tops. Otherwise, the clothing effect from the reference video can transfer onto their exposed arms and make them look unnatural.

Example of an unwanted effect on an exposed arm.
Example of an unwanted effect on an exposed arm. Select the image to enlarge it.
A second example showing the affected arms.
A second example showing the affected arms. Select the image to enlarge it.

Note 2 — Head-cover artifacts and glasses straps

In the original reference video, both characters wear visible plastic head covers. In my experience, this is not a problem when the replacement characters have hair. With a bald character, however, the result can look like plastic or excess skin around the head.

The visible plastic head covers in the reference video.
The visible plastic head covers in the reference video. Select the image to enlarge it.

That is why I added a glasses strap to one of my bald characters: to cover this weakness in the generated result.

The glasses strap added to my character reference.
The glasses strap added to my character reference. Select the image to enlarge it.