Apply Motion

Jaejun Yu | 2024-04-10

After extracting animation from a video, the next crucial step is applying this motion to your 3D model in the Scene. This process, known as retargeting, maps the extracted animation data onto your model's skeleton. Plask offers advanced features to ensure your animations look natural and professional.

Applying Motion: Step-by-Step

Method: Drag and Drop

    1. Locate your extracted animation in the Asset panel.
    1. Click and drag the animation onto the desired bone in your 3D model.
    1. Plask will automatically attempt to map the animation based on bone names and hierarchy.

Troubleshooting: Renaming Bones

If the automatic mapping doesn't produce the desired results, you may need to rename some bones in your model to match Plask's naming convention.

    1. In the Outliner, right-click on the bone you want to rename.
    1. Select 'Rename' from the context menu.
    1. Enter the new name, matching one of the standard bone names used by Plask (listed in the "Bone Structure" section below).

Advanced Feature: Stable AI and Foot End Effector Matching

Understanding End Effectors and Foot Sliding

In animation, an end effector is the part of a limb that interacts with the environment. For a human-like character, feet are crucial end effectors. A common issue in 3D animation is "foot sliding," where feet appear to slide across the ground instead of planting firmly, breaking the realism of the animation.

How Stable AI Improves Foot Placement

Plask's Stable AI introduces precise foot end effector position matching, significantly enhancing the quality of your animations:

    1. Accurate Foot Tracking: The AI precisely tracks foot positions in the source video.
    1. Intelligent Mapping: When applying motion, it ensures foot positions in your 3D model match the tracked data.
    1. Ground Contact Detection: The system identifies when a foot should be in contact with the ground.
    1. Position Locking: During ground contact phases, the foot position is locked, preventing sliding.

Benefits for All Users

  • For Beginners: Achieve more natural-looking animations without manual fixes.
  • For Professionals: Save time on manual corrections, focusing more on creative aspects.

Using Stable AI for Better Foot Placement

    1. When extracting motion from your video, select the Stable option.
    1. Ensure your source video has clear visibility of the feet.
    1. After applying the animation, play it back to observe improved foot-ground interaction.
    1. Minor manual adjustments can still be made if needed.

Technical Deep Dive: Mapping Rules and Bone Structure

Animation Data Structure

  • Plask's motion capture system is based on a standard T-pose model.
  • The system recognizes up to 52 distinct bones for a comprehensive skeletal structure.

Retargeting Process

  • The retargeting system maps animation data based on bone names and hierarchical structure.
  • This process allows for flexibility in model structure while maintaining accurate motion transfer.

Standard Bone Naming Convention

Plask uses a 52-bone system for comprehensive animation mapping. Here's the full list of recognized bone names:

Untitled

    1. hips
    1. spine
    1. leftUpLeg
    1. rightUpLeg
    1. spine1
    1. leftLeg
    1. rightLeg
    1. spine2
    1. leftFoot
    1. rightFoot
    1. neck
    1. leftToeBase
    1. rightToeBase
    1. head
    1. leftShoulder
    1. rightShoulder
    1. leftArm
    1. rightArm
    1. leftForeArm
    1. rightForeArm
    1. leftHand
    1. rightHand
    1. leftHandIndex1
    1. rightHandIndex1
    1. leftHandIndex2
    1. rightHandIndex2
    1. leftHandIndex3
    1. rightHandIndex3
    1. leftHandMiddle1
    1. rightHandMiddle1
    1. leftHandMiddle2
    1. rightHandMiddle2
    1. leftHandMiddle3
    1. rightHandMiddle3
    1. leftHandRing1
    1. rightHandRing1
    1. leftHandRing2
    1. rightHandRing2
    1. leftHandRing3
    1. rightHandRing3
    1. leftHandPinky1
    1. rightHandPinky1
    1. leftHandPinky2
    1. rightHandPinky2
    1. leftHandPinky3
    1. rightHandPinky3
    1. leftHandThumb1
    1. rightHandThumb1
    1. leftHandThumb2
    1. rightHandThumb2
    1. leftHandThumb3
    1. rightHandThumb3

Advanced Features: Auto Transformation

During the application process, Plask performs two key automatic transformations:

1. Rotation Transform

  • Adjusts bone rotations to match the source animation, regardless of initial orientation.

2. Position Scaling

  • Scales position changes proportionally, adapting animations to models with different proportions.

These auto-transformations work behind the scenes to provide a seamless retargeting experience.

Best Practices and Tips

    1. Start with a T-pose model for optimal results.
    1. Use clear, well-lit video footage with the entire body visible for best motion capture.
    1. For walking or running animations, capture footage on a flat, consistent surface.
    1. When renaming bones, focus on the main skeletal structure first (hips, spine, limbs).
    1. Double-check your bone hierarchy in the Outliner if you encounter mapping issues.
    1. Remember, while V2 AI significantly improves foot placement, other parts of the body may still require manual adjustments for perfect results.

Conclusion

Understanding the intricacies of motion application in Plask, especially the advanced V2 AI foot placement feature, empowers you to create more accurate and expressive animations. By leveraging these tools and following best practices, you can efficiently transfer complex motions to your 3D models, bringing your characters to life with enhanced realism and reduced need for manual corrections.