Add option to bake a mesh from animated skeleton pose

[smix8]

Adds option to bake a mesh from animated skeleton pose.

Takes a snapshot of the current animated skeleton pose of the skinned mesh and bakes it to another ArrayMesh.

Implements godotengine/godot-proposals#8120 to make stuff like this:

Pairs with #76725 to bake the blend shapes.

Production edit: closes godotengine/godot-roadmap#58

[jcostello]

Could be use to emit particles from a animated mesh?

[smix8]

Could be use to emit particles from a animated mesh?

See godotengine/godot-proposals#8106 and godotengine/godot-proposals#5051

Particles have currently no exposed API to bake emission points from mesh at runtime.

For performance it also makes far more sense to directly bake to the texture that the particle shader uses instead of baking to an intermediate mesh.

[clayjohn]

Personally I am a bit wary of exposing new APIs to users that cause GPU stalls like this. My preference would be to first add a caching system to Mesh so that users can choose to keep the data on the CPU if they want to do things like this.

[smix8]

Where should such an option to (pre)cache the mesh arrays be added? On the MeshInstance3D or the Mesh or e.g. within the existing ArrayMesh Surface struct?

[fire]

I am in favour of the feature, but I don't know how to resolve the request from @clayjohn

[fire]

I would also reuse the same approach from the blend shape bake with the inputted mesh outputting a mesh

[smix8]

Applied the same changes as in the blendshape bake pr. The baked mesh is always returned, and if an optional existing mesh param is provided it updates this mesh RID instead of creating a new mesh as this helps with updating instances that already use that mesh.

[PiCode9560]

Is this thing done yet?

All review comments are addressed.

[akien-mga]

Thanks!

[RavinMaddHatter]

Does this actually work? i have been trying to get it to work for a few days. Any example code would be nice or an example project. i tried what is in the docs but i keep getting out the orginal unblended mesh.

Aah. the 4.3 version i am running doesnt seem to have the actual code... just the stubs.... 3 days of head banging later.

[fire]

@RavinMaddHatter are you testing on 4.4?

[RavinMaddHatter]

I have tested on 4.4 Dev2 I have tried many many things. I am very likely doing something wrong, but that would mean the documentation is incomplete (happy to help fix it) or there is a bug. i can get you something for docs update if we can figure out how to get it to work on my PC.

Can chat in discord or continue here. I have several posts with no responses.

[RavinMaddHatter]

Does anyone have a test project so i can figure out the difference and why i only get the default pose?

[qualmonade]

I'm currently encountering a problem where regardless of if it's true or not, the function does not seem to find any of the bones attached to the skeleton of my mesh of choice. I have so far tested this with inherited scenes, including imported GLB files.



(Excuse my less-than-stellar code. I deleted most of the rest of the other code and forgot to remove the add_child() so that I could try to zero in on what the issue was exactly.)

I am wondering if this is related to the issue that RavinMaddHatter is having?

Does this actually work? i have been trying to get it to work for a few days. Any example code would be nice or an example project. i tried what is in the docs but i keep getting out the orginal unblended mesh.

[fire]

Please provide a test project with code.

[qualmonade]

Here you go!
I am hoping this is correct. Let me know if anything is broken in some way or other.

[TinyZilla]

So this function returns a ArrayMesh which is a resource not a node. If you add the resource to another MeshInstance3D it'll be correct. It seems to work correctly for me at least.

var a : MeshInstance3D = $ExistingMeshInstance
var b : MeshInstance3D = MeshInstance3D.new()
b.mesh = a.bake_mesh_from_current_skeleton_pose()
get_tree().root.add_child(b)

[RavinMaddHatter]

This may be my issue, I will test when I can.

…

On Mon, Sep 16, 2024, 10:38 AM Ken Lee ***@***.***> wrote: So this function returns a ArrayMesh which is a resource not a node. If you add the resource to another MeshInstance3D it'll be correct. It seems to work correctly for me at least. var a : MeshInstance3D = $ExistingMeshInstance var b : MeshInstance3D = MeshInstance3D.new() b.mesh = a.bake_mesh_from_current_skeleton_pose() get_tree().root.add_child(b) — Reply to this email directly, view it on GitHub <#85018 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABBUC5B7NVW5HXU6L5VNK23ZW4JRBAVCNFSM6AAAAAA7P4GYO2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGNJTGUZDGOJTGI> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[RavinMaddHatter]

Looking at this again. This is the node i am baking. It is generated via another library so it is called Baked_Opaque.

In that node, there is an attached skeleton:

I am using this exact line of code to get the meshinstance3d baked from the skeleton
var mesh = humanizer.find_child("Baked-Opaque").bake_mesh_from_current_blend_shape_mix()
Using this version of godot

When i export the OBJ (i have been exporting OBJ files of the returned mesh instance 3d rather than just displaying it, because this is supposed to return the mesh snap shot, not just a copy of the skeleton attached to a similar mesh)

This is the posed input mesh rendered by the GPU

This is the mesh exported from the CPU

I am happy to be wrong here, just want to know where i am wrong.

[RavinMaddHatter]

You can see the project. it is not minimized i apologize for that, but I am not sure how to minimize it right now. I am still figuring out the 3d aspects of godot.
https://github.com/RavinMaddHatter/Madhatters-Table-Top-RPG-Mini-Maker
The baking is occuring on line 439 of new_character_menu script
The export is occurring on line 445

This is a learning project so the code hygiene is terrible. But i cannot get it to work, i am looking into other options on this topic as well.

[fire]

I have made an issue on https://github.com/RavinMaddHatter/Madhatters-Table-Top-RPG-Mini-Maker to debug this.

[RavinMaddHatter]

From the other thread "There seems to be a missing feature to bake both blend shapes and skeleton poses."

I have not seen any updates. but i am curious if this is a bug in my implementation or in the godot implementation.