Hey fella icloners,
its been a while, i wanted to share some work in progress on my short called “Delayed”, the goal for this short was to:
- create a digital twin of new York street and figure out what is the optimal LOD for reconstruction of said street to make it look fully photoreal in Seedance when animated, both geometry and textural complexity.
- create shots that requires precision and timing that prompting alone would not be able to do accurately. This is why i love this 3d/AI hybrid workflow.
- take an iclone scene to full photorealism
- to direct my actors with precision via mocap, both face and body.
- create complex shots that would be hard to do on pro pipeline. (maya, Houdini, with renderers like octane, v-ray, etc. and compositor like Nuke ,after effect, etc)
- take advantage of real-time technology (real-time reflections) and go beyond just blockouts.
- to have lots of fun making it.
It all started with a picture from a possible client asking me if i could reconstruct it in unreal and make it come to life, i was pretty sure i could using the iclone/unreal pipeline, unfortunately i was not able to take on that challenge because i was already in the middle of another client’s project. But i really like that picture, the corner building was really cool so i started modeling it on my spare time. Here is the picture they gave me and the model i made of it.
and here is the model in iclone and rendered with AI
more coming soon…
PS: i almost forgot, this is an actual street
2 Likes
You
,
8:28 PM
Which Animatic do you think will work best with Seedance 2.5 , links below:
https://lnkd.in/gBB8S5vE <------- high realtime detail
https://lnkd.in/gEr6TEvU <-------med detail
https://lnkd.in/g-7VTwSs <-------low detail
My first thought would be using the medium detail animatic. In the video-guided feature you would then bind AI Actors with each equivalent in the animatic, at least the important ones. There is of course a limit as to how many of those you can use but I believe the number is quite high.
Mind you, I’m just learning all this myself, so I may be off.
thanks animagic, i will post the result with all the versions and show the advantages and disadvantages of each. remember that with version two you dont get the reflections on the glass and the goal is to create repeatable shots for both the environment and characters.
Cheers
See, I thought you wanted to use a video as guidance for the animations and the camera movement. In that case you instruct Seedance 2.5 to create a realistic video based on an appropriate prompt, so the reflections do not have to be in the original video.
yeah that is exactly i am going to do , i will feed that video as guidance a well as a “first frame” and character/prop sheets ,
i will test all three and see which one give us the best repeatable result. i will run them twice each on “selected” shots since i have 12 shots and that can get expensive.
You are right about things becoming expensive. So I started to use 480p for tests and that helps. The upscaling feature in AI Studio is actually quite good, I have found.
there is a rumor that RL might bring in seedance new draft mode to AI studio which will make things less expensive. 
