Lyell Hintz
patreon
StreamDiffusionTD 0.1.8 ππΌοΈ [ Changelog ]
🕑 Added 2024-04-21 22:22:39 +0000 UTCGet the TOX - www.patreon.com/posts/102788463
Important ! This version of StreamDiffusionTD replaces NDI + Spout with a faster solution for improved performance. However, I am planning to reintegrate ndi in the next version in a way that makes it easier to run non locally. 0.1.8 will only work locally on a single machine, but will be expanding support for non local.
[ EDIT - 0.1.9 Version fixes possible error when switching resolutions + issues with finding shared memory ]
Changelog:
Less latency, higher fps, and improved diffusion quality by replacing ndi+spout with direct memory buffer.
All handled inside of operator for you. If there are errors, perhaps change the 'Stream Out Name' in Stream Settings 2 and restart the stream.
You might notice a different curve on the denoising step sliders / T Index LIst.
It should be a bit more even through the steps and will better resemble input mage at higher values.
Improved input image coherence after diffusion
Added logic to automatically handle the memory i/o
Operator should handle loading output from StreamDiffusion better. No more disable/reenable needed.
In the works:
Many things I am testing / building with StreamDiffusion backend ... including tensorrt sdxl-turbo, prompt weighting, ip adapter images, controlnet, and also experimenting with stable diffusion + diffusers directly inside of TD. If you have any experience with any of these things and want to jam on some diffusers stuff, let me know !!
Enjoy ! π§ͺ
Comments
dotsimulate
It is working currently. I've been using the 4 step lora as a Custom LCM lora. I've done a bit of work on the model loading process as well. will be posting update soon. also dm me on discord and can share latest
melt.immersive
Hey! Any plans to incorporate Hyper-SD?
melt.immersive
thanks <3
dotsimulate
Just posted a fix for the resolution ! Found what was causing the issue definitely and tested across many resolutions. Note : will change resolution to multiplier of 8 pixels due to pipeline requirements.
dotsimulate
try this one ! https://www.patreon.com/posts/102788463
dotsimulate
will post one soon with a fix. I thought I had logic to catch that.
dotsimulate
will post one soon with a fix. I thought I had logic to catch that.
melt.immersive
I can confirm - no resolution other than 512x512 works :/
Wingto
"Error in extracting image data: cannot reshape array of size 790528 into shape (800,800,3)"
Mikhail Kozlov
Any resolution different to 512x512 is not working. Acceleration is disabled.
Juan JimΓ©nez
me too ! :(
Michele Di Pasquale
i have errors if i change the resolution to something different of 512x512 :/
Ethan Alloway
Thanks! Excited to try this version.
