sxela posts
Posts: 0
Files: 0
For people having numpy.dtype size changed error or RuntimeError: The shape of the 2D attn_mask is torch.Size([77, 77]), but should be (1, 1).
If you are having numpy.dtype size changed error on colab - just restart the env and run as usualIf you are having RuntimeError: The shape of the 2D attn_mask is torch.Size([77, 77]), but should be (1, 1).:you will need to download new install.bat and run it in a new folder.If you can't connect to your local server recently, try using an updated run.bat from WarpFusion/run.bat at main · Sxela/WarpFusion
New horizons and the future of Warp
Long time no see, my fellow Warp enjoyers!I’ve been working on a new UI for Warp early this year and oh God did I get carried away! Driven by your invaluable feedback I’ve tried to make something that’s easy to run without a prior CS degree or inherited GEEK skills. I also took some notes on the UI, something about making it less complex than the current fighter-aircraft-cockpit style web-apps.As you know, Warp was initially following the ‘designed-by-the-best-programmers paradigm, which...
Disco WarpFusion - 0.7.0
I'll just leave it here - After all this time?- AlwaysChangelog:25.10.2024Make it work in 2024Remove lama inpainting as obsoleteShed a few nostalgic tearsadd some example settings19.12.2024fix copyframesfix raft models error
Stable WarpFusion v0.36 - HotShotXL
Changelog:- add HotShotXL support- fix rec noise for hotshotxl- fix ipadapter style (1 image per adapter) for animatediff modes- fix rec noise not working after context size change in animatediff modeHotShotXLTo use it, just download the motion weights for HotShotXL and plug them into motion module path. Works a lot better than animatediff-sdxl motion module. Make sure to set context length to 8 for this model. Works fine with sdxl turbo too, with dpmpp sde sampler at 4 steps. Local install guid...
Stable WarpFusion v0.35 - ipadapter weight types, sdxl xinsir controlnets
Changelogadd ipadapter weight types from https://github.com/cubiq/ComfyUI_IPAdapter_plusadd SDXL Controlnets from https://huggingface.co/xinsir:tilescribblescribble animedepthopenposecannystarted adding cosxl, it's running, but only producing noise for now :(add prompted blip versionfix sdxl reconstructed noise mode not workingIPAdapter weight typesYou can now use IPAdapter weight types. They are adjustable in GUI -> controlnets tab for active ipadapters. weight_typecombine_embedsembeds scal...
For people having ImportError: 'packaging'
For people having ImportError: cannot import name 'packaging' from 'pkg_resources'error:run this in a new line: !pip install setuptools==69.5.1and restart the notebook
Stable WarpFusion v0.34 - VidToMe, variable cfg, adiff, rec noise updates
Local install guides:Windows: https://github.com/Sxela/WarpFusion#local-installation-guide-for-windows-venvLinux: https://github.com/Sxela/WarpFusion/blob/main/README.md#local-installation-guide-for-linux-ubuntu-2204-venvIf something's not working, make a new env and grab a fresh install.bat from that repo first, ask questions later :DChangelog:fix predicted noise randomness not working in animatediff modeturn off depth logsfix controlnets and ipadapters in 'stylized' source mode som...
For people having jax error on colab in animatediff mode
For people having jax error on colab in animatediff mode, run this once, in a new line: !pip uninstall jax -y
Stable WarpFusion v0.33 - Reconstructed Noise Updates
Local install guides:Windows: https://github.com/Sxela/WarpFusion#local-installation-guide-for-windows-venvLinux: https://github.com/Sxela/WarpFusion/blob/main/README.md#local-installation-guide-for-linux-ubuntu-2204-venvIf something's not working, make a new env and grab a fresh install.bat from that repo first, ask questions later :DChangelogenable fixed_code for style_strength = 1automatically skip installation on Colab after the initial installationadd force_install option to override ex...
Stable WarpFusion v0.32 - Speedup, GUI, and QoL updates and fixes
Local install guides:Windows: https://github.com/Sxela/WarpFusion#local-installation-guide-for-windows-venvLinux: https://github.com/Sxela/WarpFusion/blob/main/README.md#local-installation-guide-for-linux-ubuntu-2204-venvIf something's not working, make a new env and grab a fresh install.bat from that repo first, ask questions later :DChangelog:add optimization fixes by #infinitydeltax from discord, thanks to #romustach for pushingadd offload_model to loaded settingsremove duplicate temporal...
For people having pytorch\xformers\torchvision.transforms.functional_tensor error
Google Colab has updated its env, so we need to fix a few things for it to work.Installers for v0.20+ have been updated. Those notebooks should work without any manual fixes.For people having pytorch\xformers error (xFormers can't load C++/CUDA extensions) and all sorts of import errors like ModuleNotFoundError: No module named 'torchvision.transforms.functional_tensor':1) run Prepare folders & Install cell2) check "skip install" after running it3) add a new code cell below i...
For people having PidiNet error
For people having Softedge controlnet annotator error,download it manually here - https://github.com/Sxela/ControlNet-v1-1-nightly/releases/download/v0.1.0/table5_pidinet.pth and put into ControlNet\annotator\ckpts\ folder inside you warp folder
Stable WarpFusion v0.31 - Depth Anything, QoL
Local install guides:Windows: https://github.com/Sxela/WarpFusion#local-installation-guide-for-windows-venvLinux: https://github.com/Sxela/WarpFusion/blob/main/README.md#local-installation-guide-for-linux-ubuntu-2204-venvIf something's not working, make a new env and grab a fresh install.bat from that repo first, ask questions later :DThis notebook needs an updated transformers 4.31.0 package. Make a new env with a fresh install.bat or update the package by running !pip install transformers=...
Stable WarpFusion v0.30 - Settings Queue, IPAdapter Faceid
Local install guides:Windows: https://github.com/Sxela/WarpFusion#local-installation-guide-for-windows-venvLinux: https://github.com/Sxela/WarpFusion/blob/main/README.md#local-installation-guide-for-linux-ubuntu-2204-venvIf something's not working, make a new env and grab a fresh install.bat from that repo first, ask questions later :DThis notebook needs an updated transformers 4.31.0 package. Make a new env with a fresh install.bat or update the package by running !pip install transformers=...
If you're having Access denied error with DWPose
If you're having DWPose error likeAccess denied with the following error:Cannot retrieve the public link of the file. You may need to changethe permission to 'Anyone with the link', or have had many accesses.Which means that the DWPose author's google drive \ python gdown package user has hit the rate limit.To fix this you need to manually download the models from these links: https://drive.google.com/uc?id=12L8E2oAgZy4VACGSK9RaZBZrfgx7VTA2https://drive.google.com/uc?id=1w9pXC8tT...
Stable WarpFusion v0.29 - QoL fixes, wav2lip, FaceFusion installers
Merry Christmas Incoming!Local install guides:Windows: https://github.com/Sxela/WarpFusion#local-installation-guide-for-windows-venvLinux: https://github.com/Sxela/WarpFusion/blob/main/README.md#local-installation-guide-for-linux-ubuntu-2204-venvIf something's not working, make a new env and grab a fresh install.bat from that repo first, ask questions later :DThis notebook needs an updated transformers 4.31.0 package. Make a new env with a fresh install.bat or update the package by running !...
If you're getting xformers error on colab
If you're getting xformers error on colab about cuda version mismatch:Google colab env has been updated (their cuda version was bumped from 11.8 to 12.1), so we need to update our dependencies.I'm rolling a hotfix soon, but for now you can: add a new code cell after the install cell and before the import dependencies cell, with!pip install https://download.pytorch.org/whl/cu121/xformers-0.0.22.post4-cp310-cp310-manylinux2014_x86_64.whl#sha256=7075114dbf698b609b599f0d35032c0b2f9a389751e8b...
Stable WarpFusion v0.28 - IP Adapters
Local install guides:Windows: https://github.com/Sxela/WarpFusion#local-installation-guide-for-windows-venvLinux: https://github.com/Sxela/WarpFusion/blob/main/README.md#local-installation-guide-for-linux-ubuntu-2204-venvIf something's not working, make a new env and grab a fresh install.bat from that repo first, ask questions later :DThis notebook needs an updated transformers 4.31.0 package. Make a new env with a fresh install.bat or update the package by running !pip install transformers=...
Stable WarpFusion v0.27 - sdxl inpaint cn, animatediff multiprompt
Local install guides:Windows: https://github.com/Sxela/WarpFusion#local-installation-guide-for-windows-venvLinux: https://github.com/Sxela/WarpFusion/blob/main/README.md#local-installation-guide-for-linux-ubuntu-2204-venvIf something's not working, make a new env and grab a fresh install.bat from that repo first, ask questions later :Dvideo changelog: https://www.youtube.com/watch?v=VXS-bpWy7CAChangelog: add sdxl inpainting controlnet model add scene splitter for animatediff mode enable refe...
ComfyWarp nodes preview v0.5 - FixedQueue
Changelog:add FixedQueue nodeadd start, end, n-th frame settings to MakeFrameDataset nodemake 0.5.0 workflow7.2.24: - move to L tier29.09.2024:fix SaveFrame node after the latest ComfyUI updatesFixedQueue nodestart- frame to begin withend- frame to end withcurrent_frame- iterator, showing the current frame, which is being output as the currentvalue. The current value should be plugged into downstream nodes as the source of the current frame number.Queue Many buttonClick to render a set of frames...
Stable WarpFusion v0.26 - lazywarp, monster qr
Local install guide: https://github.com/Sxela/WarpFusion#local-installation-guide-for-windows-venv.If something's not working, make a new env and grab a fresh install.bat from that repo first, ask questions later :DChangelog: add lazywarp feature to generate flow and consistency on the fly refactor flow extraction code add lazy raft_model init add flow settings to GUI move flow extraction to run diffuse cell add flow check and auto extraction to video export cell add clip_skip add an option ...
Stable WarpFusion v0.25 - AnimateDiff
Had so much fun playing with AnimateDiff that I can't help but bring it into Warp.Local install: https://github.com/Sxela/WarpFusion#local-installation-guide-for-windows-venvPlease note that the notebook has its default values set up for AnimateDiff. Also keep in mind that it is a bit more memory intensive with ControlNets at the moment, so 1-2 is more than enough. Also, I'd recommend disabling normalize_controlnet_weights, as it seems to be too strong. Just set 1-2 controlnets with valu...
If you're having torch version errors on colab (again)
Colab updated its env again 😄If you're having torch version errors on colabreplace:!python -m pip -q install xformers==0.0.21with!python -m pip -q install https://download.pytorch.org/whl/cu118/xformers-0.0.22.post4%2Bcu118-cp310-cp310-manylinux2014_x86_64.whlHard-locking torch version (that will downgrade the existing torch) is a lot slower, but maybe that is still a better option.thanks to @huemin.artFixed notebooks: XL: Stable WarpFusion v0.24.6 -> https://www.patreon.com/posts/stable-...
fix for UnidentifiedImageError: cannot identify image file
May happen because of an update in PIL (pillow) python package version during the runtime. It extracted the image with one version and tries to read with another one. If you still need to update/finish some installs - do that and then restart the runtime and extract those image files again. You may have to delete that folder manually. Do the 1st run with default settings (skip_install off), until error Enable skip_install in cell 1.3 Restart and run allyou can also go deeper:Before running anyth...
For everyone having a dependency issue on colab hosted env: replace the line at the end of cell 1.2
For everyone having a dependency issue on colab hosted env: replace the line at the end of cell 1.2!python -m pip -q install xformerswith!python -m pip -q install xformers==0.0.21save the notebook, delete, and restart the runtime fixed notebooks will come a bit later for the major versions
ComfyWarp nodes preview - v0.4 schedulers, flow_blend
Changelog: add Scheduler nodes add flow_blend example pipeline fix SaveFrame not saving frames if it's the last node in the graph14.10.2023, v0.4.4: fix json blend error for string schedulers remove json blend option for string schedulers fix json schedules not working with int, float schedulers2.11.2023, v0.4.5: remove efficiency nodes from workflows remove efficiency nodes from installer replace mask compositing in v0.1 workflow with MixConsistencyMaps node add updated workflow files for d...
For everyone having a 'torch not found'
For everyone having a 'torch not found' error during install.bat execution (and later when running the notebook), grab a fresh install.bat here - https://github.com/Sxela/WarpFusion#local-installation-guide-for-windows-venv or replace the line:call python -m pip install torch torchvision torchaudio --extra-index-url https://download.pytorch.org/whl/cu118 xformerswithcall python -m pip install torch==2.0.1 torchvision==0.15.2 --extra-index-url https://download.pytorch.org/whl/cu118 xforme...
Stable WarpFusion v0.24 - FreeU, inpaint-softedge, temporal-depth experimental controlnets
Changelog: add FreeU Hack from https://huggingface.co/papers/2309.11497 add option to apply FreeU before or after controlnet outputs add inpaint-softedge and temporal-depth controlnet models auto-download inpaint-softedge and temporal-depth checkpoints fix sd21 lineart model not working refactor get_controlnet_annotations a bit add inpaint-softedge and temporal-depth controlnet preprocessors6.10.2023, v0.24.1: fix controlnet preview (next_frame error) fix dwpose 'final_boxes' error for f...
ComfyWarp nodes preview - v0.3 (render video, flow blend deflicker)
Changelog: Add v0.3.0 example pipeline with RenderVideo, FlowBlend mode for video output Add RenderVideo node Add ffmpeg downloader/finder Fix SaveFrame node to return output dir variable Make SaveFrame save frames with {frames_folder}_{batch_name}_%06d.png patternv0.3.1, 10.10.2023: fix install.bat xformers version fix SaveFrame node not saving frame if being the last node move to L tier2.11.2023: remove efficiency nodes from workflows remove efficiency nodes from the installer replace mask com...
Stable WarpFusion v0.23 - dwpose, controlnet preview
Local install guide: https://github.com/Sxela/WarpFusion#local-installation-guide-for-windows-venv.A100 or 24 GB card is highly recommended for sdxl.Make a new env and grab a fresh install.bat from that repo.Changelog: add dw pose estimator from https://github.com/IDEA-Research/DWPose add onnxruntime-gpu install, (update env for dw_pose) add dw_pose model downloader add controlnet preview, kudos to #kytr.ai, idea - https://discord.com/channels/973802253204996116/1124468917671309352 add temporaln...
