Data

Tools

Indexes

Applications

Experiments

Open Source Science

Recent Releases of onediff

onediff - 1.2.0(SD3, Latte and Kolors acceleratoin)

Hightlight

  • DiT model acceleratoin
    • SD3: https://github.com/siliconflow/onediff/tree/main/onediffdiffusersextensions/examples/sd3
    • DiT Video Model (Latte): https://github.com/siliconflow/onediff/tree/main/onediffdiffusersextensions/examples/latte
  • Kolors
    • https://github.com/siliconflow/onediff/tree/main/onediffdiffusersextensions/examples/kolors
  • nexfort backend support SD 1.5~2.1 models
    • HF diffusers https://github.com/siliconflow/onediff/tree/main/onediffdiffusersextensions/examples
    • ComfyUI https://github.com/siliconflow/onediff/tree/main/onediffcomfynodes/docs
  • ~Distributed Run~
    • This is moved to the next version

Reference: 1.2 milestone. https://github.com/siliconflow/onediff/milestone/5

New Contributors

  • @rewbs made their first contribution in https://github.com/siliconflow/onediff/pull/888
  • @sirouk made their first contribution in https://github.com/siliconflow/onediff/pull/1036
  • @sh-tsai made their first contribution in https://github.com/siliconflow/onediff/pull/1038

What's Changed

  • Modify mode for dynamic shape in README by @lixiang007666 in https://github.com/siliconflow/onediff/pull/943
  • Dev nodes nexfort booster by @ccssu in https://github.com/siliconflow/onediff/pull/911
  • Support diffusers sd3 speedup by @lixiang007666 in https://github.com/siliconflow/onediff/pull/945
  • Support comfyui sd3 speedup by @ccssu in https://github.com/siliconflow/onediff/pull/946
  • sd-webui refactor, and support refiner model by @marigoold in https://github.com/siliconflow/onediff/pull/930
  • Add dynamic shape demo for diffusers sd3 by @lixiang007666 in https://github.com/siliconflow/onediff/pull/953
  • Add prompt_styler by @ccssu in https://github.com/siliconflow/onediff/pull/959
  • Fix Lora switching by @ccssu in https://github.com/siliconflow/onediff/pull/967
  • remove oudated args for load_checkpoint by @doombeaker in https://github.com/siliconflow/onediff/pull/962
  • webui support controlnet extension by @marigoold in https://github.com/siliconflow/onediff/pull/948
  • webui supports nexfort backend and refactor compile related code by @marigoold in https://github.com/siliconflow/onediff/pull/966
  • Refine diffusers SD3 by @lixiang007666 in https://github.com/siliconflow/onediff/pull/972
  • Fix onediffcomfynodes/sd3_demo/README.md by @ccssu in https://github.com/siliconflow/onediff/pull/949
  • add onediffcomfynodes/benchmarks by @ccssu in https://github.com/siliconflow/onediff/pull/956
  • webui remove import oneflow for nexfort backend by @marigoold in https://github.com/siliconflow/onediff/pull/973
  • fix bug of webui controlnet arbitrary resolution by @marigoold in https://github.com/siliconflow/onediff/pull/982
  • Update SD3 performance by @lixiang007666 in https://github.com/siliconflow/onediff/pull/991
  • Support latte by @clackhan in https://github.com/siliconflow/onediff/pull/964
  • webui fix bug of AttrError shared.opt.onediffcompilercache_path by @marigoold in https://github.com/siliconflow/onediff/pull/989
  • Refine pixart readme for sigma support by @lixiang007666 in https://github.com/siliconflow/onediff/pull/986
  • Auto-Sync Graph Tensor on Weight Update by @ccssu in https://github.com/siliconflow/onediff/pull/1000
  • Don't suppress OneDiff logging if client code has already defined handlers in parent logger by @rewbs in https://github.com/siliconflow/onediff/pull/888
  • Fix load pipe by @ccssu in https://github.com/siliconflow/onediff/pull/1005
  • tosupportanimatediff by @lijunliangTG in https://github.com/siliconflow/onediff/pull/1009
  • add diffusers nexfort example by @marigoold in https://github.com/siliconflow/onediff/pull/998
  • Sd3 a100 by @strint in https://github.com/siliconflow/onediff/pull/1013
  • fix latte max mem used by @strint in https://github.com/siliconflow/onediff/pull/1019
  • Fix onediff comfy nodes docs by @ccssu in https://github.com/siliconflow/onediff/pull/988
  • Feat pre commit lint by @strint in https://github.com/siliconflow/onediff/pull/1024
  • fix Dynamic Indexing and Assignment Operations Fail in Static Graph Mode by @lijunliangTG in https://github.com/siliconflow/onediff/pull/1020
  • Add kolors compile by @lixiang007666 in https://github.com/siliconflow/onediff/pull/1007
  • [minor-fix] Update booster_cache.py to import utility by @sirouk in https://github.com/siliconflow/onediff/pull/1036
  • support diffusers v0.29 by @marigoold in https://github.com/siliconflow/onediff/pull/1037
  • Ci with pre commit by @strint in https://github.com/siliconflow/onediff/pull/1040
  • add template for issue by @strint in https://github.com/siliconflow/onediff/pull/1042
  • Feat collect env by @strint in https://github.com/siliconflow/onediff/pull/1044
  • Improve experience of running CI via a fork repo by @sh-tsai in https://github.com/siliconflow/onediff/pull/1038
  • [hot fix]version with scm by @strint in https://github.com/siliconflow/onediff/pull/1045
  • fix pub version by @strint in https://github.com/siliconflow/onediff/pull/1047
  • Add citation file by @jackalcooper in https://github.com/siliconflow/onediff/pull/1050
  • fix git shallow copy by @strint in https://github.com/siliconflow/onediff/pull/1049
  • Add bibtex in README by @jackalcooper in https://github.com/siliconflow/onediff/pull/1051

Full Changelog: https://github.com/siliconflow/onediff/compare/1.1.0...1.2.0

- Jupyter Notebook
Published by strint almost 2 years ago

onediff - 1.1.0( DiT model Acceleration and nexfort compiler backend Beta Release)

Hightlight

  • Acceleration of DiT model (with Pixart alpha as example): https://github.com/siliconflow/onediff/tree/main/onediffdiffusersextensions/examples/pixart_alpha
  • nexfort( a lightweight compiler backend for DiT models): https://github.com/siliconflow/onediff/tree/main/src/onediff/infer_compiler/backends/nexfort

What's Changed

  • add user enterprise key guide by @lijunliangTG in https://github.com/siliconflow/onediff/pull/819
  • Refining the Deversus Quantization Documentation by @lijunliangTG in https://github.com/siliconflow/onediff/pull/802
  • Fixed minor error in README.md by @iamrohitanshu in https://github.com/siliconflow/onediff/pull/823
  • update sd-webui doc and api_example by @marigoold in https://github.com/siliconflow/onediff/pull/712
  • ComfyUI online quantitative usage documentation in wiki by @fmk345 in https://github.com/siliconflow/onediff/pull/809
  • onediffx add getactiveadapters, and related unittest by @marigoold in https://github.com/siliconflow/onediff/pull/833
  • fix bug in webui when switching from quantized to non-quantized by @marigoold in https://github.com/siliconflow/onediff/pull/830
  • onediffx supports lycoris by @marigoold in https://github.com/siliconflow/onediff/pull/817
  • Refine SVD diffusers example for graph save/load by @lixiang007666 in https://github.com/siliconflow/onediff/pull/836
  • Add Apache 2.0 LICENSE by @strint in https://github.com/siliconflow/onediff/pull/842
  • Update README.md file by @lijunliangTG in https://github.com/siliconflow/onediff/pull/846
  • Support 8x dimensions by hijacking cat in webui by @nono-Sang in https://github.com/siliconflow/onediff/pull/847
  • Update onediff/onediffcomfynodes/README.md by @ccssu in https://github.com/siliconflow/onediff/pull/853
  • fix removeprefix for python 3.8 by @nono-Sang in https://github.com/siliconflow/onediff/pull/856
  • fix bug of always recompile in enterprise by @marigoold in https://github.com/siliconflow/onediff/pull/858
  • [Fix] diffusers enterprise example seed by @lixiang007666 in https://github.com/siliconflow/onediff/pull/860
  • Fix grammar in README by @jackalcooper in https://github.com/siliconflow/onediff/pull/803
  • Refine README details by @jackalcooper in https://github.com/siliconflow/onediff/pull/862
  • Dev ipa+isntantid by @ccssu in https://github.com/siliconflow/onediff/pull/814
  • fix error caused by interpolate by @nono-Sang in https://github.com/siliconflow/onediff/pull/863
  • add ONEFLOWCONV2DKERNELENABLETUNING_WARMUP Environment variable by @lijunliangTG in https://github.com/siliconflow/onediff/pull/871
  • Fix IPAdapter save load graph by @ccssu in https://github.com/siliconflow/onediff/pull/872
  • define removesuffix in webui for python38 compatible by @marigoold in https://github.com/siliconflow/onediff/pull/874
  • webui support save/load graph, refine UI by @marigoold in https://github.com/siliconflow/onediff/pull/825
  • api for new backend by @hjchen2 in https://github.com/siliconflow/onediff/pull/794
  • Version 1.1.0.dev1 by @jackalcooper in https://github.com/siliconflow/onediff/pull/876
  • Fix Ci Error by @ccssu in https://github.com/siliconflow/onediff/pull/875
  • Refine manual seed by @lixiang007666 in https://github.com/siliconflow/onediff/pull/877
  • Fix bug for torch2oflow demo test by @nono-Sang in https://github.com/siliconflow/onediff/pull/878
  • Upgrade ipa support by @ccssu in https://github.com/siliconflow/onediff/pull/879
  • fix bug of onediff.infer_compiler.register by @marigoold in https://github.com/siliconflow/onediff/pull/885
  • Fix ipa weight update by @ccssu in https://github.com/siliconflow/onediff/pull/891
  • add nexfort and pixart alpha by @strint in https://github.com/siliconflow/onediff/pull/882
  • Add throughput for benchmark by @lixiang007666 in https://github.com/siliconflow/onediff/pull/894
  • Pixart performance data by @strint in https://github.com/siliconflow/onediff/pull/902
  • Modify after Cancelling Quantitative Model by @ccssu in https://github.com/siliconflow/onediff/pull/897
  • Fix Ci Test by @ccssu in https://github.com/siliconflow/onediff/pull/905
  • Separate compile backend config by @strint in https://github.com/siliconflow/onediff/pull/909
  • Add CI for Stable Diffusion web UI by @marigoold in https://github.com/siliconflow/onediff/pull/826
  • webui extension refine and add close button for hint message by @marigoold in https://github.com/siliconflow/onediff/pull/908
  • rename cache by @strint in https://github.com/siliconflow/onediff/pull/898
  • renew readme in comfy by @lijunliangTG in https://github.com/siliconflow/onediff/pull/883
  • Add nexfort cache docstr by @lixiang007666 in https://github.com/siliconflow/onediff/pull/917
  • fix unet graph file cache by @ccssu in https://github.com/siliconflow/onediff/pull/887
  • refactor test_lora by @marigoold in https://github.com/siliconflow/onediff/pull/821
  • [fix bug] OneDiffX load_and_fuse_lora when lora_scale == 0 makes w_up to allzeros by @marigoold in https://github.com/siliconflow/onediff/pull/926
  • add sd-webui CI Test SSIM by @lijunliangTG in https://github.com/siliconflow/onediff/pull/915
  • remove extra generate lines by @lijunliangTG in https://github.com/siliconflow/onediff/pull/932
  • Fix IPAdapter Style & Composition SDXL Support by @ccssu in https://github.com/siliconflow/onediff/pull/927
  • Avoid installing both oneflow and nextforce by @ccssu in https://github.com/siliconflow/onediff/pull/938
  • Add nexfort backend quant and docstr by @lixiang007666 in https://github.com/siliconflow/onediff/pull/919
  • Add nexfort dynamic shape for pixart by @lixiang007666 in https://github.com/siliconflow/onediff/pull/931
  • Update README.md for nexfort pixart by @lixiang007666 in https://github.com/siliconflow/onediff/pull/939
  • Update texttoimage.py args default value by @lixiang007666 in https://github.com/siliconflow/onediff/pull/940

New Contributors

  • @iamrohitanshu made their first contribution in https://github.com/siliconflow/onediff/pull/823
  • @fmk345 made their first contribution in https://github.com/siliconflow/onediff/pull/809
  • @nono-Sang made their first contribution in https://github.com/siliconflow/onediff/pull/847

Full Changelog: https://github.com/siliconflow/onediff/compare/1.0.0...1.1.0

- Jupyter Notebook
Published by strint about 2 years ago

onediff - 1.0.0

OneDiff 1.0

OneDiff 1.0 is for Stable Diffusion and Stable Video Diffusion models(UNet/VAE/CLIP based) acceleration. We have got a lot of support/feedback from the community: https://github.com/siliconflow/onediff/wiki , big thanks!

The later version 2.0 will focus on DiT/Sora-like models.

OneDiff 1.0 's updates are mainly the issues in milestone 0.13

  • New Features
    • Quantize tools for enterprise edition
    • https://github.com/siliconflow/onediff/tree/main/src/onediff/quantization
    • https://github.com/siliconflow/onediff/blob/main/README_ENTERPRISE.md#onediff-enterprise
    • SD-WebUI supports offline quantized model
    • OneDiff Quality Evaluation
    • https://github.com/siliconflow/OneDiffGenMetrics
    • Reuse compiled graph
    • https://github.com/siliconflow/onediff/issues/581
    • https://github.com/siliconflow/onediff/tree/main/onediffsdwebui_extensions#fast-model-switching
    • reuse graph with constant folding enabled https://github.com/siliconflow/onediff/pull/782
    • Refine support for Playground v2.5
    • https://github.com/siliconflow/onediff/issues/703
    • support ComfyUI-AnimateDiff-Evolved
    • https://github.com/siliconflow/onediff/pull/575
    • https://github.com/siliconflow/onediff/tree/main/onediffcomfynodes/modules/oneflow/hijack_animatediff
    • support ComfyUIIPAdapterplus
    • https://github.com/siliconflow/onediff/tree/main/onediffcomfynodes/modules/oneflow/hijackipadapterplus
    • support stable cascade
    • https://github.com/siliconflow/onediff/pull/659
  • Improvements
    • Improve performance of VAE
      • https://github.com/siliconflow/onediff/issues/667
  • Bug fixes
    • Fix graph save/load
    • Fix cuda memory usage on cuda 0 when run on other device
    • Fix the quality problem
    • many others bugs/issues from the community are fixed: https://github.com/siliconflow/onediff/milestone/2?closed=1
  • Documentation
    • Add more intro about onediff: https://github.com/siliconflow/onediff?tab=readme-ov-file#about-onediff

What's Changed

  • Add -U in code blocks of installation using aliyun index link by @jackalcooper in https://github.com/siliconflow/onediff/pull/699
  • Fix black images issues with v2.1 by @doombeaker in https://github.com/siliconflow/onediff/pull/701
  • enterprise doc add sdwebui by @marigoold in https://github.com/siliconflow/onediff/pull/705
  • Dev quantize pipeline by @hjchen2 in https://github.com/siliconflow/onediff/pull/704
  • fix quantize pipeline by @hjchen2 in https://github.com/siliconflow/onediff/pull/706
  • update script of webui in enterprise doc by @marigoold in https://github.com/siliconflow/onediff/pull/709
  • add quantize tools for diffusers by @hjchen2 in https://github.com/siliconflow/onediff/pull/710
  • QuantPipeline support fromsinglefile by @marigoold in https://github.com/siliconflow/onediff/pull/711
  • Fix graph save by @doombeaker in https://github.com/siliconflow/onediff/pull/702
  • support stable cascade by @chengzeyi in https://github.com/siliconflow/onediff/pull/659
  • Allow imageonlyindicator to be None (comfy) by @lixiang007666 in https://github.com/siliconflow/onediff/pull/720
  • openconvbiasaddactfusiondefault by @clackhan in https://github.com/siliconflow/onediff/pull/721
  • fix ci error by @ccssu in https://github.com/siliconflow/onediff/pull/729
  • [Fix] black images issues with diffusers SD2.1 by @lixiang007666 in https://github.com/siliconflow/onediff/pull/725
  • [feat] Add SVD1.1 example by @lixiang007666 in https://github.com/siliconflow/onediff/pull/726
  • doc for rsd to by @strint in https://github.com/siliconflow/onediff/pull/713
  • SD-WebUI supports offline quantized model by @marigoold in https://github.com/siliconflow/onediff/pull/718
  • Refactor onediffx deepcache by @clackhan in https://github.com/siliconflow/onediff/pull/733
  • fix pipeline save load by @strint in https://github.com/siliconflow/onediff/pull/734
  • fixsdxllighttestscrip by @clackhan in https://github.com/siliconflow/onediff/pull/735
  • use diffusers' builtin instant id by @chengzeyi in https://github.com/siliconflow/onediff/pull/738
  • fix upcast_vae by @hjchen2 in https://github.com/siliconflow/onediff/pull/741
  • fix import error by @ccssu in https://github.com/siliconflow/onediff/pull/746
  • onediffx.lora supports diffusers>=0.19.3 by @marigoold in https://github.com/siliconflow/onediff/pull/740
  • sd-webui supports reuse compiled graph by @marigoold in https://github.com/siliconflow/onediff/pull/742
  • import torch first by @strint in https://github.com/siliconflow/onediff/pull/751
  • support ComfyUI-AnimateDiff-Evolved by @ccssu in https://github.com/siliconflow/onediff/pull/575
  • Reuse pipe by @strint in https://github.com/siliconflow/onediff/pull/647
  • fixmultiresulotion_error by @clackhan in https://github.com/siliconflow/onediff/pull/754
  • refinespatiotemporal_oflow by @clackhan in https://github.com/siliconflow/onediff/pull/755
  • sd-webui override sendmodelto_cpu by @marigoold in https://github.com/siliconflow/onediff/pull/758
  • remove reuse pipe ci test by @marigoold in https://github.com/siliconflow/onediff/pull/759
  • [add] deep-cache test by @ccssu in https://github.com/siliconflow/onediff/pull/739
  • refine readme by @doombeaker in https://github.com/siliconflow/onediff/pull/768
  • fixcuda0memusageerror by @clackhan in https://github.com/siliconflow/onediff/pull/770
  • fix bug of WebUI which quantization is always True by @marigoold in https://github.com/siliconflow/onediff/pull/775
  • Add SD 1.5 quant example for diffusers by @lixiang007666 in https://github.com/siliconflow/onediff/pull/757
  • Fix: Change ComfyUI-AnimateDiff-Evolved load to warning. by @ccssu in https://github.com/siliconflow/onediff/pull/777
  • Fix AttributeError in OneFlowDeepCacheSpeedUpModelPatcher by @ccssu in https://github.com/siliconflow/onediff/pull/774
  • fix ComfyUIIPAdapterplus use by @ccssu in https://github.com/siliconflow/onediff/pull/732
  • Fix Torch-to-OneFlow Transformation Time by @ccssu in https://github.com/siliconflow/onediff/pull/786
  • reuse graph with constant folding for sd webui by @marigoold in https://github.com/siliconflow/onediff/pull/782
  • refactor oneflow_compile to support multiple backends by @hjchen2 in https://github.com/siliconflow/onediff/pull/787
  • Fix redundant warning printing by @ccssu in https://github.com/siliconflow/onediff/pull/788
  • develop compile options and rm use_graph by @hjchen2 in https://github.com/siliconflow/onediff/pull/791
  • testquantizecustom_model by @ccssu in https://github.com/siliconflow/onediff/pull/756
  • Imporve ENTERPRISE doc by @lijunliangTG in https://github.com/siliconflow/onediff/pull/784
  • Update quant ci examples by @lijunliangTG in https://github.com/siliconflow/onediff/pull/792
  • refactor graph reuse by @marigoold in https://github.com/siliconflow/onediff/pull/790
  • Dev refactor onediff comfy nodes by @ccssu in https://github.com/siliconflow/onediff/pull/796
  • fix bug in generateconstantfolding_info by @marigoold in https://github.com/siliconflow/onediff/pull/811

New Contributors

  • @lijunliangTG made their first contribution in https://github.com/siliconflow/onediff/pull/784

Full Changelog: https://github.com/siliconflow/onediff/compare/0.12.1...1.0.0

- Jupyter Notebook
Published by strint about 2 years ago

onediff - 0.12.1(Stable acceleration of SD and SVD for production environment)

SOTA performance update for SDXL and SVD

https://github.com/siliconflow/onediff/tree/main?tab=readme-ov-file#state-of-the-art-performance

Fully support dynamic resolution run of SD and SVD

https://github.com/siliconflow/onediff/blob/55627d50157d4a0c4b484ba76b088c90f39179ff/onediffdiffusersextensions/examples/texttoimage_sdxl.py#L96

Compile/Save/Load pipeline for HF diffusers

https://github.com/siliconflow/onediff/tree/main/onediffdiffusersextensions#compile-save-and-load-pipeline

Fast LoRA loading and switching for HF diffusers

https://github.com/siliconflow/onediff/tree/main/onediffdiffusersextensions#fast-lora-loading-and-switching

Accelerate InstantID

https://github.com/siliconflow/onediff/blob/main/benchmarks/instantid.py https://github.com/siliconflow/onediff/tree/main/onediffcomfy_nodes#instantid

Accelerate SDXL lightning

https://github.com/siliconflow/onediff/blob/main/onediffdiffusersextensions/examples/texttoimagesdxllight.py

Reuse compiled components between pipelines

https://github.com/siliconflow/onediff/blob/main/onediffdiffusersextensions/examples/reusecompiledpipeline_components.py

Compatible with HF diffisers 0.26

SD Webui support img2img

Change log

  • Official LoRA compatible with OneDiff by @marigoold in https://github.com/siliconflow/onediff/pull/507
  • use dict.setdefault in oneflow_compile by @marigoold in https://github.com/siliconflow/onediff/pull/515
  • fix compilation failure of resnet50 and faster_rcnn by @haoyang9804 in https://github.com/siliconflow/onediff/pull/491
  • Add SILICONONEDIFFLICENSE_KEY by @jackalcooper in https://github.com/siliconflow/onediff/pull/519
  • Dev quant tools and fix graph file management by @ccssu in https://github.com/siliconflow/onediff/pull/495
  • refine document of setup by @doombeaker in https://github.com/siliconflow/onediff/pull/522
  • replace reshape by flatten and unflatten to speedup svd by @hjchen2 in https://github.com/siliconflow/onediff/pull/516
  • graph load fix by @strint in https://github.com/siliconflow/onediff/pull/525
  • compile vae decoder to avoid oneflow module to while upcasting vae by @hjchen2 in https://github.com/siliconflow/onediff/pull/526
  • Debug Comfy in CI by @jackalcooper in https://github.com/siliconflow/onediff/pull/521
  • simplify test by @strint in https://github.com/siliconflow/onediff/pull/529
  • Enable docker hub cache by @jackalcooper in https://github.com/siliconflow/onediff/pull/532
  • Add links for NA/EU by @jackalcooper in https://github.com/siliconflow/onediff/pull/542
  • Reorder links by @jackalcooper in https://github.com/siliconflow/onediff/pull/544
  • supportdeepcachesvd_pipeline by @clackhan in https://github.com/siliconflow/onediff/pull/514
  • view comfyui log by @doombeaker in https://github.com/siliconflow/onediff/pull/534
  • Documents for OneDiff Enterprise by @doombeaker in https://github.com/siliconflow/onediff/pull/545
  • fix adpater id argument by @doombeaker in https://github.com/siliconflow/onediff/pull/478
  • Dev optimize svd by @chengzeyi in https://github.com/siliconflow/onediff/pull/533
  • fix bug of torchmoduletowith_check using oneflow args by @marigoold in https://github.com/siliconflow/onediff/pull/548
  • transform diffusers AttnProcessor by @hjchen2 in https://github.com/siliconflow/onediff/pull/550
  • update readme by @doombeaker in https://github.com/siliconflow/onediff/pull/553
  • Update hf sd1.5 model url by @doombeaker in https://github.com/siliconflow/onediff/pull/554
  • rm dynamo by @hjchen2 in https://github.com/siliconflow/onediff/pull/558
  • Fix Quantitative Execution in sd_webui by @ccssu in https://github.com/siliconflow/onediff/pull/517
  • Publish onediff on pypi automatically by @jackalcooper in https://github.com/siliconflow/onediff/pull/560
  • add sd-webui api doc and script by @marigoold in https://github.com/siliconflow/onediff/pull/559
  • Fix ControlNet Usage by @ccssu in https://github.com/siliconflow/onediff/pull/561
  • align dynamic param with torch by @strint in https://github.com/siliconflow/onediff/pull/537
  • update readme by @doombeaker in https://github.com/siliconflow/onediff/pull/562
  • Add community version controlnet performance testing by @ccssu in https://github.com/siliconflow/onediff/pull/557
  • [diffusers] support dynamic batch size by @hjchen2 in https://github.com/siliconflow/onediff/pull/552
  • Enable dynamic for comfy by @strint in https://github.com/siliconflow/onediff/pull/535
  • fix ControlLora usage by @ccssu in https://github.com/siliconflow/onediff/pull/565
  • add ci for deepcache and int8 by @doombeaker in https://github.com/siliconflow/onediff/pull/556
  • Enable MLIR logging flags in CI by @jackalcooper in https://github.com/siliconflow/onediff/pull/568
  • speedup node create mixed modelpatcher by @marigoold in https://github.com/siliconflow/onediff/pull/472
  • Support YGemm by @chengzeyi in https://github.com/siliconflow/onediff/pull/563
  • Support SVD dynamic shape[feat] by @lixiang007666 in https://github.com/siliconflow/onediff/pull/564
  • add cached loadloraweight by @marigoold in https://github.com/siliconflow/onediff/pull/524
  • support custom svd by @strint in https://github.com/siliconflow/onediff/pull/536
  • make diffusers_extensions.utils a package by @isidentical in https://github.com/siliconflow/onediff/pull/579
  • [Fix] dynamic switch for uncommon resolutions by @lixiang007666 in https://github.com/siliconflow/onediff/pull/573
  • Fix typo in README.md by @jackalcooper in https://github.com/siliconflow/onediff/pull/583
  • fixmultiresolutions_bug by @clackhan in https://github.com/siliconflow/onediff/pull/578
  • add graph cache key by @ccssu in https://github.com/siliconflow/onediff/pull/576
  • [perf] Remove redundant reshape op by @lixiang007666 in https://github.com/siliconflow/onediff/pull/586
  • Modify readme ee for svd by @lixiang007666 in https://github.com/siliconflow/onediff/pull/588
  • implement compilepipe and oneflowcompiler_config by @chengzeyi in https://github.com/siliconflow/onediff/pull/584
  • add quant_unet by @ccssu in https://github.com/siliconflow/onediff/pull/592
  • Fix Check Failed Error by @ccssu in https://github.com/siliconflow/onediff/pull/585
  • renamediffusersextensiontoonediffx by @clackhan in https://github.com/siliconflow/onediff/pull/593
  • Update onediffx README.md by @strint in https://github.com/siliconflow/onediff/pull/596
  • fix env var by @chengzeyi in https://github.com/siliconflow/onediff/pull/598
  • Dev support instant id by @chengzeyi in https://github.com/siliconflow/onediff/pull/597
  • Update setup.py by @lixiang007666 in https://github.com/siliconflow/onediff/pull/606
  • Refactor dualmodule._modules by @marigoold in https://github.com/siliconflow/onediff/pull/604
  • add repr of dualmodule by @marigoold in https://github.com/siliconflow/onediff/pull/610
  • Update enterprise readme for comfy svd by @lixiang007666 in https://github.com/siliconflow/onediff/pull/608
  • [feat] SVD dynamic shape for comfyui by @lixiang007666 in https://github.com/siliconflow/onediff/pull/600
  • Fix svd for comfy by @lixiang007666 in https://github.com/siliconflow/onediff/pull/611
  • add attentionallowquantization option by @chengzeyi in https://github.com/siliconflow/onediff/pull/612
  • Diffusers ext LoRA support text encoder by @marigoold in https://github.com/siliconflow/onediff/pull/587
  • reduce transpose operations to speedup by @hjchen2 in https://github.com/siliconflow/onediff/pull/589
  • use EulerAncestralDiscreteScheduler for instantid and textto_image by @chengzeyi in https://github.com/siliconflow/onediff/pull/623
  • Fix duplicate compilation by @ccssu in https://github.com/siliconflow/onediff/pull/622
  • point DualModule buffers and params to torch_module by @marigoold in https://github.com/siliconflow/onediff/pull/617
  • fix_readme by @clackhan in https://github.com/siliconflow/onediff/pull/625
  • Supporting obj is not an object. by @ccssu in https://github.com/siliconflow/onediff/pull/621
  • fix bug of dual module (setattr, and compatible with DualModule input) by @marigoold in https://github.com/siliconflow/onediff/pull/613
  • Black config by @strint in https://github.com/siliconflow/onediff/pull/627
  • Fix typo installing onediffdiffusersextensions by @jackalcooper in https://github.com/siliconflow/onediff/pull/632
  • fix compatibility with peft and diffusers 0.26.1 by @chengzeyi in https://github.com/siliconflow/onediff/pull/626
  • diffusers tests run with vm by @strint in https://github.com/siliconflow/onediff/pull/634
  • update readme with news by @strint in https://github.com/siliconflow/onediff/pull/638
  • Fix svd deepcache dynamic shape by @lixiang007666 in https://github.com/siliconflow/onediff/pull/635
  • support save graph which has dataclass output and add reverseproxyclass by @strint in https://github.com/siliconflow/onediff/pull/633
  • Refine SVD test example by @lixiang007666 in https://github.com/siliconflow/onediff/pull/639
  • remove sdxl turbo custom scheduler to refine quality by @doombeaker in https://github.com/siliconflow/onediff/pull/614
  • Run turbo in examples by @jackalcooper in https://github.com/siliconflow/onediff/pull/637
  • Revert "Run turbo in examples" by @jackalcooper in https://github.com/siliconflow/onediff/pull/640
  • fix no module named 'onediffx.utils' error by @chengzeyi in https://github.com/siliconflow/onediff/pull/624
  • fix diffusers>=0.26 compatibility for deepcache/onediffx by @isidentical in https://github.com/siliconflow/onediff/pull/641
  • [Fix] deepcache uncommon resolution base by @lixiang007666 in https://github.com/siliconflow/onediff/pull/620
  • mv examples to diffusers extension by @strint in https://github.com/siliconflow/onediff/pull/643
  • Enhance debug of transform error by @strint in https://github.com/siliconflow/onediff/pull/645
  • Reuse compiled components betwent pipelines by @strint in https://github.com/siliconflow/onediff/pull/644
  • refine log by @strint in https://github.com/siliconflow/onediff/pull/646
  • add quant dual gemm config and quant pipeline by @hjchen2 in https://github.com/siliconflow/onediff/pull/651
  • update readme, recommend install from source if use plugin by @marigoold in https://github.com/siliconflow/onediff/pull/652
  • CI for LoRA by @marigoold in https://github.com/siliconflow/onediff/pull/595
  • sd-webui support img2img by @marigoold in https://github.com/siliconflow/onediff/pull/655
  • fix printout by @ccssu in https://github.com/siliconflow/onediff/pull/658
  • compatiblewithdiffisers_0.26 by @clackhan in https://github.com/siliconflow/onediff/pull/662
  • Remove ONEFLOWRUNGRAPHBYVM in comfy docker compose by @jackalcooper in https://github.com/siliconflow/onediff/pull/661
  • compatible for sdxl lightning by @clackhan in https://github.com/siliconflow/onediff/pull/664
  • sd-webui support sgm UNet by @marigoold in https://github.com/siliconflow/onediff/pull/668
  • Update workflow for lightning by @jackalcooper in https://github.com/siliconflow/onediff/pull/670
  • Update README_ENTERPRISE.md by @ccssu in https://github.com/siliconflow/onediff/pull/672
  • addcomfyuisavegraphdir_variable by @ccssu in https://github.com/siliconflow/onediff/pull/673
  • Fix ee check by @strint in https://github.com/siliconflow/onediff/pull/676
  • cachesdxllinghtning_pipe by @clackhan in https://github.com/siliconflow/onediff/pull/677
  • fix: proper loading from remote code by @isidentical in https://github.com/siliconflow/onediff/pull/679
  • Update diffusers version to latested by @strint in https://github.com/siliconflow/onediff/pull/681
  • update perf data by @strint in https://github.com/siliconflow/onediff/pull/686
  • Publish onediffx on PyPI regularly by @jackalcooper in https://github.com/siliconflow/onediff/pull/687
  • Also install onediffx in docker image by @jackalcooper in https://github.com/siliconflow/onediff/pull/689
  • fix ci error by @ccssu in https://github.com/siliconflow/onediff/pull/688
  • Use diffusers.EulerDiscreteScheduler as onediff's implementation by @jackalcooper in https://github.com/siliconflow/onediff/pull/692
  • Update readme by @clackhan in https://github.com/siliconflow/onediff/pull/680
  • Add OneDiff for InstantID ComfyUI by @ccssu in https://github.com/siliconflow/onediff/pull/693
  • refactor onediffx.lora by @marigoold in https://github.com/siliconflow/onediff/pull/656
  • update readme for v0121 by @strint in https://github.com/siliconflow/onediff/pull/694
  • fixsvdresolution_error by @ccssu in https://github.com/siliconflow/onediff/pull/690

New Contributors

  • @isidentical made their first contribution in https://github.com/siliconflow/onediff/pull/579

Full Changelog: https://github.com/siliconflow/onediff/compare/0.12.0...0.12.1

- Jupyter Notebook
Published by strint over 2 years ago

onediff - 0.12.0(Enable vm runtime as default)

onediff 0.12 (change image size will have no cost for most of the models now)

  • switch image size will not trigger re-compilation(i.e. no time cost);
  • faster to save and load a graph;
  • smaller static memory needed;
  • much easier to switch graphs;

Note 1. After updating onediff to 0.12, oneflow also needs to be updated to the latest with https://github.com/siliconflow/onediff?tab=readme-ov-file#1-install-oneflow 2. If you are using save/load graph. Please use this new version to save the graph again. 3. For SVD(Stable Video Diffusion) onediff users, please use os.environ["VMREBUILDDYNAMICSHAPE"] = "1" to support DYNAMIC SHAPE with SVD. There has some re-compile cost, when enabling VMREBUILDDYNAMICSHAPE, so loading graph is needed. We will do more work on this.

OneDiff SDXL inference has been integrated into fal.ai playground

SDXL inference at the speed of thought: https://www.fal.ai/models/onediff-sdxl

And OneDiff ComfyUI nodes are in ComfyUI-Manager Now

img_v3_0271_db8b580c-89e2-49a3-8041-26d34d02549g

- Jupyter Notebook
Published by strint over 2 years ago

onediff - 0.11.4(Support SD web UI and update performance)

  • Release new performance data on SDXL.
  • Support SD web UI SD and SDXL acceleration.
  • Add SVD/DeepCache diffusers pipeline and optimize performance.

What's Changed

  • Fix int8 lora by @doombeaker in https://github.com/siliconflow/onediff/pull/431
  • Fix deepcache for svd by @lixiang007666 in https://github.com/siliconflow/onediff/pull/438
  • Update onediffcomfynodes README by @ccssu in https://github.com/siliconflow/onediff/pull/439
  • Update README.md by @eltociear in https://github.com/siliconflow/onediff/pull/440
  • Fix diffusers 0 25 dev by @ccssu in https://github.com/siliconflow/onediff/pull/444
  • adddeepcachewithlora_workflow by @clackhan in https://github.com/siliconflow/onediff/pull/442
  • fix reamde typos by @doombeaker in https://github.com/siliconflow/onediff/pull/455
  • support mode parameter in PyTorch 2.1 by @haoyang9804 in https://github.com/siliconflow/onediff/pull/458
  • use fusedmultiheadattentioninference_v2 to implement CrossAttention by @fpzh2011 in https://github.com/siliconflow/onediff/pull/459
  • Add OneDiffCheckpointLoader by @ccssu in https://github.com/siliconflow/onediff/pull/457
  • Add onediffcheckpointloadersimple refine by @ccssu in https://github.com/siliconflow/onediff/pull/460
  • Fix SVD VAE compile for diffuser by @lixiang007666 in https://github.com/siliconflow/onediff/pull/461
  • Feature/svd support by @chengzeyi in https://github.com/siliconflow/onediff/pull/454
  • Update README.md for SVD by @lixiang007666 in https://github.com/siliconflow/onediff/pull/462
  • Revert "Fix SVD VAE compile for diffuser" by @hjchen2 in https://github.com/siliconflow/onediff/pull/464
  • Integrate deep cache diffusers pipeline by @clackhan in https://github.com/siliconflow/onediff/pull/450
  • support v1-5-pruned model in sd-webui by @fpzh2011 in https://github.com/siliconflow/onediff/pull/463
  • use object.setattr in DualModule and DeployableModule to avoid unexpected key in self._modules by @marigoold in https://github.com/siliconflow/onediff/pull/468
  • fix an op convertion error by @haoyang9804 in https://github.com/siliconflow/onediff/pull/469
  • Quick fix vae load by @strint in https://github.com/siliconflow/onediff/pull/470
  • add perf chart by @strint in https://github.com/siliconflow/onediff/pull/474
  • Revert "use object.setattr in DualModule and DeployableModule to avoid unexpected key in self._modules" by @marigoold in https://github.com/siliconflow/onediff/pull/476
  • updateonediffcomfynodesREADME by @ccssu in https://github.com/siliconflow/onediff/pull/477
  • Sd Web Unet Model Quantization and Black Formatting by @ccssu in https://github.com/siliconflow/onediff/pull/445
  • Add a notebook showing how to save graph locally and load from it by @kopyl in https://github.com/siliconflow/onediff/pull/475
  • prefer cudnn convolution by @chengzeyi in https://github.com/siliconflow/onediff/pull/480
  • Fix lora parameter update by @ccssu in https://github.com/siliconflow/onediff/pull/479
  • Migrate to new CI deployments by @jackalcooper in https://github.com/siliconflow/onediff/pull/482
  • enable dual gemm glu by @chengzeyi in https://github.com/siliconflow/onediff/pull/481
  • Opt deep cache sdxl pipeline by @clackhan in https://github.com/siliconflow/onediff/pull/485
  • Change default env val by @clackhan in https://github.com/siliconflow/onediff/pull/487
  • add vae compile to sd-webui by @fpzh2011 in https://github.com/siliconflow/onediff/pull/473
  • fix read me of webui by @fpzh2011 in https://github.com/siliconflow/onediff/pull/489
  • Update README.md for connection by @strint in https://github.com/siliconflow/onediff/pull/492

New Contributors

  • @eltociear made their first contribution in https://github.com/siliconflow/onediff/pull/440
  • @haoyang9804 made their first contribution in https://github.com/siliconflow/onediff/pull/458
  • @chengzeyi made their first contribution in https://github.com/siliconflow/onediff/pull/454
  • @kopyl made their first contribution in https://github.com/siliconflow/onediff/pull/475

Full Changelog: https://github.com/siliconflow/onediff/compare/0.11.3...0.11.4

- Jupyter Notebook
Published by strint over 2 years ago

onediff - 0.11.3(DeepCache, SVD supported)

- Jupyter Notebook
Published by strint over 2 years ago

onediff - 0.11.2 (ComfyUI, ControlNet and SDXL Turbo)

Speedup for ComfyUI, ControlNet, and SDXL Turbo.

- Jupyter Notebook
Published by strint over 2 years ago

onediff - 0.11.1 is released

  • Add more examples.
  • Some code refactoring and bug fixes.

- Jupyter Notebook
Published by strint over 2 years ago

onediff - 0.11.0 is released

  • New performance data.
  • Added support for SD2.1 and SDXL.
  • New plug-and-play compilation interface oneflow_compile.

- Jupyter Notebook
Published by strint over 2 years ago