Omnigen2 model implementation. #8669
Conversation
comfyanonymous
requested review from
yoland68,
robinjhuang,
pythongosssss,
ltdrdata,
Kosinkadink,
webfiltered and
christian-byrne
as code owners
|
My initial finding is that I get really bad/baked results if the reference image size differs from the latent image size. In the workflow above, you have an upscale node which scales the image to something like 1012x1050 but not exactly 1024x1024 like the empty latent image. |
|
I added a workflow that is closer to the reference code. |
|
I'm not able to find a ReferenceLatent node:
I searched the web as well as comfyui manager. This is when I tried to use the first workflow in this thread. ComfyUI Error Report
## Error Details
- **Node ID:** N/A
- **Node Type:** N/A
- **Exception Type:** Prompt execution failed
- **Exception Message:** Cannot execute because a node is missing the class_type property.: Node ID '#15'
## Stack Trace
```
PromptExecutionError@http://[IP address]:8188/assets/index-DIZ3S7TP.js:95645:5
queuePrompt@http://[IP address]:8188/assets/index-DIZ3S7TP.js:95974:13
2025-06-26T01:15:50.655808 - Loaded AdvancedControlNet nodes from2025-06-26T01:15:50.655823 - 2025-06-26T01:15:50.655832 - [Home directory]/sd/ComfyUI/custom_nodes/ComfyUI-Advanced-ControlNet2025-06-26T01:15:50.655841 - 2025-06-26T01:15:51.892684 - 2025-06-26T01:15:52.821003 - IMPORT FAILED: nodes_ideogram.py comfyui-workflow-templates is not installed. Please install the updated requirements.txt file by running: This error is happening because the ComfyUI frontend is no longer shipped as part of the main repo but as a pip package instead. If you are on the portable package you can run: update\update_comfyui.bat to solve this problem ********** ERROR *********** 2025-06-26T01:15:52.832297 - To see the GUI go to: http://[IP address]:8188 {"id":"38d4a359-349a-444f-acc1-acba3173c650","revision":0,"last_node_id":33,"last_link_id":56,"nodes":[{"id":10,"type":"CLIPLoader","pos":[80,310],"size":[310,106],"flags":{},"order":0,"mode":0,"inputs":[{"localized_name":"clip_name","name":"clip_name","type":"COMBO","widget":{"name":"clip_name"},"link":null},{"localized_name":"type","name":"type","type":"COMBO","widget":{"name":"type"},"link":null},{"localized_name":"device","name":"device","shape":7,"type":"COMBO","widget":{"name":"device"},"link":null}],"outputs":[{"localized_name":"CLIP","name":"CLIP","type":"CLIP","links":[10,11]}],"properties":{"cnr_id":"comfy-core","ver":"0.3.33","Node name for S&R":"CLIPLoader","widget_ue_connectable":{}},"widgets_values":["qwen_2.5_vl_fp16.safetensors","omnigen2","default"]},{"id":8,"type":"VAEDecode","pos":[1200.80419921875,185.2679443359375],"size":[210,46],"flags":{},"order":19,"mode":0,"inputs":[{"localized_name":"samples","name":"samples","type":"LATENT","link":46},{"localized_name":"vae","name":"vae","type":"VAE","link":14}],"outputs":[{"localized_name":"IMAGE","name":"IMAGE","type":"IMAGE","slot_index":0,"links":[9]}],"properties":{"cnr_id":"comfy-core","ver":"0.3.33","Node name for S&R":"VAEDecode","widget_ue_connectable":{}},"widgets_values":[]},{"id":9,"type":"SaveImage","pos":[1423.884765625,187.22410583496094],"size":[724.650634765625,776.3861694335938],"flags":{},"order":20,"mode":0,"inputs":[{"localized_name":"images","name":"images","type":"IMAGE","link":9},{"localized_name":"filename_prefix","name":"filename_prefix","type":"STRING","widget":{"name":"filename_prefix"},"link":null}],"outputs":[],"properties":{"cnr_id":"comfy-core","ver":"0.3.33","Node name for S&R":"SaveImage","widget_ue_connectable":{}},"widgets_values":["ComfyUI"]},{"id":29,"type":"ReferenceLatent","pos":[900.5264282226562,-80.55391693115234],"size":[197.712890625,46],"flags":{},"order":15,"mode":0,"inputs":[{"name":"conditioning","type":"CONDITIONING","link":44},{"name":"latent","shape":7,"type":"LATENT","link":42}],"outputs":[{"name":"CONDITIONING","type":"CONDITIONING","links":[43]}],"properties":{"Node name for S&R":"ReferenceLatent"},"widgets_values":[]},{"id":7,"type":"CLIPTextEncode","pos":[413,389],"size":[425.27801513671875,180.6060791015625],"flags":{},"order":8,"mode":0,"inputs":[{"localized_name":"clip","name":"clip","type":"CLIP","link":10},{"localized_name":"text","name":"text","type":"STRING","widget":{"name":"text"},"link":null}],"outputs":[{"localized_name":"CONDITIONING","name":"CONDITIONING","type":"CONDITIONING","slot_index":0,"links":[44,45]}],"properties":{"cnr_id":"comfy-core","ver":"0.3.33","Node name for S&R":"CLIPTextEncode","widget_ue_connectable":{}},"widgets_values":["deformed, blurry, over saturation, bad anatomy, disfigured, poorly drawn face, mutation, mutated, extra_limb, ugly, poorly drawn hands, fused fingers, messy drawing, broken legs censor, censored, censor_bar"]},{"id":28,"type":"SamplerCustomAdvanced","pos":[980,180],"size":[202.53378295898438,106],"flags":{},"order":18,"mode":0,"inputs":[{"localized_name":"noise","name":"noise","type":"NOISE","link":33},{"localized_name":"guider","name":"guider","type":"GUIDER","link":34},{"localized_name":"sampler","name":"sampler","type":"SAMPLER","link":35},{"localized_name":"sigmas","name":"sigmas","type":"SIGMAS","link":36},{"localized_name":"latent_image","name":"latent_image","type":"LATENT","link":49}],"outputs":[{"localized_name":"output","name":"output","type":"LATENT","slot_index":0,"links":[46]},{"localized_name":"denoised_output","name":"denoised_output","type":"LATENT","links":null}],"properties":{"cnr_id":"comfy-core","ver":"0.3.33","Node name for S&R":"SamplerCustomAdvanced","widget_ue_connectable":{}},"widgets_values":[]},{"id":31,"type":"PrimitiveNode","pos":[969.8136596679688,473.2232360839844],"size":[210,82],"flags":{},"order":1,"mode":0,"inputs":[],"outputs":[{"name":"FLOAT","type":"FLOAT","widget":{"name":"cfg_cond2_negative"},"links":[51]}],"title":"image CFG","properties":{"Run widget replace on values":false,"widget_ue_connectable":{}},"widgets_values":[2,"fixed"]},{"id":30,"type":"PrimitiveNode","pos":[967.3342895507812,346.77691650390625],"size":[210,82],"flags":{},"order":2,"mode":0,"inputs":[],"outputs":[{"name":"FLOAT","type":"FLOAT","widget":{"name":"cfg_conds"},"links":[50]}],"title":"text CFG","properties":{"Run widget replace on values":false,"widget_ue_connectable":{}},"widgets_values":[5,"fixed"]},{"id":21,"type":"RandomNoise","pos":[860,600],"size":[315,82],"flags":{},"order":3,"mode":0,"inputs":[{"localized_name":"noise_seed","name":"noise_seed","type":"INT","widget":{"name":"noise_seed"},"link":null}],"outputs":[{"localized_name":"NOISE","name":"NOISE","type":"NOISE","links":[33]}],"properties":{"cnr_id":"comfy-core","ver":"0.3.33","Node name for S&R":"RandomNoise","widget_ue_connectable":{}},"widgets_values":[822957660815591,"randomize"]},{"id":20,"type":"KSamplerSelect","pos":[870,80],"size":[315,58],"flags":{},"order":4,"mode":0,"inputs":[{"localized_name":"sampler_name","name":"sampler_name","type":"COMBO","widget":{"name":"sampler_name"},"link":null}],"outputs":[{"localized_name":"SAMPLER","name":"SAMPLER","type":"SAMPLER","links":[35]}],"properties":{"cnr_id":"comfy-core","ver":"0.3.33","Node name for S&R":"KSamplerSelect","widget_ue_connectable":{}},"widgets_values":["euler"]},{"id":12,"type":"UNETLoader","pos":[80,190],"size":[310,82],"flags":{},"order":5,"mode":0,"inputs":[{"localized_name":"unet_name","name":"unet_name","type":"COMBO","widget":{"name":"unet_name"},"link":null},{"localized_name":"weight_dtype","name":"weight_dtype","type":"COMBO","widget":{"name":"weight_dtype"},"link":null}],"outputs":[{"localized_name":"MODEL","name":"MODEL","type":"MODEL","links":[52,53]}],"properties":{"cnr_id":"comfy-core","ver":"0.3.33","Node name for S&R":"UNETLoader","widget_ue_connectable":{}},"widgets_values":["omnigen2_fp16.safetensors","default"]},{"id":27,"type":"DualCFGGuider","pos":[1132.8111572265625,-126.77679443359375],"size":[315,142],"flags":{},"order":17,"mode":0,"inputs":[{"localized_name":"model","name":"model","type":"MODEL","link":53},{"localized_name":"cond1","name":"cond1","type":"CONDITIONING","link":40},{"localized_name":"cond2","name":"cond2","type":"CONDITIONING","link":43},{"localized_name":"negative","name":"negative","type":"CONDITIONING","link":45},{"localized_name":"cfg_conds","name":"cfg_conds","type":"FLOAT","widget":{"name":"cfg_conds"},"link":50},{"localized_name":"cfg_cond2_negative","name":"cfg_cond2_negative","type":"FLOAT","widget":{"name":"cfg_cond2_negative"},"link":51}],"outputs":[{"localized_name":"GUIDER","name":"GUIDER","type":"GUIDER","slot_index":0,"links":[34]}],"properties":{"cnr_id":"comfy-core","ver":"0.3.33","Node name for S&R":"DualCFGGuider","widget_ue_connectable":{"cfg_conds":true,"cfg_cond2_negative":true}},"widgets_values":[5,2]},{"id":15,"type":"ReferenceLatent","pos":[898.9552001953125,-162.50741577148438],"size":[197.712890625,46],"flags":{},"order":14,"mode":0,"inputs":[{"name":"conditioning","type":"CONDITIONING","link":16},{"name":"latent","shape":7,"type":"LATENT","link":18}],"outputs":[{"name":"CONDITIONING","type":"CONDITIONING","links":[40]}],"properties":{"Node name for S&R":"ReferenceLatent"},"widgets_values":[]},{"id":6,"type":"CLIPTextEncode","pos":[415,186],"size":[422.84503173828125,164.31304931640625],"flags":{},"order":9,"mode":0,"inputs":[{"localized_name":"clip","name":"clip","type":"CLIP","link":11},{"localized_name":"text","name":"text","type":"STRING","widget":{"name":"text"},"link":null}],"outputs":[{"localized_name":"CONDITIONING","name":"CONDITIONING","type":"CONDITIONING","slot_index":0,"links":[16]}],"properties":{"cnr_id":"comfy-core","ver":"0.3.33","Node name for S&R":"CLIPTextEncode","widget_ue_connectable":{}},"widgets_values":["she is waving at the camera while smiling"]},{"id":17,"type":"ImageScaleToTotalPixels","pos":[140,-180],"size":[270,82],"flags":{},"order":11,"mode":0,"inputs":[{"localized_name":"image","name":"image","type":"IMAGE","link":20},{"localized_name":"upscale_method","name":"upscale_method","type":"COMBO","widget":{"name":"upscale_method"},"link":null},{"localized_name":"megapixels","name":"megapixels","type":"FLOAT","widget":{"name":"megapixels"},"link":null}],"outputs":[{"localized_name":"IMAGE","name":"IMAGE","type":"IMAGE","links":[21,54]}],"properties":{"cnr_id":"comfy-core","ver":"0.3.33","Node name for S&R":"ImageScaleToTotalPixels","widget_ue_connectable":{}},"widgets_values":["area",1]},{"id":23,"type":"BasicScheduler","pos":[964.5460205078125,724.545166015625],"size":[210,106],"flags":{},"order":10,"mode":0,"inputs":[{"localized_name":"model","name":"model","type":"MODEL","link":52},{"localized_name":"scheduler","name":"scheduler","type":"COMBO","widget":{"name":"scheduler"},"link":null},{"localized_name":"steps","name":"steps","type":"INT","widget":{"name":"steps"},"link":null},{"localized_name":"denoise","name":"denoise","type":"FLOAT","widget":{"name":"denoise"},"link":null}],"outputs":[{"localized_name":"SIGMAS","name":"SIGMAS","type":"SIGMAS","links":[36]}],"properties":{"cnr_id":"comfy-core","ver":"0.3.33","Node name for S&R":"BasicScheduler","widget_ue_connectable":{}},"widgets_values":["simple",20,1]},{"id":11,"type":"EmptySD3LatentImage","pos":[565.4563598632812,607.9689331054688],"size":[270,106],"flags":{},"order":16,"mode":0,"inputs":[{"localized_name":"width","name":"width","type":"INT","widget":{"name":"width"},"link":55},{"localized_name":"height","name":"height","type":"INT","widget":{"name":"height"},"link":56},{"localized_name":"batch_size","name":"batch_size","type":"INT","widget":{"name":"batch_size"},"link":null}],"outputs":[{"localized_name":"LATENT","name":"LATENT","type":"LATENT","links":[49]}],"properties":{"cnr_id":"comfy-core","ver":"0.3.33","Node name for S&R":"EmptySD3LatentImage","widget_ue_connectable":{"width":true,"height":true}},"widgets_values":[1024,1024,1]},{"id":32,"type":"GetImageSize","pos":[298.1094055175781,628.9943237304688],"size":[246,136],"flags":{},"order":13,"mode":0,"inputs":[{"localized_name":"image","name":"image","type":"IMAGE","link":54}],"outputs":[{"localized_name":"width","name":"width","type":"INT","links":[55]},{"localized_name":"height","name":"height","type":"INT","links":[56]},{"name":"batch_size","type":"INT","links":null}],"properties":{"cnr_id":"stability-ComfyUI-nodes","ver":"001154622564b17223ce0191803c5fff7b87146c","Node name for S&R":"GetImageSize","widget_ue_connectable":{}},"widgets_values":[]},{"id":16,"type":"LoadImage","pos":[-155.0478515625,-184.6930694580078],"size":[274.080078125,314],"flags":{},"order":6,"mode":0,"inputs":[{"localized_name":"image","name":"image","type":"COMBO","widget":{"name":"image"},"link":null},{"localized_name":"choose file to upload","name":"upload","type":"IMAGEUPLOAD","widget":{"name":"upload"},"link":null}],"outputs":[{"localized_name":"IMAGE","name":"IMAGE","type":"IMAGE","links":[20]},{"localized_name":"MASK","name":"MASK","type":"MASK","links":null}],"properties":{"cnr_id":"comfy-core","ver":"0.3.33","Node name for S&R":"LoadImage","widget_ue_connectable":{}},"widgets_values":["botox.jpg","image"]},{"id":13,"type":"VAELoader","pos":[80,460],"size":[310,58],"flags":{},"order":7,"mode":0,"inputs":[{"localized_name":"vae_name","name":"vae_name","type":"COMBO","widget":{"name":"vae_name"},"link":null}],"outputs":[{"localized_name":"VAE","name":"VAE","type":"VAE","links":[14,15]}],"properties":{"cnr_id":"comfy-core","ver":"0.3.33","Node name for S&R":"VAELoader","widget_ue_connectable":{}},"widgets_values":["omnigen/ae.safetensors"]},{"id":14,"type":"VAEEncode","pos":[682.9427490234375,-103.20915222167969],"size":[140,46],"flags":{},"order":12,"mode":0,"inputs":[{"localized_name":"pixels","name":"pixels","type":"IMAGE","link":21},{"localized_name":"vae","name":"vae","type":"VAE","link":15}],"outputs":[{"localized_name":"LATENT","name":"LATENT","type":"LATENT","links":[18,42]}],"properties":{"cnr_id":"comfy-core","ver":"0.3.33","Node name for S&R":"VAEEncode","widget_ue_connectable":{}},"widgets_values":[]}],"links":[[9,8,0,9,0,"IMAGE"],[10,10,0,7,0,"CLIP"],[11,10,0,6,0,"CLIP"],[14,13,0,8,1,"VAE"],[15,13,0,14,1,"VAE"],[16,6,0,15,0,"CONDITIONING"],[18,14,0,15,1,"LATENT"],[20,16,0,17,0,"IMAGE"],[21,17,0,14,0,"IMAGE"],[33,21,0,28,0,"NOISE"],[34,27,0,28,1,"GUIDER"],[35,20,0,28,2,"SAMPLER"],[36,23,0,28,3,"SIGMAS"],[40,15,0,27,1,"CONDITIONING"],[42,14,0,29,1,"LATENT"],[43,29,0,27,2,"CONDITIONING"],[44,7,0,29,0,"CONDITIONING"],[45,7,0,27,3,"CONDITIONING"],[46,28,0,8,0,"LATENT"],[49,11,0,28,4,"LATENT"],[50,30,0,27,4,"FLOAT"],[51,31,0,27,5,"FLOAT"],[52,12,0,23,0,"MODEL"],[53,12,0,27,0,"MODEL"],[54,17,0,32,0,"IMAGE"],[55,32,0,11,0,"INT"],[56,32,1,11,1,"INT"]],"groups":[],"config":{},"extra":{"ds":{"scale":1,"offset":[-537.2743534996835,378.46027997638174]},"frontendVersion":"1.18.9","groupNodes":{"IP2PSampler":{"nodes":[{"type":"KSamplerSelect","pos":[912,1536],"size":{"0":315,"1":58},"flags":{},"order":6,"mode":0,"outputs":[{"name":"SAMPLER","type":"SAMPLER","links":[],"localized_name":"SAMPLER"}],"properties":{"Node name for S&R":"KSamplerSelect"},"widgets_values":["euler"],"index":0,"inputs":[{"name":"sampler_name","localized_name":"sampler_name","type":"COMBO","widget":{"name":"sampler_name"},"boundingRect":[0,0,0,0],"link":null}]},{"type":"RandomNoise","pos":[912,1200],"size":{"0":315,"1":82},"flags":{},"order":7,"mode":0,"outputs":[{"name":"NOISE","type":"NOISE","links":[],"localized_name":"NOISE"}],"properties":{"Node name for S&R":"RandomNoise"},"widgets_values":[156680208700303,"fixed"],"index":1,"inputs":[{"name":"noise_seed","localized_name":"noise_seed","type":"INT","widget":{"name":"noise_seed"},"boundingRect":[0,0,0,0],"link":null}]},{"type":"Reroute","pos":[720,1488],"size":[75,26],"flags":{},"order":9,"mode":0,"inputs":[{"name":"","type":"","link":null}],"outputs":[{"name":"","type":"","links":null}],"properties":{"showOutputText":false,"horizontal":false},"index":2},{"type":"BasicScheduler","pos":[912,1632],"size":{"0":315,"1":106},"flags":{},"order":12,"mode":0,"inputs":[{"name":"model","type":"MODEL","link":null,"localized_name":"model"},{"name":"scheduler","localized_name":"scheduler","type":"COMBO","widget":{"name":"scheduler"},"boundingRect":[0,0,0,0],"link":null},{"name":"steps","localized_name":"steps","type":"INT","widget":{"name":"steps"},"boundingRect":[0,0,0,0],"link":null},{"name":"denoise","localized_name":"denoise","type":"FLOAT","widget":{"name":"denoise"},"boundingRect":[0,0,0,0],"link":null}],"outputs":[{"name":"SIGMAS","type":"SIGMAS","links":[],"localized_name":"SIGMAS"}],"properties":{"Node name for S&R":"BasicScheduler"},"widgets_values":["normal",20,1],"index":3},{"type":"Reroute","pos":[575,1344],"size":[75,26],"flags":{},"order":14,"mode":0,"inputs":[{"name":"","type":"","link":null}],"outputs":[{"name":"","type":"","links":null}],"properties":{"showOutputText":false,"horizontal":false},"index":4},{"type":"Reroute","pos":[570,1386],"size":[75,26],"flags":{},"order":13,"mode":0,"inputs":[{"name":"","type":"","link":null}],"outputs":[{"name":"","type":"","links":null}],"properties":{"showOutputText":false,"horizontal":false},"index":5},{"type":"InstructPixToPixConditioning","pos":[672,1344],"size":{"0":235.1999969482422,"1":86},"flags":{},"order":15,"mode":0,"inputs":[{"name":"positive","type":"CONDITIONING","link":null,"localized_name":"positive"},{"name":"negative","type":"CONDITIONING","link":null,"localized_name":"negative"},{"name":"vae","type":"VAE","link":null,"localized_name":"vae"},{"name":"pixels","type":"IMAGE","link":null,"localized_name":"pixels"}],"outputs":[{"name":"positive","type":"CONDITIONING","links":[],"slot_index":0,"localized_name":"positive"},{"name":"negative","type":"CONDITIONING","links":[],"slot_index":1,"localized_name":"negative"},{"name":"latent","type":"LATENT","links":[],"slot_index":2,"localized_name":"latent"}],"properties":{"Node name for S&R":"InstructPixToPixConditioning"},"index":6,"widgets_values":[]},{"type":"DualCFGGuider","pos":[912,1344],"size":{"0":315,"1":142},"flags":{},"order":16,"mode":0,"inputs":[{"name":"model","type":"MODEL","link":null,"localized_name":"model"},{"name":"cond1","type":"CONDITIONING","link":null,"localized_name":"cond1"},{"name":"cond2","type":"CONDITIONING","link":null,"localized_name":"cond2"},{"name":"negative","type":"CONDITIONING","link":null,"localized_name":"negative"},{"name":"cfg_conds","localized_name":"cfg_conds","type":"FLOAT","widget":{"name":"cfg_conds"},"boundingRect":[0,0,0,0],"link":null},{"name":"cfg_cond2_negative","localized_name":"cfg_cond2_negative","type":"FLOAT","widget":{"name":"cfg_cond2_negative"},"boundingRect":[0,0,0,0],"link":null}],"outputs":[{"name":"GUIDER","type":"GUIDER","links":[],"slot_index":0,"localized_name":"GUIDER"}],"properties":{"Node name for S&R":"DualCFGGuider"},"widgets_values":[3,1.5],"index":7},{"type":"SamplerCustomAdvanced","pos":[1296,1200],"size":{"0":355.20001220703125,"1":106},"flags":{},"order":17,"mode":0,"inputs":[{"name":"noise","type":"NOISE","link":null,"slot_index":0,"localized_name":"noise"},{"name":"guider","type":"GUIDER","link":null,"slot_index":1,"localized_name":"guider"},{"name":"sampler","type":"SAMPLER","link":null,"slot_index":2,"localized_name":"sampler"},{"name":"sigmas","type":"SIGMAS","link":null,"slot_index":3,"localized_name":"sigmas"},{"name":"latent_image","type":"LATENT","link":null,"slot_index":4,"localized_name":"latent_image"}],"outputs":[{"name":"output","type":"LATENT","links":[],"slot_index":0,"localized_name":"output"},{"name":"denoised_output","type":"LATENT","links":null,"localized_name":"denoised_output"}],"properties":{"Node name for S&R":"SamplerCustomAdvanced"},"index":8,"widgets_values":[]}],"links":[[null,0,2,0,4,"MODEL"],[2,0,3,0,26,"MODEL"],[null,0,5,0,7,"CONDITIONING"],[null,0,4,0,6,"CONDITIONING"],[4,0,6,0,35,"CONDITIONING"],[5,0,6,1,29,"CONDITIONING"],[null,2,6,2,4,"VAE"],[null,0,6,3,13,"IMAGE"],[2,0,7,0,26,"MODEL"],[6,0,7,1,33,"CONDITIONING"],[6,1,7,2,33,"CONDITIONING"],[5,0,7,3,29,"CONDITIONING"],[1,0,8,0,19,"NOISE"],[7,0,8,1,28,"GUIDER"],[0,0,8,2,20,"SAMPLER"],[3,0,8,3,21,"SIGMAS"],[6,2,8,4,33,"LATENT"]],"external":[[{"type":"SamplerCustomAdvanced","pos":[1296,1200],"size":{"0":355.20001220703125,"1":106},"flags":{},"order":17,"mode":0,"inputs":[{"name":"noise","type":"NOISE","link":null,"slot_index":0},{"name":"guider","type":"GUIDER","link":null,"slot_index":1},{"name":"sampler","type":"SAMPLER","link":null,"slot_index":2},{"name":"sigmas","type":"SIGMAS","link":null,"slot_index":3},{"name":"latent_image","type":"LATENT","link":null,"slot_index":4}],"outputs":[{"name":"output","type":"LATENT","links":[],"shape":3,"slot_index":0},{"name":"denoised_output","type":"LATENT","links":null,"shape":3}],"properties":{"Node name for S&R":"SamplerCustomAdvanced"},"index":8},0,"LATENT"]],"config":{"0":{},"1":{},"2":{"input":{"MODEL":{"name":"model"}}},"3":{},"4":{"input":{"CONDITIONING":{"name":"positive"}}},"5":{"input":{"CONDITIONING":{"name":"negative"}}},"6":{},"7":{"input":{"cfg_conds":{"name":"cfg_text"},"cfg_cond2_negative":{"name":"cfg_image"}}},"8":{}}}},"ue_links":[],"links_added_by_ue":[]},"version":0.4} |
|
This is not yet in stable comfyui so you need to update to the latest git version. |
|
ae.safetensorsae.safetensors |
|
Ok, that worked for the nodes, but when I run the workflow I get this red artifact:
(I got the same issue when I used input and output of 1024x1024 and with both of the above workflows.) |
|
how about the two reference image? |
If you run your comfyui with --bf16-unet does that fix it? Can you also tell me what GPU/pytorch version you have. |
i have same error |
add --bf16-unet fixed |
The same error, -- bf16 unet startup can fix this issue. GPU/pytorch : H20/cu122py310 |
|
The corrupted output should be fixed if you update. |
|
and how to input two reference image? |
|
Its working in the sense that its outputting valid images, but it is each time transforming the style of the image much more than in the examples I have seen. It could be the limitations of the model or it could be that I am not seeing the answer easily in this repo. I'm also not sure why the worfflow image turned out one big color, but my looking hasnt solved it yet.
|
|
Using Slower workflow |
|
can we have support for omnigen2 edit loras : |
Model files can be found here: https://huggingface.co/Comfy-Org/Omnigen2_ComfyUI_repackaged/tree/main/split_files
Slower workflow with dual CFG sampling just like the example code:
Faster workflow with non optimal sampling settings (the reference code does triple cfg like the old ip2p models, this workflow does regular cfg):
