cannot import name 'clear_device_cache' from 'accelerate.utils.memory' (/workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages/accelerate/utils/memory.py)

[sruckh-kubra]

Followed the exact instructions for using an anaconda environment. Using either the gradio app or the sample python text to image code the same error is presented.

Traceback (most recent call last):
File "/workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages/diffusers/utils/import_utils.py", line 920, in _get_module
return importlib.import_module("." + module_name, self.name)
File "/workspace/miniconda3/envs/omnigen/lib/python3.10/importlib/init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 1050, in _gcd_import
File "", line 1027, in _find_and_load
File "", line 1006, in _find_and_load_unlocked
File "", line 688, in _load_unlocked
File "", line 883, in exec_module
File "", line 241, in _call_with_frames_removed
File "/workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages/diffusers/loaders/peft.py", line 38, in
from .lora_base import _fetch_state_dict, _func_optionally_disable_offloading
File "/workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages/diffusers/loaders/lora_base.py", line 56, in
from peft.tuners.tuners_utils import BaseTunerLayer
File "/workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages/peft/init.py", line 17, in
from .auto import (
File "/workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages/peft/auto.py", line 31, in
from .config import PeftConfig
File "/workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages/peft/config.py", line 24, in
from .utils import CONFIG_NAME, PeftType, TaskType
File "/workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages/peft/utils/init.py", line 16, in
from .loftq_utils import replace_lora_weights_loftq
File "/workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages/peft/utils/loftq_utils.py", line 25, in
from accelerate.utils.memory import clear_device_cache
ImportError: cannot import name 'clear_device_cache' from 'accelerate.utils.memory' (/workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages/accelerate/utils/memory.py)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/workspace/OmniGen/test.py", line 1, in
from OmniGen import OmniGenPipeline
File "/workspace/OmniGen/OmniGen/init.py", line 1, in
from .model import OmniGen
File "/workspace/OmniGen/OmniGen/model.py", line 9, in
from diffusers.loaders import PeftAdapterMixin
File "", line 1075, in _handle_fromlist
File "/workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages/diffusers/utils/import_utils.py", line 910, in getattr
module = self._get_module(self._class_to_module[name])
File "/workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages/diffusers/utils/import_utils.py", line 922, in _get_module
raise RuntimeError(
RuntimeError: Failed to import diffusers.loaders.peft because of the following error (look up to see its traceback):
cannot import name 'clear_device_cache' from 'accelerate.utils.memory' (/workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages/accelerate/utils/memory.py)

[kiolep]

Try pip install --upgrade accelerate if you haven't yet. For me it solved my problem.
It may give you a warning that OmniGen expects accelerate==0.26.1, but it should work never the less.

[sruckh]

Well, that did seem to resolve the previous error, now it is complaining about the model. I don't know if it auto downloads or if I need to manually do this.

(omnigen) root@5a8df14cc945:/workspace/OmniGen# pip install -U accelerate
Requirement already satisfied: accelerate in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (0.26.1)
Collecting accelerate
Downloading accelerate-1.6.0-py3-none-any.whl.metadata (19 kB)
Requirement already satisfied: numpy<3.0.0,>=1.17 in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from accelerate) (2.2.4)
Requirement already satisfied: packaging>=20.0 in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from accelerate) (24.2)
Requirement already satisfied: psutil in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from accelerate) (5.9.8)
Requirement already satisfied: pyyaml in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from accelerate) (6.0.2)
Requirement already satisfied: torch>=2.0.0 in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from accelerate) (2.3.1+cu118)
Requirement already satisfied: huggingface-hub>=0.21.0 in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from accelerate) (0.30.1)
Requirement already satisfied: safetensors>=0.4.3 in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from accelerate) (0.5.3)
Requirement already satisfied: filelock in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from huggingface-hub>=0.21.0->accelerate) (3.18.0)
Requirement already satisfied: fsspec>=2023.5.0 in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from huggingface-hub>=0.21.0->accelerate) (2024.12.0)
Requirement already satisfied: requests in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from huggingface-hub>=0.21.0->accelerate) (2.32.3)
Requirement already satisfied: tqdm>=4.42.1 in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from huggingface-hub>=0.21.0->accelerate) (4.67.1)
Requirement already satisfied: typing-extensions>=3.7.4.3 in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from huggingface-hub>=0.21.0->accelerate) (4.13.1)
Requirement already satisfied: sympy in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from torch>=2.0.0->accelerate) (1.13.3)
Requirement already satisfied: networkx in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from torch>=2.0.0->accelerate) (3.4.2)
Requirement already satisfied: jinja2 in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from torch>=2.0.0->accelerate) (3.1.6)
Requirement already satisfied: nvidia-cuda-nvrtc-cu11==11.8.89 in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from torch>=2.0.0->accelerate) (11.8.89)
Requirement already satisfied: nvidia-cuda-runtime-cu11==11.8.89 in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from torch>=2.0.0->accelerate) (11.8.89)
Requirement already satisfied: nvidia-cuda-cupti-cu11==11.8.87 in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from torch>=2.0.0->accelerate) (11.8.87)
Requirement already satisfied: nvidia-cudnn-cu11==8.7.0.84 in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from torch>=2.0.0->accelerate) (8.7.0.84)
Requirement already satisfied: nvidia-cublas-cu11==11.11.3.6 in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from torch>=2.0.0->accelerate) (11.11.3.6)
Requirement already satisfied: nvidia-cufft-cu11==10.9.0.58 in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from torch>=2.0.0->accelerate) (10.9.0.58)
Requirement already satisfied: nvidia-curand-cu11==10.3.0.86 in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from torch>=2.0.0->accelerate) (10.3.0.86)
Requirement already satisfied: nvidia-cusolver-cu11==11.4.1.48 in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from torch>=2.0.0->accelerate) (11.4.1.48)
Requirement already satisfied: nvidia-cusparse-cu11==11.7.5.86 in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from torch>=2.0.0->accelerate) (11.7.5.86)
Requirement already satisfied: nvidia-nccl-cu11==2.20.5 in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from torch>=2.0.0->accelerate) (2.20.5)
Requirement already satisfied: nvidia-nvtx-cu11==11.8.86 in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from torch>=2.0.0->accelerate) (11.8.86)
Requirement already satisfied: triton==2.3.1 in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from torch>=2.0.0->accelerate) (2.3.1)
Requirement already satisfied: MarkupSafe>=2.0 in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from jinja2->torch>=2.0.0->accelerate) (3.0.2)
Requirement already satisfied: charset-normalizer<4,>=2 in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from requests->huggingface-hub>=0.21.0->accelerate) (3.4.1)
Requirement already satisfied: idna<4,>=2.5 in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from requests->huggingface-hub>=0.21.0->accelerate) (3.10)
Requirement already satisfied: urllib3<3,>=1.21.1 in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from requests->huggingface-hub>=0.21.0->accelerate) (2.3.0)
Requirement already satisfied: certifi>=2017.4.17 in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from requests->huggingface-hub>=0.21.0->accelerate) (2025.1.31)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages (from sympy->torch>=2.0.0->accelerate) (1.3.0)
Downloading accelerate-1.6.0-py3-none-any.whl (354 kB)
Installing collected packages: accelerate
Attempting uninstall: accelerate
Found existing installation: accelerate 0.26.1
Uninstalling accelerate-0.26.1:
Successfully uninstalled accelerate-0.26.1
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
omnigen 1.0.3 requires accelerate==0.26.1, but you have accelerate 1.6.0 which is incompatible.
Successfully installed accelerate-1.6.0
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.
(omnigen) root@5a8df14cc945:/workspace/OmniGen# python app.py
The cache for model files in Transformers v4.22.0 has been updated. Migrating your old cache. This is a one-time only operation. You can interrupt this and resume the migration later on by calling transformers.utils.move_cache().
0it [00:00, ?it/s]
Loading safetensors
Traceback (most recent call last):
File "/workspace/OmniGen/app.py", line 11, in
pipe = OmniGenPipeline.from_pretrained(
File "/workspace/OmniGen/OmniGen/pipeline.py", line 85, in from_pretrained
processor = OmniGenProcessor.from_pretrained(model_name)
File "/workspace/OmniGen/OmniGen/processor.py", line 48, in from_pretrained
text_tokenizer = AutoTokenizer.from_pretrained(model_name)
File "/workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py", line 864, in from_pretrained
config = AutoConfig.from_pretrained(
File "/workspace/miniconda3/envs/omnigen/lib/python3.10/site-packages/transformers/models/auto/configuration_auto.py", line 1038, in from_pretrained
raise ValueError(
ValueError: Unrecognized model in Shitao/OmniGen-v1. Should have a model_type key in its config.json, or contain one of the following strings in its name: albert, align, altclip, audio-spectrogram-transformer, autoformer, bark, bart, beit, bert, bert-generation, big_bird, bigbird_pegasus, biogpt, bit, blenderbot, blenderbot-small, blip, blip-2, bloom, bridgetower, bros, camembert, canine, chameleon, chinese_clip, chinese_clip_vision_model, clap, clip, clip_text_model, clip_vision_model, clipseg, clvp, code_llama, codegen, cohere, conditional_detr, convbert, convnext, convnextv2, cpmant, ctrl, cvt, dac, data2vec-audio, data2vec-text, data2vec-vision, dbrx, deberta, deberta-v2, decision_transformer, deformable_detr, deit, depth_anything, deta, detr, dinat, dinov2, distilbert, donut-swin, dpr, dpt, efficientformer, efficientnet, electra, encodec, encoder-decoder, ernie, ernie_m, esm, falcon, falcon_mamba, fastspeech2_conformer, flaubert, flava, fnet, focalnet, fsmt, funnel, fuyu, gemma, gemma2, git, glpn, gpt-sw3, gpt2, gpt_bigcode, gpt_neo, gpt_neox, gpt_neox_japanese, gptj, gptsan-japanese, granite, granitemoe, graphormer, grounding-dino, groupvit, hiera, hubert, ibert, idefics, idefics2, imagegpt, informer, instructblip, instructblipvideo, jamba, jetmoe, jukebox, kosmos-2, layoutlm, layoutlmv2, layoutlmv3, led, levit, lilt, llama, llava, llava_next, llava_next_video, llava_onevision, longformer, longt5, luke, lxmert, m2m_100, mamba, mamba2, marian, markuplm, mask2former, maskformer, maskformer-swin, mbart, mctct, mega, megatron-bert, mgp-str, mimi, mistral, mixtral, mllama, mobilebert, mobilenet_v1, mobilenet_v2, mobilevit, mobilevitv2, mpnet, mpt, mra, mt5, musicgen, musicgen_melody, mvp, nat, nemotron, nezha, nllb-moe, nougat, nystromformer, olmo, olmoe, omdet-turbo, oneformer, open-llama, openai-gpt, opt, owlv2, owlvit, paligemma, patchtsmixer, patchtst, pegasus, pegasus_x, perceiver, persimmon, phi, phi3, pix2struct, pixtral, plbart, poolformer, pop2piano, prophetnet, pvt, pvt_v2, qdqbert, qwen2, qwen2_audio, qwen2_audio_encoder, qwen2_moe, qwen2_vl, rag, realm, recurrent_gemma, reformer, regnet, rembert, resnet, retribert, roberta, roberta-prelayernorm, roc_bert, roformer, rt_detr, rt_detr_resnet, rwkv, sam, seamless_m4t, seamless_m4t_v2, segformer, seggpt, sew, sew-d, siglip, siglip_vision_model, speech-encoder-decoder, speech_to_text, speech_to_text_2, speecht5, splinter, squeezebert, stablelm, starcoder2, superpoint, swiftformer, swin, swin2sr, swinv2, switch_transformers, t5, table-transformer, tapas, time_series_transformer, timesformer, timm_backbone, trajectory_transformer, transfo-xl, trocr, tvlt, tvp, udop, umt5, unispeech, unispeech-sat, univnet, upernet, van, video_llava, videomae, vilt, vipllava, vision-encoder-decoder, vision-text-dual-encoder, visual_bert, vit, vit_hybrid, vit_mae, vit_msn, vitdet, vitmatte, vits, vivit, wav2vec2, wav2vec2-bert, wav2vec2-conformer, wavlm, whisper, xclip, xglm, xlm, xlm-prophetnet, xlm-roberta, xlm-roberta-xl, xlnet, xmod, yolos, yoso, zoedepth

[sruckh]

Yep. Manually downloading the model data from Huggingface and putting it in the Shitao/OmniGen-v1 subdirectory did the trick.