[REQUEST] Implementing Depthmap Anything V2 model?

[eyeEmotion]

Hi,

is there any intention of implementing the new Depth Anything v2 model? (Base and Large).

I'm currently using it via cmd-prompt, and it has a lot more detail, and is a little bit faster at generating depthmaps too. Although in certain areas, it does take a step backwards though in comparison to v1. But still a vast improvement overal.

Cheers.

PS: sorry, I don't know how to put labels on there requests.

[petermg]

Hi,

is there any intention of implementing the new Depth Anything v2 model? (Base and Large).

I'm currently using it via cmd-prompt, and it has a lot more detail, and is a little bit faster at generating depthmaps too. Although in certain areas, it does take a step backwards though in comparison to v1. But still a vast improvement overal.

Cheers.

PS: sorry, I don't know how to put labels on there requests.

I'm also hoping for this!

[semjon00]

I am hoping somwbody could impöement it. I am busy currently.

[graemeniedermayer]

If @petermg @eyeEmotion @semjon00 wanted to test it out #458 in pull request. Might need some finessing but it seems to be working.

[petermg]

If @petermg @eyeEmotion @semjon00 wanted to test it out #458 in pull request. Might need some finessing but it seems to be working.

Awesome! How do I install it instead of the main branch?

[petermg]

Thought I got it installed, it shows up as an option but it gives the error:

ModuleNotFoundError: No module named 'depth_anything_v2'

[petermg]

Here's the full error:

Please report this issue here. Make sure to provide the full stacktrace:
Traceback (most recent call last):
File "F:\SD\stable-diffusion-webui\extensions\stable-diffusion-webui-normalmap-script\src\common_ui.py", line 548, in run_generate
input_i, type, result = next(gen_obj)
File "F:\SD\stable-diffusion-webui\extensions\stable-diffusion-webui-normalmap-script\src\core.py", line 329, in core_generation_funnel
raise e
File "F:\SD\stable-diffusion-webui\extensions\stable-diffusion-webui-normalmap-script\src\core.py", line 130, in core_generation_funnel
model_holder.ensure_models(inp[go.MODEL_TYPE], device, inp[go.BOOST], inp[go.TILING_MODE])
File "F:\SD\stable-diffusion-webui\extensions\stable-diffusion-webui-normalmap-script\src\depthmap_generation.py", line 68, in ensure_models
self.load_models(model_type, device, boost, tiling_mode)
File "F:\SD\stable-diffusion-webui\extensions\stable-diffusion-webui-normalmap-script\src\depthmap_generation.py", line 233, in load_models
from depth_anything_v2.depth_anything_v2.dpt import DepthAnythingV2
ModuleNotFoundError: No module named 'depth_anything_v2'

[graemeniedermayer]

You might need to do a extra git pull.

If not check that in the extension file stable-diffusion-webui-depthmap-script folder there is a depth_anything_v2 folder that isn't empty.

I might have also made a pathing error somewhere.

[petermg]

You might need to do a extra git pull.

If not check that in the extension file stable-diffusion-webui-depthmap-script folder there is a depth_anything_v2 folder that isn't empty.

I might have also made a pathing error somewhere.

Still getting the error. Here is what that folder contains on my system:

also here is the error:

[petermg]

and when I did a git pull

[graemeniedermayer]

Thank you for all the information! That is how the folder should look, so I'm a little confused. I made some small edits, but I'm not confident they'll fix it. I'll have to think about it more.

If you have any other extensions that use depth_anything_v2 you could try changing the line to from depth_anything_v2.dpt import DepthAnythingV2 and seeing if there's any change. You could also try temporarily turning off all the other extensions.

My import structure is very similar to the marigold import. Does marigold work for you?

[petermg]

Thank you for all the information! That is how the folder should look, so I'm a little confused. I made some small edits, but I'm not confident they'll fix it. I'll have to think about it more.

If you have any other extensions that use depth_anything_v2 you could try changing the line to from depth_anything_v2.dpt import DepthAnythingV2 and seeing if there's any change. You could also try temporarily turning off all the other extensions.

My import structure is very similar to the marigold import. Does marigold work for you?

Yes Marigold works no problem. Maybe I installed it wrong? I went to EXTENSIONS tab, UNCHECKED the official depth map extension and installed this one via INSTALL FROM URL and used this as the url:
https://github.com/graemeniedermayer/stable-diffusion-webui-normalmap-script
and for branch put depthanything_v2
It says it's installed. But maybe I did something wrong? Here is my extension tab.

[petermg]

Ok so here is something weird, BEFORE I update to the update you just did, I have the DEPTH Tab as seen here:

But after updating to your update just now, it's totally gone!

[petermg]

ok I deleted the extensions inside the folder and installed just your version and the depth tab is back but still the same exact error. I'll see if I can figure out how to do what you mentioned about changing the line to from depth_anything_v2.dpt import DepthAnythingV2 and seeing if there's any change.