We are looking to obtain albedo from an image. One problem that concern us a lot is the cast shadow. We found that Cosmos1-diffusion-renderer can remove cast shadow from the image really well.
โพสนี้มีภาษาไทย | This post available in Thai
We will show image obtain from Unsplash.com. We also add the comparision with Coloful Diffuse which are previous stage-of-the-art work.
Cast shadow removal
We will show a bunch of image that have cast shadow on the image.
| Input Image | Colorful Diffuse | Cosmos1-Diffusion-Renderer |
|---|---|---|
|
|
|
| Notice how good the shadow under the hand as remove | ||
| Photo by Gracia Dharma on Unsplash | ||
| Input Image | Colorful Diffuse | Cosmos1-Diffusion-Renderer |
|---|---|---|
|
|
|
| The shadow on the floor was removed completely. | ||
| Photo by Spencer Everett on Unsplash | ||
| Input Image | Colorful Diffuse | Cosmos1-Diffusion-Renderer |
|---|---|---|
|
|
|
| Even this one nice to remove the cast shadow but it stuggle to remove len flare (near the bottom-left side of the car ) | ||
| Photo by Erik Mclean on Unsplash | ||
| Input Image | Colorful Diffuse | Cosmos1-Diffusion-Renderer |
|---|---|---|
|
|
|
| To be fair, Sometime Colorful Diffuse can remove cast shadow as well | ||
| Photo by Marcin Galusz on Unsplash | ||
Handle dark region well
| Input Image | Colorful Diffuse | Cosmos1-Diffusion-Renderer |
|---|---|---|
|
|
|
| Area outside the light almost invisible but it Diffusion Renderer can recover it back | ||
| Photo by Amit Gaur on Unsplash | ||
Sometimes color is unreliable
| Input Image | Colorful Diffuse | Cosmos1-Diffusion-Renderer |
|---|---|---|
|
|
|
| The wall should be white color, but it produce a black color. | ||
| Photo by John Thomas on Unsplash | ||
| Input Image | Colorful Diffuse | Cosmos1-Diffusion-Renderer |
|---|---|---|
|
|
|
| Train console become gray but i believe it should be blue. | ||
| Photo by Chean Ang Heng on Unsplash | ||
Small detail sometimes unreliable
| Input Image | Colorful Diffuse | Cosmos1-Diffusion-Renderer |
|---|---|---|
|
|
|
| woman eyes are gone | ||
| Photo by Charles Chen on Unsplash | ||
More images
We ran over 150+ in-the-wild image from unsplash. you can inspect it closely at this page or go to the github repo to obtain the image to on newer work publish in the future.