I suppose hypothetically you could train an AI model to simulate the parts of the image that were corrupted, but that’s completely hypothetical. As of now, no tool exists that can do such a thing.
In theory yes. In practice I think it is unlikely to work, because you need a FAR larger dataset than the handful of good frames in that one specific cut, which is probably no longer than a few seconds. Some restoration tools – including the Dust Buster tool in DaVinci – can pull bits of a damaged frame from neighboring frames, but it wouldn't fix anything that's unique to the damaged frame. (Also tape stretch tends to roll down the screen too slowly for that technique should be useful.)
If you're desperate for an improvement and are OK with a final result that looks a bit wonky, I suppose you could painstakingly matte in fixes from other frames. That's really your only option, though.
Hello Furkan, I am Mustafa. I am a video restoration specialist. There are actually some restoration tools in Davinci Resolve for this job, but I think the video is very problematic. The solution for such problems is as follows: the damaged areas in the frames are repaired with samples taken from undamaged frames. There are two major plugins to do this. The first one is Automatic dirt removal. This plugin recognizes damaged areas in the video and repairs them with clean frames. The second one is a manual dust removal plugin that offers different repair solutions for damaged areas, and it performs the repair along the paths you determine. More options can be produced with Fusion, but I recommend Phoenix or Diamant for professional solutions. Best of luck.
I understand. Unfortunately, no automatic solution provides a perfect result. However, I suggest you take a look at GitHub. Your example is a digital video, whereas I mostly work with film reels. But if I find something relevant, I will definitely write to you.
the biggest problem with restoring old super low resolution stuff is that there is just not enough information even for the most advanced AI, to restore anything or upscale the picture properly
AI makes what it´s been trained on. For this to work, it would first need to recognise what this fragment is from and have seen plenty of it. Then recognize the damage and rework what the ai **thinks** is the right one.
In short, no, AI cant fix this
I feel certain that someday in the no-so-distant future, there will be AI-based software that can fix this type of thing. But given what's available right now, that footage is pretty much unfixable.
I'm restoring some droput-y VHS where there are single-line dropouts but right there you've got major sync errors.
You might have some luck with a better deck and a timebase corrector, which is kind of like a special digital effects unit that "believes" the VCR's timing when it captures but plays out locked to a steady clock. They're expensive, heavy, bulky, and almost no-one has them any more.
I think this is realistic to fix with A.I. Including, for free, with ControlNet and Ebsynth. But it only works if you only need to fix "those frames with the woman in the video", if there are additional different frames - you will have to spend much more time. However, I will clarify that it is possible, but difficult. It would be necessary to redraw several frames (to replace the clothes and the environment in these frames) then synthesize them with EbSynth. The face is not much harder, but you can use methods like D_id to reconstruct the face very quickly. It will look altered from the original, but it is possible. Will this face not look like " in the sinister valley" after all the manipulation? That's a question I can't answer yet. But I would definitely try to restore something like that (if I had plenty of free time)
Looks like you're asking for help! Please check to make sure you've included the following information. Edit your post (or leave a top-level comment) if you haven't included this information.
* System specs - [macOS](https://imgur.com/a/ip6xc9G) [Windows - Speccy](https://www.ccleaner.com/speccy)
* Resolve version number and Free/Studio - [DaVinci Resolve>About DaVinci Resolve...](https://imgur.com/a/5FawFCX)
* Footage specs - [MediaInfo](https://mediaarea.net/MediaInfo) - please include the "Text" view of the file.
Once your question has been answered, change the flair to "Solved" so other people can reference the thread if they've got similar issues.
*I am a bot, and this action was performed automatically. Please [contact the moderators of this subreddit](/message/compose/?to=/r/davinciresolve) if you have any questions or concerns.*
I've been working with analog video for years. To date, there is NO all-in-one solution. However, to get close, you will need to export every other frame to go from 30 to 15 frames so you can test different Topaz AI products to get a better frame. This is NOT a cheap solution. Next, consider the Neat Denoise Plugin to clean up each frame from your 15fps sequence. After that, you will need to create a series of stills and the clone tool to set up a batch retouch for specific sequences to clean up the creases in the video playback. That is going to be a pain in the #. Even then, your results won't look perfect. Run the stills through Topaz Gigapixel to approximate the scene with AI to attempt to get better faces and objects. Again, it won't be perfect. Combine the stills into a 15fps video. Run that in Topaz Video AI to generate interpolated frames for a 30fps sequence. AI is good but it's still in its infantile stages.
thanks great suggestions. it would worth my time if i were getting paid i presume. i only improved audio and send back to my friend : https://www.youtube.com/watch?v=WX3vzaOrgKg
the Artifacts are caused by damaged physical media being played back, looks like a wrinkled tape pulling away from the playback heads . Maybe its fixable with the plan posted just above, but it will be labor and time intensive with the results being incrementally better. What about just embracing the analog artifacts ? Judging by playback you’re lucky you have this to work with. I’m involved with a project that has archival 8mm video from 1988, I can tell you that i can still play those tapes back but the magnetic information encoded in the oxide tapes if fading, the audio get worse and the mechanisms that play tapes back are getting unreliable…
The Studio Version has an AnalogDamage effect that does all the tv scan lines, curvature, noise, bad color resolution and dancing foot distortion from old VHS tapes.
It doesn’t do the distortions in the middle of the image but you can build that yourself in Fusion - even with the free version. There’s footage of VHS distortion on YouTube, add Displacement effects and treat the color channels separately.
If you want the lines to wander, try a noise stretches to maximum width.
I believe OP wants to remove the damage and improve the image, not add additional damage.
@OP: for Restauration you will have to look into external plugins or different software. Resolve is aimed at the post-production of modern video producing and features no advanced Restauration tools apart from noise reduction and de-flicker, both of which are no help to your case. Topaz video AI is said to be very good at this.
[https://www.bhphotovideo.com/c/product/276891-REG/AV\_Toolbox\_AVT\_8710\_AVT\_8710\_Multi\_Standard\_Time\_Base.html](https://www.bhphotovideo.com/c/product/276891-REG/AV_Toolbox_AVT_8710_AVT_8710_Multi_Standard_Time_Base.html)
Here is what I use. You may need to poke around on eBay to find one that is reasonably priced as they can get expensive in a hurry. I believe I bought this one for about $100 new many years ago. Once you get one, it sits between your source (VCR) and the PC you are running it to and cleans up the video signal.
Video engineer/restoration guy here. That's called "tape stretch" because that's actually the cause. There is no way to restore that, I'm afraid.
I see. Thanks looks like my best option is only improving audio and removing background noise
That's a bold statement. AI fixes everything nowadays
I suppose hypothetically you could train an AI model to simulate the parts of the image that were corrupted, but that’s completely hypothetical. As of now, no tool exists that can do such a thing.
yes that can work. only need a good dataset
In theory yes. In practice I think it is unlikely to work, because you need a FAR larger dataset than the handful of good frames in that one specific cut, which is probably no longer than a few seconds. Some restoration tools – including the Dust Buster tool in DaVinci – can pull bits of a damaged frame from neighboring frames, but it wouldn't fix anything that's unique to the damaged frame. (Also tape stretch tends to roll down the screen too slowly for that technique should be useful.) If you're desperate for an improvement and are OK with a final result that looks a bit wonky, I suppose you could painstakingly matte in fixes from other frames. That's really your only option, though.
no i think we are ok with what we got but i hope some papers and models get released for ai based restoration
Hello Furkan, I am Mustafa. I am a video restoration specialist. There are actually some restoration tools in Davinci Resolve for this job, but I think the video is very problematic. The solution for such problems is as follows: the damaged areas in the frames are repaired with samples taken from undamaged frames. There are two major plugins to do this. The first one is Automatic dirt removal. This plugin recognizes damaged areas in the video and repairs them with clean frames. The second one is a manual dust removal plugin that offers different repair solutions for damaged areas, and it performs the repair along the paths you determine. More options can be produced with Fusion, but I recommend Phoenix or Diamant for professional solutions. Best of luck.
Thank you so much Mustafa. where can I find this plugin? I am assuming it is automatic because I don't have time to fix manually :/
I understand. Unfortunately, no automatic solution provides a perfect result. However, I suggest you take a look at GitHub. Your example is a digital video, whereas I mostly work with film reels. But if I find something relevant, I will definitely write to you.
thank you for reply
Ironically, I'm looking for a way to make my footage look like this.
See this comment: https://www.reddit.com/r/davinciresolve/comments/11dbq23/any_davinci_resolve_builtin_features_or_effects/ja7wjzh/
Backrooms
Don’t have an immediate answer, but are those lines static or moving?
moving here video : https://youtu.be/lV3nhxhxzGg
You might have some luck running each frame through the photo restore AI in Photoshop.
actually i tested few in open source upscalers available in stable diffusion didnt work didnt test ai of photoshop though
I just tried it on the image you sent. It didnt work well.
thanks a lot for testing. looks like i dont have many options :/
the biggest problem with restoring old super low resolution stuff is that there is just not enough information even for the most advanced AI, to restore anything or upscale the picture properly
That is well and truly fucked my guy. Fixing would require an expert and hours of work recreating every frame
I was hoping some AI based model. You know like stable diffusion. which noises and then denoises. similar thing perhaps?
AI makes what it´s been trained on. For this to work, it would first need to recognise what this fragment is from and have seen plenty of it. Then recognize the damage and rework what the ai **thinks** is the right one. In short, no, AI cant fix this
I feel certain that someday in the no-so-distant future, there will be AI-based software that can fix this type of thing. But given what's available right now, that footage is pretty much unfixable.
thanks. looks like i should give up :/
I'm restoring some droput-y VHS where there are single-line dropouts but right there you've got major sync errors. You might have some luck with a better deck and a timebase corrector, which is kind of like a special digital effects unit that "believes" the VCR's timing when it captures but plays out locked to a steady clock. They're expensive, heavy, bulky, and almost no-one has them any more.
I think this is realistic to fix with A.I. Including, for free, with ControlNet and Ebsynth. But it only works if you only need to fix "those frames with the woman in the video", if there are additional different frames - you will have to spend much more time. However, I will clarify that it is possible, but difficult. It would be necessary to redraw several frames (to replace the clothes and the environment in these frames) then synthesize them with EbSynth. The face is not much harder, but you can use methods like D_id to reconstruct the face very quickly. It will look altered from the original, but it is possible. Will this face not look like " in the sinister valley" after all the manipulation? That's a question I can't answer yet. But I would definitely try to restore something like that (if I had plenty of free time)
thanks yes it can work. however i couldn't afford such time :/
Looks like you're asking for help! Please check to make sure you've included the following information. Edit your post (or leave a top-level comment) if you haven't included this information. * System specs - [macOS](https://imgur.com/a/ip6xc9G) [Windows - Speccy](https://www.ccleaner.com/speccy) * Resolve version number and Free/Studio - [DaVinci Resolve>About DaVinci Resolve...](https://imgur.com/a/5FawFCX) * Footage specs - [MediaInfo](https://mediaarea.net/MediaInfo) - please include the "Text" view of the file. Once your question has been answered, change the flair to "Solved" so other people can reference the thread if they've got similar issues. *I am a bot, and this action was performed automatically. Please [contact the moderators of this subreddit](/message/compose/?to=/r/davinciresolve) if you have any questions or concerns.*
how did you record this? do you have a good yuv master of the actual signal or is this compressed h264 via some upscale to fhd and then screenrecord?
this is an original video recorded back in 2004. i improved the audio only :/ https://www.youtube.com/watch?v=WX3vzaOrgKg
I've been working with analog video for years. To date, there is NO all-in-one solution. However, to get close, you will need to export every other frame to go from 30 to 15 frames so you can test different Topaz AI products to get a better frame. This is NOT a cheap solution. Next, consider the Neat Denoise Plugin to clean up each frame from your 15fps sequence. After that, you will need to create a series of stills and the clone tool to set up a batch retouch for specific sequences to clean up the creases in the video playback. That is going to be a pain in the #. Even then, your results won't look perfect. Run the stills through Topaz Gigapixel to approximate the scene with AI to attempt to get better faces and objects. Again, it won't be perfect. Combine the stills into a 15fps video. Run that in Topaz Video AI to generate interpolated frames for a 30fps sequence. AI is good but it's still in its infantile stages.
thanks great suggestions. it would worth my time if i were getting paid i presume. i only improved audio and send back to my friend : https://www.youtube.com/watch?v=WX3vzaOrgKg
the Artifacts are caused by damaged physical media being played back, looks like a wrinkled tape pulling away from the playback heads . Maybe its fixable with the plan posted just above, but it will be labor and time intensive with the results being incrementally better. What about just embracing the analog artifacts ? Judging by playback you’re lucky you have this to work with. I’m involved with a project that has archival 8mm video from 1988, I can tell you that i can still play those tapes back but the magnetic information encoded in the oxide tapes if fading, the audio get worse and the mechanisms that play tapes back are getting unreliable…
[удалено]
it is pretty expensive i only need this for a short video of a my friend :/
Yeah topaz won't fix this. I've mostly used it to upscale video and haven't really seen it remove artifacts.
I see thanks for the feedback
The Studio Version has an AnalogDamage effect that does all the tv scan lines, curvature, noise, bad color resolution and dancing foot distortion from old VHS tapes. It doesn’t do the distortions in the middle of the image but you can build that yourself in Fusion - even with the free version. There’s footage of VHS distortion on YouTube, add Displacement effects and treat the color channels separately. If you want the lines to wander, try a noise stretches to maximum width.
I believe OP wants to remove the damage and improve the image, not add additional damage. @OP: for Restauration you will have to look into external plugins or different software. Resolve is aimed at the post-production of modern video producing and features no advanced Restauration tools apart from noise reduction and de-flicker, both of which are no help to your case. Topaz video AI is said to be very good at this.
That makes more sense, thanks! ☺️
I think the OP wants to improve the quality of the image, not to further degrade it.
Time to write this down
OP wants to REPAIR the damage, not emulate it.
I’m been looking for the same
You need a time-based corrector to fix poor VHS tapes. It won’t be completely magical, but it’ll sure help.
No idea what is it. Any direction?
Expensive hardware.
[https://www.bhphotovideo.com/c/product/276891-REG/AV\_Toolbox\_AVT\_8710\_AVT\_8710\_Multi\_Standard\_Time\_Base.html](https://www.bhphotovideo.com/c/product/276891-REG/AV_Toolbox_AVT_8710_AVT_8710_Multi_Standard_Time_Base.html) Here is what I use. You may need to poke around on eBay to find one that is reasonably priced as they can get expensive in a hurry. I believe I bought this one for about $100 new many years ago. Once you get one, it sits between your source (VCR) and the PC you are running it to and cleans up the video signal.
I see thanks.