In search of a download manager - with a twist

[Homeless Vagrant]

I'm looking for some sort of download manager-esque program that has a specific feature. Now, this program may not exist, because I've looked all over Hell's half-acre and have come away with nothing.

There's a site I visit that uses the imageboard engine LynxChan with a custom frontend. In each thread, there are images and other file attachments, just as you'd expect. Let's say that, on Monday, a thread has 15 attachments. I can use, for instance, DownThemAll to snag those without issue. On Tuesday, there are 25 more attachments. If I use DTA (or any other download manager, it would seem), it will download ALL of the files, not just the new ones, and will simply rename those with filename collisions. This is obviously not optimal for a multitude of reasons.

Are there any download managers that will grab only the new files on subsequent runs, like some sort of update? Or, if nothing else, not download files with the same name as one already in the download folder?

Thanks for any assistance, and my apologies if this is in the wrong forum or isn't clear enough.

[binaryzero]

Write a PowerShell script to remove the duplicates.

[Homeless Vagrant]

On 02/06/2023 at 20:19, binaryzero said:

Write a PowerShell script to remove the duplicates.

The entire point is to not download the duplicate files in the first place. That's bandwidth wasted, excess wear and tear of the HDD, and time better spent doing, like, anything else. 

And I have exactly zero coding ability. Not for lack of trying; it's just not my strong suit.

[goretsky Supervisor]

Hello,

If the forum in question has an option to hide previously-viewed posts, perhaps turn that option on so that when your download manager crawls the site, it does not access the previous posts and their associated images.

Regards,

Aryeh Goretsky
 

[Homeless Vagrant]

On 03/06/2023 at 05:06, goretsky said:

If the forum in question has an option to hide previously-viewed posts, perhaps turn that option on so that when your download manager crawls the site, it does not access the previous posts and their associated images.

Unfortunately, the only options available are to hide the thread itself or simply collapse posts within the thread, which doesn't really help. The whole site is a javascript nightmare, so this comes as no surprise.

[binaryzero]

On 03/06/2023 at 13:03, Homeless Vagrant said:

The entire point is to not download the duplicate files in the first place. That's bandwidth wasted, excess wear and tear of the HDD, and time better spent doing, like, anything else. 

And I have exactly zero coding ability. Not for lack of trying; it's just not my strong suit.

Lolll excess wear and tear, jfc...

You're not going to find what you're after, think outside the box.

[xrobwx71]

?

[Homeless Vagrant]

On 03/06/2023 at 23:11, binaryzero said:

Lolll excess wear and tear, jfc...

You're not going to find what you're after, think outside the box.

Dude, I'm talking about drives that are 6+ years old that I have used and abused. Pardon the hell out of me for being concerned about unnecessary overuse, okay? If you're only going to condescend to me, just don't.

 

On 04/06/2023 at 11:51, xrobwx71 said:

?

This... This might have promise. Thank you!