Re-using existing file lists before downloading

maxxyme · Post by **maxxyme** » 2004-02-25 11:59

I've not found an significant topic about this, so i made a new thread.

Well it's about (re)using file lists before downloading.

For example if i already have a recent file list from a guy that DC++ founds as an alternate source, i wish DC++ first use that "fresh" file list instead of downloading it once again.
Because when you download a file (or files) that has a large number of sources, and you already have almost all file lists of the sources, DC++ downloads them ALL once again, even if they're recent enough...

Of course if DC++ gets the errors "file doesnt exists" because i.e. the file list is too old and the file doesn't exist anymore in the correct directory (for example), it will download once again the list, to fresh it.
But only in this case.

I hope i've been enough comprehensible...

TheParanoidOne · Post by **TheParanoidOne** » 2004-02-25 12:09

How do you define "recent"?

Twink · Post by **Twink** » 2004-02-25 14:41

recent as in maybe todays date?, then it could compare the users share size with the filelist?

ivulfusbar · Post by **ivulfusbar** » 2004-02-25 15:00

I tested it.. and was not satisfied with how it worked.. or atleast not interested enough to continue to keep it in my own clone. I can always see if i can find it again somewhere in old code-snippets.

psf8500 · Post by **psf8500** » 2004-02-25 18:03

Guess you could start the process of downloading the filelist as normal then once you get $FileLength compare it with the existing filelist you got.

If it's the same size theres a good chance it's the same filelist, if not download it...

maxxyme · Post by **maxxyme** » 2004-02-26 07:15

TheParanoidOne wrote:How do you define "recent"?

Yes as Twink said, if the list has been downloaded within the same day (for example)

Post by **GargoyleMT** » 2004-02-28 12:56

maxxyme wrote:Yes as Twink said, if the list has been downloaded within the same day (for example)

Refreshes happen hourly... what if he just reorganized his/her share?

Twink wrote:then it could compare the users share size with the filelist?

This seems to make the most sense, but you only know their share size after reading the list - and having ADLSearches can throw that number off. So you'd have to cache it somewhere.

Twink · Post by **Twink** » 2004-02-28 17:24

well what about the suggestion to check the size of the actual file list, surely they aren't likely to be the same.

Post by **GargoyleMT** » 2004-02-28 20:30

Twink wrote:well what about the suggestion to check the size of the actual file list, surely they aren't likely to be the same.

Making a connection to that user seems wasteful if you can achieve the same by caching... I could be wrong, or overly influenced by the negative aspeccts of certain CDMs (BlackDC) that connect to get your PK, but immediately disconnect, which causes a large spike in threadcount when you're on a hub where most people use such a client.