webcow Filter

Cleanup Filter (Details)

Cleanup Filter

The Cleanup filter provides an easy way to perform several cleaning or seperate actions on the list. You can easlily strip duplicate links out of it for example, remove dir-sorting links of an apache directory listing, or remove any link that might contain text content so you'll get binary files only.

!	The Cleanup filter makes most sense when placed at the end after any other filer. Keep this in mind if you use Remove Double Entries especially.

Just enable the cleaning options you want by checking one or more entry/ies:

Cleaning options

• # Cut off
• .DotEnding Remove
• No Apache Stuff
• Binarize
• Remove Double Entries

# Cut off

Will remove any page-relative link-parts. This prevents duplicate downloading of the same file, because the url-part started with # at the end points to a propably same file - only to a different position in it.

. DotEnding Remove

This will remove any 'dot' links. This removes such links which will point to a location which is already listed. E.g. files/. will point to files/ afterwards.

No Apache Stuff

Remove any non-interesting selfreferences of an apache directory listing.

Binarize

This filter removes any link which seems to be a text or text-like file. Keep in mind that this filter is based on file-ending not mime-type. It will remove anykind of cgi or alike (php, asp, cfml etc.) as well assuming, they'll return a standard html page only even if they can provide a binary download, too.

Remove Double Entries

Simply remove any duplicate link.