Wzfusker For Linux

Wzfusker is is a small clone of fusker, which was a program that could be used to download parts of Web sites. The project provides several tools to make selective mirroring easier, including selecting only URLs or images from the page and regex-based matching of links.

Here are some key features of "Wzfusker":

� Uses multiple concurrent connections for faster retrieval � Supports multiple levels of undo � Supports basic fusker-like commands � Written in Python

The basic idea behind a fusker is: it maintains a list of URLs. At any time you can choose to download the list of URLs using the get command. Instead of getting the URLs, you can ask the fusker to transform the list into a new list. It can do this by examining each URL in the list, filtering out all the links in the URL, and making a new URL list consisting entirely of pages linked to by URLs in the original list. In a similar fashion, it can transform the list of URLs into a list of all images linked to in the original list. You can also run regular expressions over the list, discarding (or keeping) URLs that match the regex.

A basic tutorial follows.

Start the program:

python fusker.py

Then enter one or more URLs to examine:

wzfusker: url YOUR_URL_HERE

You can then choose to get the URL as-is, or filter out any links or images in the URL. Let’s say the URL is an image gallery containing links to full-size images. Use the “hrefs” option to strip out the links:

wzfusker: hrefs

This gives you a list of links, which you may wish to view:

wzfusker: ls

The list probably contains some bogus links. Perhaps you only want to keep URLs containing the word “fullsize”:

wzfusker: keep fullsize

Now you can download the list:

wzfusker: get

Requirements:

� Python

What's New in This Release:

� This release adds support for framesets and includes several fixes that together make it pick up links more reliably, such as base href detection, better support for non-compliant hrefs, and unescaping of HTML entities in URLs.