html_jumping allows to get an HTML, passing previously for several URL. This is sometimes needed because some webpages need cookies or a HTTP referrer to get a certain page.
For example:
>>> ## start the console
>>> from html_jumping import html_jumping
>>> self.handler = html_jumping()
>>> config = {
'route': [
['http://pypi.python.org/pypi', 'GET' ],
['http://pypi.python.org/pypi', 'GET', {
'term': 'html_jumping',
':action': 'search',
'submit': 'search'
}]
]
}
>>> received_header, received_content = self.handler.get(config)
Product's homepage
Requirements:
· Python
· lxml
· httplib2