http-parser For Linux

n/a

Last updated: Aug 6, 2012 MIT/X Consortium License

SOFTPEDIA® DOWNLOAD NOW 555 downloads so far

HTTP request/response parser. #HTTP request parser #HTTP response parser #HTTP #Request #Response #Parser

Description

Free Download

http-parser is a HTTP request/response parser for Python in C under MIT License, based on http-parser from Ryan Dahl.

pip install http-parser

Or install from source:

git clone git://github.com/benoitc/http-parser.git cd http-parser && python setup.py install

http-parser provide you parser.HttpParser low-level parser in C that you can access in your python program and http.HttpStream providing higher-level access to a readable,sequential io.RawIOBase object.

To help you in your day work, http-parser prvides you 3 kind of readers in the reader module: IterReader to read iterables, StringReader to reads strings and StringIO objects, SocketReader to read sockets or objects with the same aî (recv_into needed). You cnan of course use any io.RawIOBase object.

Likre http-parser in C you can pass your own callbacks to the C parser, so you can eventually parse asynchronously any HTTP stream. Callbacks are:

on_message_begin() on_path(path) on_query_string(query_string) on_url(url) on_fragment(fragment) on_header_field(field, last_was_value) on_header_value(key, value) on_headers_complete() on_body(chunk) on_message_complete()

Example of HttpStream ex:

#!/usr/bin/env python import socket

from http_parser.http import HttpStream from http_parser.reader import SocketReader

def main(): s = socket.socket(socket.AF_INET, socket.SOCK_STREAM) try: s.connect(('gunicorn.org', 80)) s.send("GET / HTTP/1.1\r\nHost: gunicorn.org\r\n\r\n") r = SocketReader(s) p = HttpStream(r) print p.headers() print p.body_file().read() finally: s.close()

if __name__ == "__main__": main()

Example of HttpParser:

#!/usr/bin/env python import socket

from http_parser.parser import HttpParser

def main():

p = HttpParser() s = socket.socket(socket.AF_INET, socket.SOCK_STREAM) body = [] try: s.connect(('gunicorn.org', 80)) s.send("GET / HTTP/1.1\r\nHost: gunicorn.org\r\n\r\n")

while True: data = s.recv(1024) if not data: break

recved = len(data) nparsed = p.execute(data, recved) assert nparsed == recved

if p.is_headers_complete(): print p.get_headers()

if p.is_partial_body(): body.append(p.recv_body())

if p.is_message_complete(): break

print "".join(body)

finally: s.close()

if __name__ == "__main__": main()

You can find more docs in the code (or use a doc genererator).