Softpedia
 


LINUX CATEGORIES:



GLOBAL PAGES >>
NEWS ARCHIVE >>
SOFTPEDIA REVIEWS >>
MEET THE EDITORS >>
WEEK'S BEST
  • Linux Kernel 3.9.6 / 3....
  • Linux Kernel 3.0.82 LTS...
  • KDE Software Compilatio...
  • PulseAudio 4.0
  • Wireshark 1.10.0
  • NetworkManager 0.9.8.2
  • LibreOffice 3.6.6 / 4.0...
  • SystemRescueCd 3.7.0
  • Linux Kernel 3.10 RC6
  • Ubuntu Tweak 0.8.5
  • 7-DAY TOP DOWNLOAD
    #
    Program
    Psiphon 3
    1,656 downloads
    LibreOffice 3.6.6 /
    4.0.3 / 4.0.4 RC2 /
    4.1.0 Beta 2

    1,354 downloads
    Wine 1.4.1 / 1.6 RC2
    1,253 downloads
    BackTrack 5 R3
    1,214 downloads
    Adobe Flash Player
    for Linux
    11.2.202.258

    1,018 downloads
    Red Hat Linux 9
    994 downloads
    VLC 2.0.7
    898 downloads
    Ubuntu 10.04.4 LTS
    786 downloads
    Debian GNU/Linux 7.1
    688 downloads
    Red Hat Enterprise
    Linux 6.4

    686 downloads
    MOST POPULAR DISTROS
    #
    Distribution
    PCLinuxOS 2013.04
    User rating: 4.8/5
    Votes: 370
    OpenMandriva 2013.0
    Alpha

    User rating: 4.4/5
    Votes: 625
    Ubuntu 9.10
    User rating: 4.4/5
    Votes: 267
    Clonezilla LiveCD
    2.1.1-25 / 2.1.2-12

    User rating: 4.3/5
    Votes: 260
    BackTrack 5 R3
    User rating: 4.3/5
    Votes: 569
    Fedora 18
    User rating: 4.3/5
    Votes: 613
    openSUSE Linux 12.3
    / 13.1 Milestone 2

    User rating: 4.2/5
    Votes: 471
    Ubuntu 12.04.2 LTS
    User rating: 4.2/5
    Votes: 696
    Ubuntu 10.04.4 LTS
    User rating: 4.0/5
    Votes: 286
    Linux Mint 15
    User rating: 4.0/5
    Votes: 371
    Home > Linux > Tags > web crawler

    Downloads tagged with: web crawler


    FoxySpider 1.5.3

    update
    FoxySpider icon A web crawler add-on for Mozilla Firefox
    [read more >]

    License:
    Rating:
    Downloads:
    Category:
    Updated:

    Other/Proprietary Li...
    NOT RATED
    1,079
    Firefox Extensions
    April 24th, 21:14 GMT

    YACY 1.2

    update
    YACY icon YACY is a distributed Web crawler and also a caching HTTP/HTTPS proxy.
    [read more >]

    License:
    Rating:
    Downloads:
    Category:
    Updated:

    GPL
    Good (3.3/5)
    1,169
    HTTP (WWW)
    November 9th, 2012 GMT

    python-spy 0.2.1

    NEW
    python-spy icon Python Spider framework
    [read more >]

    License:
    Rating:
    Downloads:
    Category:
    Updated:

    BSD License
    NOT RATED
    71
    Libraries
    September 20th, 2012 GMT

    Apache Nutch 2.0

    update
    Apache Nutch icon Web searching software which builds on Lucene Java
    [read more >]

    License:
    Rating:
    Downloads:
    Category:
    Updated:

    GPL
    NOT RATED
    2,706
    HTTP (WWW)
    July 10th, 2012 GMT

    warc 0.2.1

    update
    warc icon Python library to work with WARC files
    [read more >]

    License:
    Rating:
    Downloads:
    Category:
    Updated:

    BSD License
    NOT RATED
    238
    Libraries
    May 16th, 2012 GMT

    larjona-crawler 1.0

    update
    larjona-crawler icon LArjona web crawler
    [read more >]

    License:
    Rating:
    Downloads:
    Category:
    Updated:

    GPL v3
    NOT RATED
    136
    HTTP (WWW)
    December 25th, 2011 GMT

    SpiderBOY 1.0

    NEW
    SpiderBOY icon A typical crawler, returns a list of URLs
    [read more >]

    License:
    Rating:
    Downloads:
    Category:
    Updated:

    GPL v3
    NOT RATED
    159
    HTTP (WWW)
    December 23rd, 2011 GMT

    Cesar Valiente WebCrawler 1.0

    NEW
    Cesar Valiente WebCrawler icon WebCrawler for the Development & Tools subject of the M.Sc. on Free Software
    [read more >]

    License:
    Rating:
    Downloads:
    Category:
    Updated:

    GPL v3
    NOT RATED
    140
    HTTP (WWW)
    December 10th, 2011 GMT

    PureTest 4.3

    update
    PureTest icon An application which is primarily used to setup scenarios of tasks, execute and debug them
    [read more >]

    License:
    Rating:
    Downloads:
    Category:
    Updated:

    Free To Use But Rest...
    Good (3.1/5)
    741
    Debuggers
    August 16th, 2011 GMT

    Grub Next Generation C# client 1.0.1

    update
    Grub Next Generation C# client icon C# implementation of new grub client.
    [read more >]

    License:
    Rating:
    Downloads:
    Category:
    Updated:

    GPL
    NOT RATED
    966
    HTTP (WWW)
    June 8th, 2011 GMT

    Grub Next Generation upload server 1.0

    update
    Grub Next Generation upload server icon The standalone, configurable upload server for grub
    [read more >]

    License:
    Rating:
    Downloads:
    Category:
    Updated:

    GPL
    NOT RATED
    953
    Log Analyzers
    May 10th, 2011 GMT

    noncrawl 0.1

    NEW
    noncrawl icon A web crawler creating link soups
    [read more >]

    License:
    Rating:
    Downloads:
    Category:
    Updated:

    GPL
    NOT RATED
    186
    HTTP (WWW)
    July 29th, 2010 GMT

    AWSpider 0.3.2.12

    update
    AWSpider icon Amazon Web Services web crawler
    [read more >]

    License:
    Rating:
    Downloads:
    Category:
    Updated:

    MIT/X Consortium Lic...
    Very Good (4.0/5)
    1,427
    HTTP (WWW)
    July 25th, 2010 GMT

    ItSucks 0.4.1

    update
    ItSucks icon ItSucks software is a java web spider (web crawler) with the ability to download (and resume) files.
    [read more >]

    License:
    Rating:
    Downloads:
    Category:
    Updated:

    GPL
    Good (3.2/5)
    649
    HTTP (WWW)
    May 31st, 2010 GMT

    Domo 0.52

    NEW
    Domo icon A web crawler & archiver
    [read more >]

    License:
    Rating:
    Downloads:
    Category:
    Updated:

    GPL
    NOT RATED
    236
    HTTP (WWW)
    February 9th, 2010 GMT

    Webstemmer 0.7.1

    NEW
    Webstemmer icon Web crawler and HTML layout analyzer
    [read more >]

    License:
    Rating:
    Downloads:
    Category:
    Updated:

    MIT/X Consortium Lic...
    NOT RATED
    427
    HTTP (WWW)
    June 16th, 2009 GMT

    Grub Next Generation Python client 0.4

    NEW
    Grub Next Generation Python client icon Python implementation of new grub client.
    [read more >]

    License:
    Rating:
    Downloads:
    Category:
    Updated:

    GPL
    NOT RATED
    450
    HTTP (WWW)
    March 1st, 2009 GMT

    Methabot 1.6.0.1

    update
    Methabot icon File system crawler
    [read more >]

    License:
    Rating:
    Downloads:
    Category:
    Updated:

    ISC License
    Excellent (5.0/5)
    837
    FTP
    February 23rd, 2009 GMT

    YiJing::0x11 0.02

    NEW
    YiJing::0x11 icon YiJing::0x11 is a web crawler in Perl.
    [read more >]

    License:
    Rating:
    Downloads:
    Category:
    Updated:

    Perl Artistic License
    Fair (2.6/5)
    721
    Perl Modules
    June 4th, 2008 GMT

    InfoCrawler 1.1

    update
    InfoCrawler icon InfoCrawler is an open source knowledge management solution.
    [read more >]

    License:
    Rating:
    Downloads:
    Category:
    Updated:

    GPL v3
    Good (3.0/5)
    547
    HTTP (WWW)
    April 23rd, 2008 GMT

    PyGalleryCrawler 0.1.1

    update
    PyGalleryCrawler icon PyGalleryCrawler project is a Web crawler for online image galleries.
    [read more >]

    License:
    Rating:
    Downloads:
    Category:
    Updated:

    GPL
    NOT RATED
    578
    Graphics
    April 18th, 2007 GMT

    Webtools 4 larbin 1.0

    NEW
    Webtools 4 larbin icon Webtools 4 larbin provides a set scripts to handle the output of Larbin.
    [read more >]

    License:
    Rating:
    Downloads:
    Category:
    Updated:

    GPL
    NOT RATED
    519
    Information Management
    February 2nd, 2007 GMT

    HarvestMan 1.4.6

    update
    HarvestMan icon HarvestMan is a full-featured, multi-threaded Web crawler and offline browser.
    [read more >]

    License:
    Rating:
    Downloads:
    Category:
    Updated:

    GPL
    Good (3.2/5)
    1,081
    HTTP (WWW)
    September 9th, 2005 GMT


    WindowsGamesDriversMacLinuxScriptsMobileHandheldNews

    SUBMIT PROGRAM   |   ADVERTISE   |   GET HELP   |   SEND US FEEDBACK   |   RSS FEEDS   |   UPDATE YOUR SOFTWARE   |   ROMANIAN FORUM