Issues

• Error raised when there's a valid <base> tag in <head>

  stewartmckee/cobweb#61 · Filter by author svenaas opened on Nov 5, 2020
  3

• Feature request: Stop crawl at time

  stewartmckee/cobweb#54 · Filter by author samnissen opened on Apr 19, 2017
  3

• Falling into Crawl Traps

  stewartmckee/cobweb#53 · Filter by author fuzzygroup opened on Apr 8, 2017
  10

• undefined method `banner' for main:Object (NoMethodError) on calling from command line

  stewartmckee/cobweb#52 · Filter by author gushonorato opened on Jul 21, 2016
  1

• Should depend on slop 3.6.0 or update cobweb bin

  stewartmckee/cobweb#47 · Filter by author mhmaguire opened on Jan 7, 2016
  1

• How can I start stop crawling website

  stewartmckee/cobweb#46 · Filter by author qiun opened on Jan 4, 2016
  1

• Redirect Limit causing crawl to stop

  stewartmckee/cobweb#36 · Filter by author stewartmckee opened on Jan 23, 2015

• Code organization

  stewartmckee/cobweb#34 · Filter by author andrejj opened on Nov 18, 2014
  1

• Should it be possible to add "depth" in the data hash ?

  stewartmckee/cobweb#28 · Filter by author ABrisset opened on May 13, 2014
  3

• Should be possible to use Ruby's URI implementation instead of Addressable::URI

  stewartmckee/cobweb#27 · Filter by author gh2k opened on May 13, 2014
  3

• Improve connection handling

  stewartmckee/cobweb#24 · Filter by author stewartmckee opened on Nov 22, 2013

• external_urls not treated as external

  stewartmckee/cobweb#16 · Filter by author stewartmckee opened on Feb 18, 2013