Significant improvements and fixes; see http://code.google.com/p/crawler-commons/issues/list for discussions
