Issues · bbcarchdev/anansi · GitHub

Labels Milestones

Handle 307 (Temporary Redirect) and 308 (Permanent Redirect) properly

#70

· nevali opened

on Apr 28, 2017

Clustering fails with divide by 0 error from the database

#69

· CygnusAlpha opened

on Feb 7, 2017

Anansi sometimes fails to follow 303 redirects

#68

· townxelliot opened

on Jan 3, 2017

Allow partitioning of the cluster based upon newness

#66

· nevali opened

on Nov 14, 2016

URI parsing failures

#62

· cgueret opened

on Nov 4, 2016

Allow a plug-in to perform actions when a new URI is added to the queue

#59

· nevali opened

on Sep 21, 2016

crawler-add should ignore blank lines

#58

· nevali opened

on Sep 5, 2016

When the crawler is terminated, the cluster_leave() is not invoked

#57

· nevali opened

on Nov 6, 2015

Rearrange libraries and executables to make purpose clearer

#55

· nevali opened

on Oct 13, 2015

Add a common memory allocation API which invokes abort() on failure

#53

· nevali opened

on Sep 21, 2015

Add message IDs for anything more severe than LOG_DEBUG

#51

· nevali opened

on Sep 21, 2015

Support storing cached resources in WARC format

#49

· nevali opened

on Jun 22, 2015