Skip to content

Add option to pass configuration to simplecrawler directly #29

Open
Open
Add option to pass configuration to simplecrawler directly#29

Description

@minorOffense
minorOffense
opened on Jun 18, 2019

There are a lot of options in simplecrawler. Might be useful to allow passing options directly to the crawler for really custom setups. Like limiting crawl depth or number of pages to crawl, etc.

Activity

  1. aaronbauman commented on Aug 31, 2020

    @aaronbauman
    aaronbauman
    on Aug 31, 2020

    +1
    I had a similar thought when writing the patch for maxDepth #34

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions