We started test crawling with our bot on 16.12.2019.
Our bot does NOT search for email or addresses. Our bot just parses and saves the website content for research purposes.
We want to find out how much storage space a website contains on average and how many words it contains.
Our goal is to save lots of Internet traffic and cpu power for web servers in the future.
Our bot respects your robots.txt data. Normally each website should only be crawled once during the test period.
We will go public at Jan/Feb 2020!
Thank you for your attention.
Contact Person: Sebastian Karpp (https://www.linkedin.com/in/skarpp/)