AI Interpolator Scraping Bot

Warning - anyone new to this module should be switching to the AI module instead, where the AI Interpolator exists as the AI Automators with improved functionality and more providers in to come. The ScrapingBot submodule will give you the same feature set as this module.

The AI Interpolator Scraping Bot module is a plugin for the AI Interpolator module that makes it possible to scrape titles, main images, raw html or main content of a website into a text field.

It is using the ScrapingBot service to do this. This means that it can scrape websites rendered by Javascript and you could even use proxies from different countries when scraping.

You get 10% off your first month if you use the promo code DRUPALAI - this helps the development of this module, since they offer me free testing accounts for automated test.

Features

• Add an link field and a textarea field and set the link field and the textarea will be filled out.
• It scrapes using the ScrapingBot service, so it can run Chrome browsers from Proxies and scrape most things

Post-Installation

1. Visit ScrapingBot config page and add your username and api key: /admin/config/scraping_bot/settings
2. When you generate a text long field you will have the option in the field config settings to enable the AI interpolator module on an link field and choose how you want to scrape it.

Look at the videos on Workflows of AI to get an general idea of what you can do.

Note that this is still in Alpha mode and should not be used for Production environments.