mirror of
https://github.com/ail-project/ail-framework.git
synced 2024-11-22 22:27:17 +00:00
chg: [HOWTO] clarify that AIL framework is required for the crawler part
This commit is contained in:
parent
59df5f0e12
commit
4dde62f26e
1 changed files with 9 additions and 2 deletions
11
HOWTO.md
11
HOWTO.md
|
@ -139,9 +139,16 @@ All Splash dockers are launched inside the ``Docker_Splash`` screen. You can use
|
|||
### TL;DR - Local setup
|
||||
#### Installation
|
||||
- ```crawler_hidden_services_install.sh -y```
|
||||
- Add the following line in ``SOCKSPolicy accept 172.17.0.0/16`` in ``/etc/tor/torrc``
|
||||
- Add the following line in ``SOCKSPolicy accept 172.17.0.0/16`` in ``/etc/tor/torrc``
|
||||
- ```sudo service tor restart```
|
||||
- set activate_crawler to True in ``/bin/packages/config.cfg``
|
||||
#### Start
|
||||
- ```sudo ./bin/torcrawler/launch_splash_crawler.sh -f $AIL_HOME/configs/docker/splash_onion/etc/splash/proxy-profiles/ -p 8050 -n 1";```
|
||||
- ```sudo ./bin/torcrawler/launch_splash_crawler.sh -f $AIL_HOME/configs/docker/splash_onion/etc/splash/proxy-profiles/ -p 8050 -n 1```
|
||||
|
||||
If AIL framework is not started, it's required to start it before the crawler service:
|
||||
|
||||
- ```./bin/LAUNCH.sh -l```
|
||||
|
||||
Then starting the crawler service (if you follow the procedure above)
|
||||
|
||||
- ```./bin/LAUNCH.sh -c```
|
||||
|
|
Loading…
Reference in a new issue