23 commits

Author	SHA1	Message	Date
Terrtia	e5dca268a8	chg: [Crawler] refractor	2019-02-21 09:54:43 +01:00
Terrtia	516238025f	chg: [Crawler] add bootsrap4 src + refractor crawler	2019-02-05 17:16:44 +01:00
Thirion Aurélien	44c513dcbb	chg: [Crawler] add onion to blacklist	2019-01-31 16:56:45 +01:00
Terrtia	92d192238b	fix: [Crawler] change max page crawled	2019-01-29 17:04:45 +01:00
Terrtia	c1b34bd99c	fix: [Crawler] limit max crawled pages	2019-01-29 15:38:00 +01:00
Thirion Aurélien	f4ba21e492	blacklist onion debian manpages	2019-01-14 11:08:53 +01:00
Terrtia	b3b75ccbea	fix: [Crawler] Restart Splash on failure, limit unbound in memory cache (maxrss)	2019-01-04 15:51:08 +01:00
Terrtia	4d04333f54	fix: [Splash server] add debug output	2018-12-19 09:30:24 +01:00
Alexandre Dulaunoy	efaba35dec	Common onion addresses	2018-10-05 13:50:17 +02:00
Terrtia	6328cc22b7	chg: [Crawler] add domains blacklist	2018-09-28 16:29:09 +02:00
Terrtia	ecb2857151	chg: [Crawler] css + limit splash RAM	2018-09-27 16:47:48 +02:00
Terrtia	e357dce59b	fix: [Crawler] detect splash connection to proxy error	2018-09-27 15:43:03 +02:00
Terrtia	04b9d9fc1d	chg: [Crawler] add docs	2018-09-27 11:14:29 +02:00
Terrtia	c49e871ba8	chg: [crawler] add infos	2018-09-26 16:34:27 +02:00
Terrtia	874824a589	fix: [Crawler] clean	2018-09-24 16:28:55 +02:00
Terrtia	50c81773e9	chg: [Crawler] add launcher and install	2018-09-24 16:23:14 +02:00
Terrtia	0c63f2f24f	chg: [Crawler] catch server response	2018-09-17 15:35:06 +02:00
Terrtia	6f0817365a	chg: [Crawler UI] display domain information	2018-09-12 09:55:49 +02:00
Terrtia	7e24943537	chg: [Crawler] crawler accept all kind of domains	2018-08-24 10:13:56 +02:00
Terrtia	e9580d6775	chg: [Crawler] change BDD, save i2p links	2018-08-21 15:54:53 +02:00
Terrtia	ed559d9f4a	chg: [Showpaste] add screenshot + improve onion db	2018-08-16 17:24:39 +02:00
Terrtia	7652089433	chg: [Onion] change onion regex, fix crawler	2018-08-13 09:23:14 +02:00
Terrtia	8b1c10b38c	chg: [Onion] add onion splash crawler	2018-08-09 17:42:21 +02:00