33 commits

Author	SHA1	Message	Date
Terrtia	2a1cd4a009	chg: [Onion, crawler config] auto crawler: add config by url, fix onions tagging + filter subdomains	2019-04-23 11:15:34 +02:00
Terrtia	6fdf7c2123	chg: [UI crawler] status/remove auto crawler	2019-04-18 16:57:51 +02:00
Terrtia	f64c385343	chg: [Crawler] handle port: crawling + history	2019-03-22 16:48:07 +01:00
Terrtia	c0d72e7d2a	chg: [Crawler UI] Crawler major refractor (end) + basic UI for manual crawler	2019-02-26 14:50:48 +01:00
Terrtia	7b32d7f34e	chg: [Crawler] major refractor	2019-02-25 16:38:50 +01:00
Terrtia	60f7645ac1	chg: [Crawler] refractor	2019-02-22 17:00:24 +01:00
Terrtia	e5dca268a8	chg: [Crawler] refractor	2019-02-21 09:54:43 +01:00
Terrtia	da78d0552d	chg: [Crawler UI Tags] add tag by day + add crawler status + UI onion blacklist	2019-02-19 11:41:45 +01:00
Terrtia	c2885589cf	chg: [UI] basic navbar + sidebar + refractor	2019-02-07 17:22:44 +01:00
Terrtia	516238025f	chg: [Crawler] add bootsrap4 src + refractor crawler	2019-02-05 17:16:44 +01:00
Terrtia	92d192238b	fix: [Crawler] change max page crawled	2019-01-29 17:04:45 +01:00
Terrtia	6c7086f4eb	fix: [Crawler] first_seen	2019-01-29 16:54:39 +01:00
Terrtia	88eaaeae93	chg: [Crawler] add priority queue, fix #263	2019-01-29 16:08:59 +01:00
Terrtia	c1b34bd99c	fix: [Crawler] limit max crawled pages	2019-01-29 15:38:00 +01:00
Terrtia	2dc0eca4a9	fix: [Crawler] fix crawler cache info	2019-01-29 12:09:19 +01:00
Terrtia	bb301a870c	fix: [Crawler] fix onion blacklist + add crawler info	2019-01-29 12:00:14 +01:00
Terrtia	f842194c57	fix: [Crawler] retry when splash is not available	2018-12-17 16:04:12 +01:00
Terrtia	6328cc22b7	chg: [Crawler] add domains blacklist	2018-09-28 16:29:09 +02:00
Terrtia	82e6df4b94	chg: [Crawler] domains stats + logs + clean	2018-09-28 15:23:27 +02:00
Terrtia	e357dce59b	fix: [Crawler] detect splash connection to proxy error	2018-09-27 15:43:03 +02:00
Terrtia	c49e871ba8	chg: [crawler] add infos	2018-09-26 16:34:27 +02:00
Terrtia	874824a589	fix: [Crawler] clean	2018-09-24 16:28:55 +02:00
Terrtia	8eca0e0778	fix: [Crawler] clean	2018-09-24 16:24:30 +02:00
Terrtia	50c81773e9	chg: [Crawler] add launcher and install	2018-09-24 16:23:14 +02:00
Terrtia	5b31b6e853	fix: [Crawler] save domain to crawl on splash error	2018-09-18 16:20:13 +02:00
Terrtia	f5b648d72a	pixelate paste screenshot	2018-09-18 11:03:40 +02:00
Terrtia	6f0817365a	chg: [Crawler UI] display domain information	2018-09-12 09:55:49 +02:00
Terrtia	ced0b1e350	chg: [I2P] add default config	2018-08-24 10:24:03 +02:00
Terrtia	7e24943537	chg: [Crawler] crawler accept all kind of domains	2018-08-24 10:13:56 +02:00
Terrtia	e9580d6775	chg: [Crawler] change BDD, save i2p links	2018-08-21 15:54:53 +02:00
Terrtia	ed559d9f4a	chg: [Showpaste] add screenshot + improve onion db	2018-08-16 17:24:39 +02:00
Terrtia	7652089433	chg: [Onion] change onion regex, fix crawler	2018-08-13 09:23:14 +02:00
Terrtia	8b1c10b38c	chg: [Onion] add onion splash crawler	2018-08-09 17:42:21 +02:00