1067 commits

Author	SHA1	Message	Date
Terrtia	dd4ca9966a	fix: [showpaste url] fix decoded url	2019-11-17 15:17:33 +01:00
Terrtia	2e921a12f2	chg: [UI] show correlation (pgp. decoded, cryptocurrency) migration	2019-11-15 17:22:50 +01:00
Terrtia	bb03ef532b	chg: [Correlation UI] add correlation blueprint + UI graph correlation	2019-11-14 17:05:58 +01:00
Terrtia	e42ec48380	chg: [Correlation Graph] add correlation by pgp, cryptocurrency, decoded and item + request correlation by type(pgp, ...) + objects(domain, paste)	2019-11-13 16:46:28 +01:00
Terrtia	504e45a43b	chg: [Correlation domain] add correlation graph by domain (union + intersection)	2019-11-12 17:08:52 +01:00
Terrtia	c5510acb73	fix: [Cryptocurrency] fix import conflict	2019-11-11 10:29:36 +01:00
Terrtia	880c351c0c	chg: [update + show decoded items] add background update	2019-11-08 16:00:42 +01:00
Terrtia	6b9ba9d377	chg: [Domain] Show last origin	2019-11-08 09:25:09 +01:00
Terrtia	63b3d5a5f9	fix: [showDomain] fix url pgp + cryptocurrency	2019-11-05 16:53:30 +01:00
Terrtia	c8d5ce9a28	chg: [core] mv bin/packages/config.cfg configs/core.cfg + use ConfigLoader	2019-11-05 15:18:03 +01:00
Terrtia	3c6e424ac3	chg: [UI Domain] UI: tag domain	2019-11-05 09:49:51 +01:00
Terrtia	a3e5e44c9b	chg: [core + UI] refractor Domain + Show Domain, better handle of ports, select screenshot on the UI, ...	2019-10-31 17:14:23 +01:00
Terrtia	a2d6874417	chg: [Domain + UI Crawler] refractor show domain	2019-10-30 17:12:04 +01:00
Terrtia	f1def65c89	chg: [lib ConfigLoader] add configLoader class	2019-10-28 13:48:43 +01:00
Terrtia	9051c4081b	fix: [url_prefix] add root blueprint, fix:#403	2019-09-25 08:58:18 +02:00
Terrtia	839443500d	chg: [Cryptocurrency, RegexTracker] uptdate cryptocurrency list + fix: RegexTracker typo	2019-09-22 14:57:23 +02:00
Terrtia	fed04e8e5a	chg: [Tracker] add optionnal description field	2019-09-13 16:33:34 +02:00
Terrtia	5734205828	chg: [API] add Tracker documentation	2019-09-13 11:40:09 +02:00
Terrtia	fb35be77f4	chg: [Tracker] add more info	2019-09-13 11:06:41 +02:00
Terrtia	a42676fbce	fix: [sparkline] datatable drawing	2019-09-12 14:49:08 +02:00
Terrtia	d41ee58a67	fix: [d3 graph] fix script path	2019-09-12 14:37:48 +02:00
Terrtia	55f4b72054	fix: [d3 js plugin]	2019-09-12 14:15:18 +02:00
Terrtia	ccdcfcd954	fix: [template] add trackers	2019-09-12 14:00:44 +02:00
Terrtia	01ff202ae8	chg: [update] add v2.2 update + fix default update + fix Empty Item.get_tags() + add new LAUNCHER options	2019-09-12 13:25:29 +02:00
Terrtia	934d631f7a	chg: [tracker] add missing btn	2019-09-11 15:37:31 +02:00
Terrtia	0ced25f3be	chg: [trackers] filter trackers list by type + minor fix	2019-09-11 15:33:04 +02:00
Terrtia	ad65ed7c8e	chg: [UI sparklines] sparklines: fix + factory	2019-09-06 16:52:51 +02:00
Terrtia	bd8735a6e5	chg: [merge] master	2019-09-04 10:24:46 +02:00
Terrtia	2ec96586eb	fix: [UI caching] avoid domain archive caching	2019-09-03 13:42:17 +02:00
Terrtia	ebf87f71b3	fix: typo	2019-09-03 12:00:24 +02:00
Terrtia	6dcecd6ba6	fix: [UI caching] fix: #373 avoid screenshot caching	2019-09-03 11:58:34 +02:00
Terrtia	dfd1128daa	chg: [api] add new endpoints: get bitcoin/pgp name/pgp keys/pgp mail metadata + items list	2019-08-16 17:59:44 +02:00
Terrtia	7ed09bc923	chg: [UI term tracker] refractor term management: trackers list + show trackers + add new trackers	2019-08-14 09:44:49 +02:00
Terrtia	80f9535074	chg: [api] add endpoint: get tracked item_id by uuid and daterange	2019-08-09 17:07:54 +02:00
Terrtia	4b0819a644	chg: [api] add endpoint: delete tracker term (regex/set/word)	2019-08-09 15:22:57 +02:00
Terrtia	bb6d3a6a26	chg: [Term tracker] add term tracker module (word + set) + API: add new term to track (word + set + regex)	2019-08-07 12:08:24 +02:00
Terrtia	28320a32a6	chg: [term] refractor + add new tracked word/set	2019-08-06 17:03:49 +02:00
Terrtia	0a071a5165	chg: [api] 405 response: add url to api endpoint documentation	2019-08-06 11:29:12 +02:00
Terrtia	071a206d5e	fix: [api] chg api role	2019-08-06 10:37:56 +02:00
Terrtia	88592dae57	chg: [api] add bruteforce protection	2019-08-06 10:22:09 +02:00
Terrtia	fa133ce12c	fix: [test api] typo	2019-08-05 16:31:03 +02:00
Terrtia	e28d563523	chg: [api] use POST with parameters + add API unittest	2019-08-05 16:00:23 +02:00
Terrtia	fea7b07134	chg: [api] add api versioning	2019-08-05 09:46:56 +02:00
Terrtia	5e1ae8a893	chg: [api] add new endpoints: get tag metadata + get all tags	2019-08-01 14:36:52 +02:00
Terrtia	98fb6ecef7	fix: [api doc] typo	2019-08-01 13:43:28 +02:00
Terrtia	4c20f58a52	chg: [api] add advanced get item via POST + use same query for each get item	2019-08-01 13:16:57 +02:00
Terrtia	8c02c1b00b	chg: [api] add 404 errors code + add future endpoints in doc	2019-08-01 09:45:59 +02:00
Terrtia	918b4c28ed	fix: [api] fix errors handler 404 405, return json	2019-07-31 13:24:43 +02:00
Terrtia	44cf5bb4af	chg: [API v1] add API documentation + update/delete items tags + Flask_tags refractor	2019-07-30 13:49:21 +02:00
Terrtia	6af9514a48	chg: [API] add GET: item metadata + item content + item tags	2019-07-26 15:44:29 +02:00
Terrtia	0a756294fe	chg: [API] import item (text)	2019-07-26 14:28:02 +02:00
Terrtia	3a8531cafa	chg: [API + import] add API format + item_import refractor	2019-07-25 17:26:32 +02:00
Terrtia	44d6eb8570	chg: [rest API] access: check token user role	2019-07-11 13:58:15 +02:00
Terrtia	8483ec8f90	fix: [role_manager] add password characters	2019-07-05 15:23:16 +02:00
Terrtia	add0a95814	fix: [secrets import] use urandom	2019-07-05 15:20:47 +02:00
Terrtia	71abe1ebc8	Merge branch 'master' into user_management	2019-07-04 11:36:07 +02:00
Terrtia	65584196e8	fix: [items submit UI] fix tags dropdown	2019-07-04 11:34:54 +02:00
Terrtia	34786d54db	Merge branch 'master' into user_management	2019-07-02 14:12:28 +02:00
Terrtia	5f157c52d8	chg: [Flask login] add brute force protection + log login errors	2019-06-26 16:36:40 +02:00
Terrtia	d26b55973c	fix: [MISP export] fix event creation	2019-06-25 14:55:03 +02:00
Terrtia	3357b855de	fix: [UI items_submit] add active tag + fix template name	2019-06-25 14:18:39 +02:00
Terrtia	9a883aef23	chg: [UI submit items] bootstrap 4 migration	2019-06-25 14:11:30 +02:00
Terrtia	27ae671b3d	fix: [UI login/change_password] add missing ail-logo	2019-06-24 17:14:16 +02:00
Terrtia	c759142ca2	fix: [UI settings] fix toggle_sidebar	2019-06-24 14:37:52 +02:00
Terrtia	be251289a7	chg: [Flask server] https support + create self signed certificate	2019-06-24 13:43:16 +02:00
Terrtia	bb65179e50	fix: [user_management] fix tokens duplicate + check user_acl_integrity + add login errors messages	2019-06-20 15:49:40 +02:00
Terrtia	a9837c6e27	chg: [user_management 2.0] add update scripts + fix create_default_user	2019-06-20 14:47:59 +02:00
Terrtia	821cf3cbea	chg: [UI user_management] user_role acl: hide admin panel	2019-06-20 11:15:56 +02:00
Terrtia	7ecd43db99	chg: [UI user_management] incorrect passwords: display errors	2019-06-20 10:56:31 +02:00
Terrtia	e4ab9b6a05	fix: [server endpoint] unknow users: avoid endpoint enumeration	2019-06-20 10:11:23 +02:00
Terrtia	ef716f22e5	chg: [user_management endpoint] check user roles + add 503 template	2019-06-19 17:02:09 +02:00
Terrtia	6eec0aabfe	Merge branch 'master' into user_management	2019-06-19 15:11:44 +02:00
Terrtia	34e57fe7af	chg: [user_managemant] clean code + check password and email length	2019-06-19 15:00:25 +02:00
Terrtia	8ca6e1a73c	chg: [UI dashboard + search] bootstrap 4 migration: dashbaord + fix search input	2019-06-18 16:19:27 +02:00
Terrtia	fbeac2340d	chg: [UI crawler, show_domain] domain history: remove target blank	2019-06-18 11:01:54 +02:00
Terrtia	e1bf59aded	chg: [UI crawler, show_domain] add domain history list + navigation	2019-06-18 10:58:37 +02:00
Terrtia	5183a3492a	chg: [UI crawled domains] Download all domain content (HTML + HAR + screenshot)	2019-06-12 10:58:13 +02:00
Terrtia	5b58872b15	chg: [user_management UI] add admin section: edit + create users	2019-06-11 17:37:20 +02:00
Terrtia	9c2d290580	chg: [user_management UI] edit my_profile + renew api tokens	2019-06-07 17:14:11 +02:00
Terrtia	e71daac7d2	fix: [backend crawler] rename downloaded archive	2019-06-07 13:53:33 +02:00
Terrtia	b4f06c21f9	chg: [backend crawler] domains: download 1 archive by crawled (most recent)	2019-06-07 13:47:44 +02:00
Terrtia	3fe9d14e9f	chg: [user_management] create default admin user (temp passwd save in AIL_HOME) + change password UI + logout UI + create random password	2019-06-06 21:27:13 +02:00
Terrtia	99e35c51ec	Merge branch 'master' into user_management	2019-06-05 16:59:36 +02:00
Terrtia	0d3d4aae1d	fix: [paste_submit UI] filter empty file field	2019-06-05 16:41:59 +02:00
Terrtia	601ea8f13e	chg: [paste_submit UI] add debug	2019-06-05 16:31:35 +02:00
Terrtia	1929b2c6a7	fix: [paste_submit UI] filter empty file field	2019-06-05 16:18:30 +02:00
Terrtia	9cb6312279	fix: [UI crawler endpoints] display crawler status + fix #353	2019-06-04 14:22:46 +02:00
Alexandre Dulaunoy	f09bb63a35	chg: [template] the "item" project	2019-05-25 09:51:49 +02:00
Terrtia	8dfe8fec91	fix: [correlation] fix graph node endpoint	2019-05-24 14:14:07 +02:00
Terrtia	bc6332dae4	fix: [correlation] fix endpoint	2019-05-24 13:19:11 +02:00
Terrtia	eb9c81acef	chg: [correlation] clean files	2019-05-24 13:08:10 +02:00
Terrtia	4794cafe01	chg: [correlation] add cryptocurrency + refractor correlation	2019-05-24 12:02:43 +02:00
Terrtia	ff23a2bce2	chg: [Bitcoin] map cryptocurrency: bitcoin (DB pivot)	2019-05-21 16:14:09 +02:00
Terrtia	da5579875d	chg: [pgpdump] reprocess tagged items + fix pgpdump	2019-05-20 14:32:07 +02:00
Terrtia	9639a51abd	chg: [PgpDump] fix graph + add new tags: pgp-signature pgp-public-key-block + avoid keys injection in pgp user_id	2019-05-20 11:57:49 +02:00
Terrtia	7e8ba8cdaf	chg: [decoded UI] add PgpDump UI + fix hashdecoded js	2019-05-17 17:51:07 +02:00
Terrtia	cca69def71	chg: [decoded items] bootstrap 4 migration	2019-05-15 17:23:58 +02:00
Terrtia	f2ca241e4f	chg: [restapi] add rest api authentification + create default user	2019-05-08 14:58:41 +02:00
Terrtia	1dac8177fe	chg: [user_management] add user role_management	2019-05-06 16:58:36 +02:00
Terrtia	2606220c2b	fix: [faup] fix new return types (bytes to str)	2019-05-06 13:38:13 +02:00
Terrtia	cc61c99290	fix: [showpaste] fix: #346, avoid None screenshots	2019-05-06 10:00:39 +02:00
Terrtia	64ff94ce5f	chg: [user_management] create + check user password	2019-05-03 16:52:05 +02:00
Terrtia	9b66fa703f	fix: [crawler] typo: domains down	2019-05-03 10:04:20 +02:00
Terrtia	1ab1a55a4f	chg: [UI] add basic user management	2019-05-02 17:31:14 +02:00
Steve Clement	57a344cfab	fix: [travis] Next round of travis fixes. LAUNCH.sh is the only launch script needed. ... chg: [installer] Be way more quiet, watching unzips is only fun during development. chg: [installer] Make the arch one +x	2019-05-01 20:49:07 +09:00
Alexandre Dulaunoy	0f2b139625	chg: [hashDecoded] cleanup for the VT message + PEP	2019-04-30 15:50:06 +02:00
Terrtia	a183695ddb	chg: [crawler UI] bootstrap 4 migration: show domains by daterange + bug fix hidden services tags	2019-04-26 15:14:29 +02:00
Terrtia	3e6fbc8f79	fix: [paste submit] update broken endpoint + get item date	2019-04-26 10:04:07 +02:00
Terrtia	e6dca7f8bf	chg: [update v1.5] add background update: screenshots_crawled	2019-04-24 16:19:35 +02:00
Terrtia	9868833c77	chg: [crawled screenshot] use sha256 as filepath	2019-04-24 14:09:04 +02:00
Terrtia	4ecff21194	chg: [UI crawler] add splash dashboard	2019-04-23 14:26:26 +02:00
Terrtia	2a1cd4a009	chg: [Onion, crawler config] auto crawler: add config by url, fix onions tagging + filter subdomains	2019-04-23 11:15:34 +02:00
Terrtia	6fdf7c2123	chg: [UI crawler] status/remove auto crawler	2019-04-18 16:57:51 +02:00
Terrtia	ecca5b11d0	fix: [UI dashboard] typo	2019-04-18 11:01:11 +02:00
Terrtia	de285ed64c	chg: [UI DOC] add dynamic update message + add bootstrap 4 migration message + add update doc (DB)	2019-04-18 10:56:00 +02:00
Terrtia	7a5fac9a43	fix: [UI show domain] fix domain/port unpacking	2019-04-18 09:54:25 +02:00
Terrtia	ddaad5db93	chg: [v1.5 background update] create update stats	2019-04-17 17:07:09 +02:00
Terrtia	4bff603d4f	chg: [settings UI] add background update progress	2019-04-17 14:39:29 +02:00
Terrtia	3b11df7f90	chg: [UI] add server Management, check if new update/version are available + background update status + link to new realease/commits	2019-04-16 17:24:59 +02:00
Terrtia	ddf043059a	chg: [UI] update nav bar endpoint	2019-04-15 17:14:48 +02:00
Terrtia	346e26433a	fix: [Update tags + UI] use srandmember + display update warning	2019-04-15 14:30:28 +02:00
Terrtia	3f1e68f638	fix: [tracked terms] show mime type	2019-04-15 13:36:14 +02:00
Terrtia	a43467a0f2	chg: [Update v1.5] update tracked terms path	2019-04-15 13:27:46 +02:00
Terrtia	fc1a04336c	fix: [dynamic update v1.5] make sure updates are excuted in the correct order + fix nb_seen_hash dynamic update	2019-04-15 11:01:33 +02:00
Terrtia	1ed9468881	fix: [UI showpaste] min preview	2019-04-11 13:44:20 +02:00
Terrtia	3cc614a1ad	chg: [DB] update items tags metadata	2019-04-11 11:58:06 +02:00
Terrtia	e83174327a	chg: [DB] remove absolute path	2019-04-10 17:47:40 +02:00
Terrtia	d44acea04d	chg: [merge] merge update into advanced_crawler	2019-04-10 16:41:06 +02:00
Terrtia	2589fc2161	chg: [merge] merge master into update branche	2019-04-10 15:43:15 +02:00
Terrtia	b4bee29a33	Merge branch 'master' into advanced_crawler	2019-04-10 15:37:42 +02:00
Terrtia	6165987ec3	chg: [DB Migration] add hash dynamic update	2019-04-10 15:36:41 +02:00
Terrtia	870fa1981c	fix: [update_thirdparty] detect and use virtualenv	2019-04-02 09:50:52 +02:00
Terrtia	f64c385343	chg: [Crawler] handle port: crawling + history	2019-03-22 16:48:07 +01:00
Terrtia	f4cdddbc7f	chg: [UI + item submit] remove browse paste from UI + fix pasteSubmit tagging	2019-03-21 11:50:53 +01:00
Terrtia	51eb951a47	fix: [UI terms] update tags endpoint	2019-03-21 11:34:21 +01:00
Terrtia	c2bc72c72e	chg: [Tags alertHandler] remove alertHandler + add quick tag search sidebar + use tag last_seen to display tagged items	2019-03-21 11:11:53 +01:00
Terrtia	ce6475e96e	chg: [tags] remove/add tags by daterange + improve item loading time	2019-03-20 15:57:55 +01:00
Terrtia	8b5266706e	fix: [Tags] cast nb_max_page to int	2019-03-20 13:33:12 +01:00
Terrtia	a9e86231ad	chg: [Tags] add backend, daterange selector	2019-03-20 13:25:02 +01:00
Terrtia	65e6eae00d	chg: [UI preview items] b4 migration + new template + better display + decrease item loading time + add basic animation/transition	2019-03-19 13:34:41 +01:00
Terrtia	e9bac098c9	fix: [UI Tags] paste preview	2019-03-15 11:16:44 +01:00
Terrtia	23d9cb2265	chg: [UI Tags search] bootstrap 4 migration	2019-03-14 17:04:55 +01:00
Terrtia	9e4813ca4b	chg: [UI Tags] start b4 migration + add date range selector	2019-03-12 13:37:15 +01:00
Terrtia	d3b3942ad7	chg: [Flask UI] refractor crawler frontend + show crawled domain	2019-03-06 15:05:58 +01:00
Terrtia	6f5f880b7d	chg: [Crawler UI] add basic tooltips	2019-03-01 11:40:43 +01:00
Terrtia	93c7db86e4	chg: [Crawler UI Flask] refractor functions, templates	2019-02-28 14:56:14 +01:00
Terrtia	460f70fee6	chg: [css] add basic toggle sidebar	2019-02-27 16:58:17 +01:00
Terrtia	aaf4712877	fix: [UI crawler manual] fix min input	2019-02-26 15:39:52 +01:00
Terrtia	c0d72e7d2a	chg: [Crawler UI] Crawler major refractor (end) + basic UI for manual crawler	2019-02-26 14:50:48 +01:00
Terrtia	e5dca268a8	chg: [Crawler] refractor	2019-02-21 09:54:43 +01:00
Terrtia	0832784f7a	chg: [thirdparty_update] get b4 datatable	2019-02-19 11:56:08 +01:00
Terrtia	da78d0552d	chg: [Crawler UI Tags] add tag by day + add crawler status + UI onion blacklist	2019-02-19 11:41:45 +01:00
Terrtia	95d63daaf4	chg: [Crawler UI] fix css + bootstrap4 migration	2019-02-15 17:00:07 +01:00
Terrtia	674a9a2591	chg: [UI] font icon v5 + navbar + sidebar	2019-02-08 17:16:58 +01:00
Terrtia	c2885589cf	chg: [UI] basic navbar + sidebar + refractor	2019-02-07 17:22:44 +01:00
Terrtia	516238025f	chg: [Crawler] add bootsrap4 src + refractor crawler	2019-02-05 17:16:44 +01:00
Terrtia	423c7b1455	fix: [UI] fix flot js install	2019-02-04 14:56:54 +01:00
Terrtia	655646b7c5	fix: [hiddenServices] catch empty data	2019-01-29 16:43:56 +01:00
Terrtia	c1b34bd99c	fix: [Crawler] limit max crawled pages	2019-01-29 15:38:00 +01:00
Terrtia	7a80683f13	chg: [hiddenServices] crawlers status, dynamic update	2019-01-29 14:27:50 +01:00
Terrtia	b9572e0085	fix: [Crawler] typo	2019-01-29 12:19:10 +01:00
Terrtia	bb301a870c	fix: [Crawler] fix onion blacklist + add crawler info	2019-01-29 12:00:14 +01:00
Terrtia	c4c3810037	fix: [hiddenServices] typo	2019-01-08 15:51:39 +01:00
Terrtia	46c1105483	chg: [hiddenServices] auto update last crawled domains	2019-01-08 15:48:40 +01:00
Terrtia	77211c5496	chg: [hashDecoded] add top5 types piechart (v0.1)	2018-12-24 11:42:55 +01:00
Terrtia	f023f41ae5	fix: cleaning ...	2018-12-21 15:21:08 +01:00
Terrtia	e93a0b637c	chg: [hashDecoded] add option to display decoded files, fix #271	2018-12-21 15:18:07 +01:00
Terrtia	306815a31d	fix: [hiddenServices UI] fix none type	2018-12-20 09:08:14 +01:00
Terrtia	6ee4b7bf93	Merge branch 'master' into update	2018-12-19 15:23:34 +01:00
Terrtia	4e08aaa80f	chg: [UI Crawled Domains] show crawled domains by date range (options: domains tags, up domains, down domains) ... todo: Shows domain history	2018-12-17 15:58:48 +01:00
Terrtia	31a8dfe0b3	fix: [AIL] use only relative paths ... pastes duplicates are fixed on the fly	2018-11-21 16:45:25 +01:00
Terrtia	d9b776d58a	merge master	2018-11-14 15:55:42 +01:00
Sami Mokaddem	62e46b6dc1	Merge pull request #287 from CIRCL/term_management ... Term management upgrade	2018-11-08 14:10:25 +01:00
Terrtia	173c0a15c6	fix: [term_management] delete tags	2018-11-08 12:01:40 +01:00
Terrtia	4e906ff841	fix: [term_management] delete emails	2018-11-08 10:41:37 +01:00
Terrtia	0adb8b4624	chg: [terms_management] delete terms tags	2018-11-07 15:37:25 +01:00
Terrtia	46614c97c8	chg: [terms_management] delete email	2018-11-07 11:42:31 +01:00
Terrtia	2c46c7f2ab	fix: [tag export] limit custom tag lenght	2018-11-07 10:17:57 +01:00
Terrtia	f91aba5f6f	chg: [tag export] UI, add custom tags	2018-11-07 09:41:58 +01:00
Terrtia	0ad80a22ca	fix: [update_thirdparty] upgrade github source	2018-11-06 17:04:02 +01:00
Terrtia	a3fa5a4dcf	chg: [auto push tag] delete unwanted tags	2018-11-06 16:08:58 +01:00
Terrtia	979472df15	chg: [Terms] tag tracked terms	2018-11-06 13:38:37 +01:00
Terrtia	af1ff6225e	fix: [Search] tags display	2018-11-05 10:36:58 +01:00
Terrtia	5c67297dc8	fix: [Search] Improve search performance ... note: search by paste name is temporary disabled	2018-11-05 10:13:48 +01:00
Terrtia	5872cf9196	fix: [Scripts] Remove absolute path	2018-11-02 16:07:27 +01:00
Terrtia	ea7fd8d54c	fix: [Duplicate] show duplicate with relative path	2018-10-24 15:47:03 +02:00
Terrtia	6328cc22b7	chg: [Crawler] add domains blacklist	2018-09-28 16:29:09 +02:00
Terrtia	b3a6dc8487	fix: [Crawler] remove hardcoded url	2018-09-28 15:42:06 +02:00
Terrtia	3dd20af4d1	Merge branch 'master' into onion_crawler	2018-09-28 15:29:24 +02:00
Terrtia	82e6df4b94	chg: [Crawler] domains stats + logs + clean	2018-09-28 15:23:27 +02:00
Terrtia	ecb2857151	chg: [Crawler] css + limit splash RAM	2018-09-27 16:47:48 +02:00
Terrtia	ff0affc679	fix: [Flask] remove hardcoded url	2018-09-26 11:59:51 +02:00
Terrtia	3a72f1548d	fix: [Flask] remove hardcoded url	2018-09-25 16:46:06 +02:00
Terrtia	b3923428e5	fix: [Flask] remove hardcoded url	2018-09-25 14:37:14 +02:00
Terrtia	e4a5f66a10	Merge branch 'master' into onion_crawler	2018-09-24 16:35:04 +02:00
Terrtia	874824a589	fix: [Crawler] clean	2018-09-24 16:28:55 +02:00
Terrtia	50c81773e9	chg: [Crawler] add launcher and install	2018-09-24 16:23:14 +02:00
Terrtia	6edc1ddbeb	chg: [HiddenServices] get domain related to other domains	2018-09-21 10:34:06 +02:00
Terrtia	61b4c9e579	chg: [Flask] add prefix in config to flask routes	2018-09-20 10:56:29 +02:00
Terrtia	5eadc2755f	chg: [Flask] add prefix in config to flask routes	2018-09-20 10:38:19 +02:00
Terrtia	5732d7b134	fix: [hashDecoded] range_type_json	2018-09-19 15:36:33 +02:00
Terrtia	912f2352ab	fix: [crawled screenshot] fix img error	2018-09-18 16:58:49 +02:00
Terrtia	ce63d81878	chg: [UI] pixelate crawled screenshot by default	2018-09-18 11:51:21 +02:00
Terrtia	f5b648d72a	pixelate paste screenshot	2018-09-18 11:03:40 +02:00
Terrtia	094b211259	fix: [showpaste] path transversal	2018-09-17 15:42:22 +02:00
Terrtia	0c63f2f24f	chg: [Crawler] catch server response	2018-09-17 15:35:06 +02:00
Terrtia	6f0817365a	chg: [Crawler UI] display domain information	2018-09-12 09:55:49 +02:00
Terrtia	ca982e13e1	chg: [Crawled Domain] show crawled pastes by domain	2018-08-27 14:34:08 +02:00
Terrtia	40772a5732	fix: merge	2018-08-27 11:30:19 +02:00
Terrtia	823c33174a	Merge branch 'master' into onion_crawler	2018-08-27 11:20:51 +02:00
Terrtia	d42dd118a4	chg: [Domain crawled] add random screenshot	2018-08-27 11:02:39 +02:00
Terrtia	6c981ea5e9	fix: [HashDecoded] typo	2018-08-24 11:58:54 +02:00
Terrtia	ab452841b1	fix: [HashDecoded] change template title	2018-08-24 11:51:16 +02:00
Terrtia	e6b583ee7a	chg: [Hash] add Help on graph node	2018-08-24 11:40:09 +02:00
Terrtia	a586548047	Merge branch 'master' into base64	2018-08-24 10:35:28 +02:00
Terrtia	7e24943537	chg: [Crawler] crawler accept all kind of domains	2018-08-24 10:13:56 +02:00
Terrtia	e9580d6775	chg: [Crawler] change BDD, save i2p links	2018-08-21 15:54:53 +02:00
Terrtia	ed559d9f4a	chg: [Showpaste] add screenshot + improve onion db	2018-08-16 17:24:39 +02:00
Terrtia	54cc4f3723	fix: [UI-Showpaste] show raw paste, force text/plain mimetype	2018-08-03 09:15:34 +02:00
Terrtia	911cff70da	chg: [UI] add AIL icon, fix li links	2018-08-02 10:44:47 +02:00
Terrtia	deaebaa4fd	fix: [UI-Hash] pie chart json	2018-07-27 13:51:29 +02:00
Terrtia	009f87ee10	[fix: [UI-hash] fix graph node zoom	2018-07-27 11:27:41 +02:00
Terrtia	b02cbee179	chg: [UI-dashboard] add logs number configuration	2018-07-26 11:35:54 +02:00
Terrtia	0a82482db4	chg: [UI-dashboard] convert time to local	2018-07-26 10:34:43 +02:00
Terrtia	5ad5939bd5	chg: display last logs	2018-07-25 16:48:44 +02:00
Terrtia	03a37af5cf	chg: [Hash] add reprocess regex order	2018-07-25 10:47:36 +02:00
Terrtia	8c97c70a3f	Merge branch 'master' into base64	2018-07-24 15:21:32 +02:00
Terrtia	4b8c26dec8	fix: [hive auto export] fix #221	2018-07-24 14:46:35 +02:00
Terrtia	3479923f96	fix: [UI-Hash] pie decoder	2018-07-23 11:43:48 +02:00
Terrtia	9c03c40482	chg: [UI-Hash] add decoder pie	2018-07-23 11:11:52 +02:00
Terrtia	1fbd4109c2	chg: [UI-Hash] add decoded type on graph	2018-07-20 15:48:56 +02:00
Terrtia	bd5f83f0eb	chg: refractor base64 encoded to hash	2018-07-20 10:32:52 +02:00
Terrtia	e25dd52d64	add: Binary decoder	2018-07-18 11:45:19 +02:00
Terrtia	524d5fe604	add: hash download	2018-07-18 10:09:35 +02:00
Terrtia	d9c924c38d	chg: use json to submit hash	2018-07-17 14:23:49 +02:00
Terrtia	412b012ddf	add: hash line_graph (nb/day)	2018-07-16 16:45:36 +02:00
Terrtia	6f69da0c0d	fix: paste submit css	2018-07-16 10:32:41 +02:00
Terrtia	fce324e370	fix: release tiemeout alarm, chg:icon graph node	2018-07-13 11:54:14 +02:00
Terrtia	87b7facba8	add: base 64 node graph	2018-07-12 17:07:17 +02:00
Alexandre Dulaunoy	9dc211dbe9	chg: [UI] Typo fixed as requested by our favourite German.	2018-07-10 10:49:02 +02:00
Terrtia	fd02085495	add: show hash info	2018-07-09 17:07:59 +02:00
Terrtia	c2a976e907	add: stacked barchart, resize chart	2018-07-09 11:47:04 +02:00
Terrtia	0e5a7d8d47	add date_range stacked bar	2018-07-06 16:54:43 +02:00
Terrtia	3b4e2a18aa	fix: date format https://github.com/CIRCL/AIL-framework/issues/219	2018-07-05 14:45:34 +02:00
Terrtia	cd154be6f9	fix: term_management UI bug ,https://github.com/CIRCL/AIL-framework/issues/214	2018-07-05 14:12:47 +02:00
Terrtia	f7d38bea16	add: base64 date and type selector	2018-07-05 13:58:40 +02:00
Terrtia	b6d855b963	change import d3.js to d3.min.js	2018-06-29 15:58:24 +02:00
Terrtia	adfc8cf260	add d3 and daterange js	2018-06-29 15:52:13 +02:00
Terrtia	a0a639276c	fix submit paste	2018-06-29 15:29:02 +02:00
Terrtia	98d0235fc3	Merge branch 'master' into base64	2018-06-29 14:57:46 +02:00
Terrtia	5908710b34	fix: update submitted tags link	2018-06-29 11:29:52 +02:00
Terrtia	cb807bf2c6	chg: change base64 icon	2018-06-29 11:28:35 +02:00
Terrtia	16c700ddb4	new: add base64 display on paste + base64 statistics	2018-06-29 10:02:29 +02:00
Terrtia	225776c69c	fix: tp and fp, errors messages on paste submission	2018-06-20 10:02:26 +02:00
Terrtia	6a89fac309	fix hive and misp error	2018-06-19 16:39:49 +02:00
Terrtia	af9db53171	add tag fp and tp	2018-06-19 15:09:26 +02:00
Terrtia	bf72c27711	fix path-event id map	2018-06-19 13:43:26 +02:00
Terrtia	cd4c099685	fix db init	2018-06-19 11:54:34 +02:00
Terrtia	103787a07d	fix	2018-06-19 11:43:16 +02:00
Terrtia	bc40bb3c38	fix hive connection + add keys sample	2018-06-19 11:42:06 +02:00
Terrtia	0ee36e484f	fix hive connection + submitted dir creation	2018-06-19 11:31:30 +02:00
Terrtia	634bf6e552	add img + fix upload api	2018-06-18 17:16:22 +02:00
Terrtia	704e6f0ad1	change default submit tag, event-path map, publish events	2018-06-18 13:58:31 +02:00
Terrtia	aee1b50ef1	fix duplicate export attribute + tag export whitelist	2018-06-15 17:25:43 +02:00
Terrtia	31fc33ab03	misp event creation, auto and manual + the hive alert auto creation, manual case creation	2018-06-14 16:51:06 +02:00
Terrtia	8522d50308	modify navbar + decompress file password	2018-06-11 10:21:11 +02:00
Terrtia	c64588f60e	add feature, user can submit paste on the web interface	2018-06-08 16:49:20 +02:00
Terrtia	8e9c77b364	verify file upload extention	2018-06-06 10:05:25 +02:00
Terrtia	6143bc3dce	submit users input paste	2018-06-05 16:58:04 +02:00
Terrtia	c41a56e4a2	clean Flask_tags + gitignore	2018-06-01 13:36:08 +02:00
Terrtia	2b310d4367	clean	2018-06-01 11:26:45 +02:00
Terrtia	cd6734f704	fix install	2018-05-31 15:35:20 +02:00
Terrtia	884d655b0c	taxonomies and galaxies update via LAUNCH	2018-05-31 13:53:29 +02:00
Terrtia	5c50de45de	add taxonomies and galaxies update and install	2018-05-31 10:07:23 +02:00
Terrtia	8a87b7b082	galaxy tag info + fix	2018-05-30 16:18:58 +02:00
Terrtia	dbe67e094b	galaxies synonyms	2018-05-29 17:17:02 +02:00
Terrtia	f3f6b76428	galaxy description and tags	2018-05-29 08:47:46 +02:00
Terrtia	f5cae0d99c	taxonomie + add tags + tags display	2018-05-23 16:58:56 +02:00
Terrtia	b9eb3ed9ba	add and delete tags features	2018-05-17 15:33:06 +02:00
Terrtia	4fbbf8bbd2	display tag on important paste and search	2018-05-17 11:00:05 +02:00
Terrtia	0d164b6f4c	add tag js and css	2018-05-16 14:48:15 +02:00
Terrtia	b1b7d33c96	tags	2018-05-16 14:39:01 +02:00
Terrtia	f66a528bc2	fix Duplicate, save list of duplicates on disk + prevent empty hash creation	2018-05-15 23:28:47 +02:00
Terrtia	225fe76c96	fix duplicate + get raw paste	2018-05-11 16:07:30 +02:00
Terrtia	142c1dc9b0	clean	2018-05-09 13:03:46 +02:00
Terrtia	3841c159a0	change leveldb to ardb	2018-05-07 14:50:40 +02:00
Terrtia	c17b9402f7	clean	2018-05-04 14:25:47 +02:00
Terrtia	96a3df42bc	decode with redis connection	2018-05-04 13:53:29 +02:00
Terrtia	a900d5f08d	add python 2 to 3 bash + fix Duplicate + clean	2018-05-03 16:21:33 +02:00
Terrtia	c52caebe7c	improve Duplicate + tlsh + add time out handler + debug + clean	2018-05-02 17:07:10 +02:00
Terrtia	c3428df5dc	add apiKeys module	2018-04-26 14:42:39 +02:00
Terrtia	8738b7cf75	fix track term and avoid duplicate mail address	2018-04-24 16:44:37 +02:00
Terrtia	f93fe9aeb2	add bitcoin module	2018-04-23 14:51:53 +02:00
Terrtia	41eb250278	fix python 3 compqtibility issues	2018-04-20 10:42:19 +02:00
Terrtia	8571a86344	frontend python 3.5 upgrade	2018-04-17 16:06:32 +02:00
Philipp Schmied	4835589ff4	Fixed typo	2018-03-01 08:50:27 +01:00
Philipp Schmied	29608ab29b	Fixed e-mail notificatins for sets and regexes	2018-02-28 11:31:16 +01:00
Philipp Schmied	b6fcf51309	Flask_terms.py: Fixed mapping of notifcation e-mails to terms with uppercase letters	2018-02-28 09:19:27 +01:00
Philipp Schmied	5b1f0b0212	Implemented email notifications (bin: config.cfg additions, email sending via analyzer scripts; var: Changes to add notifications via terms management); terms_management: Fixed click handlers not being added to all tracked terms.	2018-02-27 15:12:02 +01:00
Alexandre Dulaunoy	abdf41fe23	Merge pull request #164 from mokaddem/showDiff ... Show differences between duplicates	2018-02-21 22:25:16 +01:00
Sami Mokaddem	9125930a77	fix: canvasjs changed its folder hierarchy	2017-12-14 11:47:11 +01:00
Sami Mokaddem	304213cfa4	update: Possibility to change the authorized max line length in the config for the diff of duplicates	2017-12-12 11:00:26 +01:00
Sami Mokaddem	3fe7ecf75a	feature: diff in the web interface for duplicates pastes.	2017-12-12 10:48:21 +01:00
mokaddem	9cab76cf88	Merge pull request #162 from mokaddem/sentimentBugfix ... Fix: bug between front-end and back-end date representation	2017-12-11 16:35:38 +01:00
Paul A	4a4a1d478b	Quick refactor for the JavaScript	2017-10-22 18:48:54 +02:00
Paul A	f6b6777095	Fixed some code for the JavaScript (coding-style)	2017-10-20 15:44:09 +02:00
Paul A	48fc8e3464	Removed duplicate function	2017-10-20 15:32:58 +02:00
Simon Tran	a41c5d55c5	Migrated Dockerfile to Ubuntu 16.04 LTS ... Fixed AIL Web dependencies installation Added Docker documentation	2017-10-01 02:23:32 +02:00
Sami Mokaddem	2cfb8c173b	Fixed from front-end date representation bug	2017-09-27 10:46:20 +02:00
=	b9bd651033	Removed useless import	2017-08-23 14:06:59 +02:00
=	3b3f3aa89c	Flask: Added support of LevelDB database depending of the year	2017-08-23 12:20:39 +02:00
=	d632335760	Automatically start redis_levelDB with the correct date	2017-08-23 10:16:56 +02:00
=	bd46c83fb6	BrowseImportantPaste: Fixed a bug where onClickListener was not set when the table was only 1 page long	2017-08-21 11:55:01 +02:00
=	409eb25a64	Deleted data-flow graph and header.html from the index + Added fixed typo where 10min was in fact 3min	2017-08-21 10:51:56 +02:00
Mokaddem	fa52292029	Added comments, cleanup and added credentials search progress in Flask	2017-07-20 10:50:24 +02:00
Mokaddem	cbb2909156	Added comments	2017-07-20 10:24:48 +02:00
Mokaddem	05417f405c	Finished basic link web interface + solved some bugs	2017-07-20 10:04:30 +02:00
Mokaddem	ef741f85c0	Added similarity checks + started link webInterface	2017-07-19 11:52:06 +02:00
Mokaddem	882ab88b00	Draft module + web link	2017-07-18 16:57:15 +02:00
Mokaddem	9b8570e40b	Dirty draft webpage credential_tracking	2017-07-17 17:26:19 +02:00
Mokaddem	f1a1e75c32	Restaured old example webpage	2017-07-17 16:18:21 +02:00
Mokaddem	9558aafe67	Prevent the loss of the 1 message in import_dir.py	2017-07-17 16:14:27 +02:00
Mokaddem	b60e164380	Added support of onion in browseWarningPaste	2017-04-26 11:47:02 +02:00
Mokaddem	5e4d0170d4	Bug fixes, jinja2 iter0 and typo	2017-04-26 11:31:08 +02:00
Mokaddem	e614da4748	Deleted print + Added curve fill for Mixer graph in Index	2017-04-25 15:52:41 +02:00
Mokaddem	71b2757ed2	New script create_new_web_module permits to rapidly create a new pre-configured webpage from a template.	2017-04-25 15:22:04 +02:00
Mokaddem	6afbf77af0	Modified skeleton template name into rawSkeleton + Added possibility to hide modules in the header.	2017-04-25 12:18:08 +02:00
Mokaddem	f6e8582d9d	Auto organisation of the navbar -> Web page are auto-inserted. Created skeleton webpage	2017-04-19 15:14:20 +02:00
Mokaddem	32906965d8	Draft of new organisation of the web interface. Usage of Flask's blueprint	2017-04-19 11:02:03 +02:00
Mokaddem	da081bae42	Merge branch 'regexInTerms' into production	2017-04-18 16:59:40 +02:00
Mokaddem	c8baabd882	Updated TermsFrequency related modules + Fixed bugs (encoding, behaviors, ...)	2017-04-18 15:28:21 +02:00
Mokaddem	2da4c572c7	New feature in Terms: regex and set of words support (draft)	2017-03-28 17:42:44 +02:00
Mokaddem	3261eca836	Fixed all_index newline bug + added print of what's happening	2017-03-15 14:29:49 +01:00
Mokaddem	5b7d047622	Changed os.system by os.mkdir + fixed bug during rotation	2017-03-15 14:05:13 +01:00
Mokaddem	4005b72180	Added backward support + renamed index with timestamp	2017-03-15 11:51:35 +01:00
Mokaddem	381e72ee99	Added display of number of elements inside the index + changed variables names	2017-03-15 10:07:46 +01:00
Mokaddem	e4757f5ceb	Added possibility to choose the index in search + Updated search page with jinja2 iter0	2017-03-15 09:39:48 +01:00
Mokaddem	41132fe0bc	Added support of per_paste for term-management and plot-term	2017-02-28 15:54:39 +01:00
Mokaddem	4071bf2e91	fixed a bug in manage_term (usage of loop.index0) + fixed bug in top_set where graph was not displaying the correct per_paste value	2017-02-28 15:01:48 +01:00
Mokaddem	25adae0104	Added possibility to select in top_terms the data per_paste or not (need module testing)	2017-02-15 16:29:02 +01:00
Mokaddem	d4da3a316f	Added path of the paste in the log of Categ.py	2017-02-14 10:59:47 +01:00
Mokaddem	29241eb49f	Added a line separator between the two graphs in dashboard.	2017-01-09 14:44:14 +01:00
Mokaddem	0e39f516a9	Added sleep in helper for multiple listening interfaces (reduce useless work), Added a simple way to pre-process feed before sending it to the global feed.	2017-01-09 14:12:26 +01:00
Mokaddem	24c5621d29	BUG FIX in Flask_trendingmodule, Fixed member_set when get_top_relevant_data is None.	2016-12-26 16:33:10 +01:00
Mokaddem	1c2169d3bc	Improved interface for multiple feeds and refresh_script.	2016-12-26 16:16:44 +01:00
Mokaddem	a18c046dea	Fixed bug multiple refresh instances and harmonized interface.	2016-12-23 16:15:05 +01:00
Mokaddem	03dddbc359	Reduced refresh rate of processed_pastes, synchro graphs and adjusted max on each graphs.	2016-12-23 16:01:30 +01:00
Mokaddem	97292e0899	Updated web interface to handle new mixer module. and fixed one dependency bug.	2016-12-23 15:44:46 +01:00
Mokaddem	faa8f8302d	Removed typo in the number of remaining pastes to display in browseImportantPaste	2016-12-22 09:28:55 +01:00
Mokaddem	9df12cdae8	Added sub-flask in a directory	2016-12-22 08:57:45 +01:00
Mokaddem	d30f3ca6c7	Added missing depency datetime in dashboard	2016-12-09 13:53:57 +01:00
Mokaddem	0054be5bab	Added missing json dependency in dashboard	2016-12-09 08:50:36 +01:00
Mokaddem	8daa72789e	Splitted Flask_server into module related to website sections	2016-12-09 08:46:37 +01:00
Mokaddem	d3ed1bbf40	Merge branch 'website-improvement' into production	2016-12-08 10:05:55 +01:00
Mokaddem	1abba4dcf9	Added support of re-plotting the plotted terms	2016-12-08 08:44:10 +01:00
Mokaddem	84dcd5586f	Started plotting same data with different dates	2016-11-25 16:42:22 +01:00
Mokaddem	a3255d168c	ModuleInfo correctly handle CurveManageTopSets, ... Changed queue coloring in dashboard, ModuleInformation now have a history of executed command and better handle module killing.	2016-11-25 11:54:16 +01:00
Mokaddem	5d269ea1ee	Added date in Duplicate for better distinguish duplicate. Also, added a timeout for the dataTable in duplicate inside the modal.	2016-11-24 15:05:29 +01:00
Mokaddem	df8d978088	Added dynamic data loading in dataTable in search.html	2016-11-24 13:31:31 +01:00
Mokaddem	80ca49f018	Prevent browser to request reconnection for the eventStream + Added dynamic data loading in the dataTable of BrowseImportantPastes	2016-11-11 16:51:39 +01:00
Mokaddem	768fb6f2df	removed server overhead for paste preview data	2016-11-10 16:41:07 +01:00
Mokaddem	699c819387	fixed bug in show concerned pastes previex en (terms managements)	2016-11-10 16:33:05 +01:00
Mokaddem	94e3034e7d	Fixed bun in terms management, where action_button was not bind in other dataTable pages	2016-11-10 15:53:22 +01:00
Mokaddem	7763bfb4c7	Pastes dataTable now display only the latest clicked paste even if there were discarded queries	2016-11-10 15:39:45 +01:00
Mokaddem	2dd69fbb25	Fixed modal background stacking bug + button leading to saved paste bug fixed in search	2016-11-10 14:56:25 +01:00
Mokaddem	317005c2b4	tryed to fix html display problem in tooltip + fixed problem button showPaste in modal not pointing to the paste	2016-11-10 10:30:29 +01:00
Mokaddem	34221b083f	Partially solved the browser freezing problem + tootlip is also binded at a new page generation of the DataTable	2016-11-10 09:28:55 +01:00
Mokaddem	acdd1367a3	Added event source for getImportantPaste	2016-10-28 16:55:56 +02:00
Mokaddem	c95000866d	Dynamic table in search now load all the data + fixed bugs where tooltip where not shown on other than the first page displayed and ... tooltip interpret html (not supposed to...)	2016-10-28 14:21:08 +02:00
Mokaddem	f51808d914	Added support of html formatting in search result dynamic loading table	2016-10-28 09:48:22 +02:00
Mokaddem	4be62a4e2d	Added draft of dynamic update table with search result	2016-10-28 09:28:42 +02:00
Mokaddem	340624fe1e	Fixed bug in modal show paste (show more button not showing)	2016-10-27 16:18:49 +02:00
Mokaddem	7e7e679ab6	Added dataTable for duplicate in show saved paste	2016-10-27 15:53:45 +02:00
Mokaddem	59a7000527	Bootstrap support in show saved paste	2016-10-27 12:38:39 +02:00
Mokaddem	ac254e0e63	Added support of browsing concerned paste in dashboard for all modules + Show in the page what was the concerned module	2016-10-27 11:50:24 +02:00
Mokaddem	1826b170ec	Added support of local paste view in dashboard for Mails event only	2016-10-27 11:27:26 +02:00
Mokaddem	7c8d414948	modified provider name into no data when there is no data	2016-10-14 16:47:22 +02:00
Mokaddem	91678179fd	Added msgs when queues or feed is not running/coming	2016-10-14 16:33:54 +02:00
Alexandre Dulaunoy	2781a2f0b7	Stuck not stucked	2016-09-21 08:35:20 +02:00
Jerome St-Hilaire	ea13f87c2c	Fixed dependency fetching for the web interface	2016-09-15 12:14:55 -07:00
Raphaël Vinot	acfe9c1336	Update Flask_server.py	2016-08-26 18:06:48 +02:00
Raphaël Vinot	3290b51c91	Update update_thirdparty.sh	2016-08-26 18:05:18 +02:00
Mokaddem	79be8ab934	Fixed introduced bug relative to chart in index webpage.	2016-08-26 15:59:53 +02:00
Mokaddem	0c760d763b	Added support of PID in ModuleInformation and index.html	2016-08-26 15:27:37 +02:00
Mokaddem	5c565068a6	Removed auto-reload in dashboard if window in undefined	2016-08-26 11:25:11 +02:00
Mokaddem	181c372131	Updated dependencies	2016-08-26 11:10:39 +02:00
Mokaddem	4cb3b672be	Added comments	2016-08-26 10:28:35 +02:00
Mokaddem	86b655100e	Deleted useless parsing function	2016-08-26 10:01:14 +02:00
Mokaddem	07d7559060	Added dataTable support in browse paste modal.	2016-08-26 08:30:09 +02:00
Mokaddem	813cc7031a	Changed lots of code into zrank	2016-08-25 17:48:12 +02:00
Mokaddem	991176fdfd	Suppressed metismenu import.	2016-08-25 16:40:13 +02:00
Mokaddem	fb22816236	Added module number info in index webpage	2016-08-25 16:27:32 +02:00
Mokaddem	0b5a3e0cd2	Auto generate graph div + possibility to query all sentiments data.	2016-08-25 15:06:18 +02:00
Mokaddem	21f2c43572	Individualized sentiments-graph loading	2016-08-25 13:11:16 +02:00
Mokaddem	f9bf00f022	Removed autokill feature if not specified	2016-08-25 11:09:31 +02:00
Mokaddem	611454ba82	Added color in web-index reprenting modules states.	2016-08-24 18:00:05 +02:00
Mokaddem	e3daa84196	Added icon in header	2016-08-23 16:09:34 +02:00
Mokaddem	e12244fb53	Added show/hide curve with legend in terms-top-set.	2016-08-23 15:39:13 +02:00
Mokaddem	e56187eb7e	Added position of each top term in the other sets + highligth ones not present.	2016-08-23 14:52:02 +02:00
Mokaddem	a64d447b7b	Auto hide button add_to_chart when no data plotted.	2016-08-23 12:09:41 +02:00
Mokaddem	e59b7c4e47	Added tooltip in graph for terms-plot-tool	2016-08-23 12:03:23 +02:00
Mokaddem	0eba419651	Added multiple terms plot in terms-plot-tool.	2016-08-23 11:56:32 +02:00
Mokaddem	9f2d672ec8	harmonized tooltip and popover display	2016-08-23 11:20:48 +02:00
Mokaddem	8c956c22b1	Added autohide curves in terms-top-set.	2016-08-23 11:02:36 +02:00
Mokaddem	32dfd2b181	Moved legend place in term-plot-top	2016-08-23 10:16:33 +02:00
Mokaddem	f9b27e4013	Fixed bug in curve preventing to track concerned_pastes. Now all tracked words are put in lower case.	2016-08-23 09:50:03 +02:00
Mokaddem	1766ced9e6	Fixed potential XSS problem with pastes display in 'search' and 'important_paste_by_module'.	2016-08-23 09:08:17 +02:00
Mokaddem	047331df3e	Added save of paste_baseName in set for searches. This is done in ModuleStats to not surcharge the Global module.	2016-08-23 08:52:54 +02:00
Mokaddem	6be557890c	Replaced negative hour by 24h based.	2016-08-23 07:19:51 +02:00
Mokaddem	85ab0e36ff	In sentiment analysis. if today top provider set is empty, try to take yesterday data and then takes from all_providers.	2016-08-23 07:11:03 +02:00
Mokaddem	8359a6668f	Suppressed useless comms	2016-08-22 21:36:19 +02:00
Mokaddem	2fd2c8af39	Removed commented code	2016-08-22 20:59:56 +02:00
Mokaddem	27ae577e00	Fixed stupid line remove in index.html...	2016-08-22 16:25:52 +02:00
Mokaddem	a424069c64	Fixed bug in flask with zrange (was taking the bottom of the set instead of the top leading to get only the min instead of max)	2016-08-22 16:12:20 +02:00
Mokaddem	003c72bd7c	Fixed bug with redis where the inserted key was too long, causing a crash + fixed bug taking min instead of max in terms-top-set	2016-08-22 16:01:42 +02:00
Mokaddem	2466f355ab	Fixed bug in manage-terms-top-set + added auto sorting in important-paste-by-module	2016-08-22 14:54:37 +02:00
Mokaddem	e144e8e1c6	Fixed bug in terms-management-interface (only display one paste) + removed get_language of all pastes due to the huge overhead.	2016-08-22 13:59:12 +02:00
Mokaddem	d3c0fc5f94	Added terms trending module and web interface: ... - Curve module has been rewritten - Added new module curve_manage_top_set - Added all web-pages	2016-08-22 13:35:49 +02:00
Mokaddem	841e87eb16	Fixed bug in sentiment trending, if there was no data for the avg -> there was one NaN leading to no display in the gauge.	2016-08-20 18:48:24 +02:00
Mokaddem	ee8f26c7c4	In sentiment trending, if there are no providers in the today\'s set, get data from random providers	2016-08-20 18:14:19 +02:00
Mokaddem	2ed60cb9bf	Fixed typo	2016-08-20 16:44:36 +02:00
Mokaddem	3f1cf705fc	Deleted alert()	2016-08-20 16:41:49 +02:00
Mokaddem	1c96eac2e4	Enter simulate button click on input field for terms management and plot tool	2016-08-20 16:38:51 +02:00
Mokaddem	465d18fc73	Added terms-plot tool	2016-08-20 16:23:06 +02:00
Mokaddem	fb3dea6bd2	Finnished terms-plot-top-set. Also added possibility to add terms to track or blacklist.	2016-08-20 15:59:22 +02:00
Mokaddem	a5117d7cad	Added top set webpage	2016-08-20 11:46:22 +02:00
Mokaddem	0b6828fb16	Correctly handle and display add or remove a term in term-frequency + started sketch of terms-plot tool.	2016-08-19 16:53:46 +02:00
Mokaddem	8d41b109e7	Added query of the data for the new tracked word	2016-08-19 14:33:01 +02:00
Mokaddem	b78effe779	Added draft of terms_management + Added copyright in readme	2016-08-19 13:34:02 +02:00
Mokaddem	52b7124a6b	- Modified redis connection (from levelDB to redis). ... - Added term frequency in curve. - Modified ModuleStats and WebStats to use redis special command (incrby instead of get-set and zset) and Flask to perform the correct queries. - Added panel color in sentiment trending	2016-08-18 15:34:19 +02:00
Mokaddem	24072ece36	Added support of pasteName in search + added header in search.html + supressed mixed indent and trailing in Flask.py	2016-08-17 14:21:31 +02:00
Mokaddem	c10f28d9df	Updated isolated launch scripts + Added switch displaying queue in index	2016-08-17 13:46:01 +02:00
Mokaddem	23b65eddca	Auto unchecked info checkbox in index	2016-08-17 11:25:05 +02:00
Mokaddem	4d09ab0f6b	Modified icon sentiment in web-header.	2016-08-17 11:13:37 +02:00
Mokaddem	44f54b7b81	Added dependencies	2016-08-17 11:04:48 +02:00
Mokaddem	f0b527167a	Added script flexgauge	2016-08-17 10:50:30 +02:00
Mokaddem	c12e67a35a	Added tooltips + slight gauge modification	2016-08-17 10:43:43 +02:00
Mokaddem	894b9efda9	Added drop of really long line in sentiment-analysis module + Added description of sentiment module. Also, fixed bug in webpage sentiement-trending concerning avg and date range.	2016-08-17 09:46:25 +02:00
Mokaddem	1084e45f1b	Added draft of filter in sentiment analysis (Discard syntaxical languages) + Added nice tooltip for sparkline. Trending displays avg in function of the number of elements processed and not for the complete week + fixed bug in gauge and canvasjs (was performing avg with only 1 graph instead of all 8).	2016-08-16 16:33:02 +02:00
Mokaddem	ecd834ffb6	Added autoreload in sentiment-trending.	2016-08-16 11:27:49 +02:00
Mokaddem	bb677b9061	Added avg text in sentiment-trending + fixed date range bug	2016-08-16 11:23:14 +02:00
Mokaddem	cdd08d7df0	Added all providers for plot_tool in moduleStats + fixed date range bug	2016-08-16 11:07:36 +02:00
Mokaddem	8fa3c2b147	Added stacked choice or not for plot-tool (sentiments)	2016-08-16 10:49:05 +02:00
Mokaddem	4baac0b994	Tool-plot for sentiment working + Splitted script and webpage	2016-08-16 10:31:18 +02:00
Mokaddem	1e7547d16c	Created draft of search for plot tool	2016-08-15 16:32:02 +02:00
Mokaddem	88ed8a239d	Linked plot button with server	2016-08-15 15:54:53 +02:00
Mokaddem	82f70e61f4	Added provider checkbox	2016-08-15 15:16:31 +02:00
Mokaddem	f90987d284	Added date on slider	2016-08-15 14:53:46 +02:00
Mokaddem	d8c84ec674	Added link to data in analysis trending + fixed tooltip bug in sparkline	2016-08-15 12:57:39 +02:00
Mokaddem	6c7f660052	Added support of week and day average.	2016-08-13 22:17:11 +02:00
Mokaddem	1a5158b081	Added sentiment analyser module (draft)	2016-08-13 15:24:57 +02:00
Mokaddem	0431ecf434	Modified webpage display and added js.	2016-08-12 10:22:24 +02:00
Mokaddem	9c3b573af2	Splited js from html + Added some ID + small display modification.	2016-08-12 07:49:24 +02:00
Mokaddem	87a86b38d1	Added page Plot-tool	2016-08-11 21:08:43 +02:00
Mokaddem	c028ca80da	Separated options from the plot funcion for sparkline.	2016-08-11 17:57:23 +02:00
Mokaddem	98c4cacb98	Finished first panel in sentiment-today.	2016-08-11 17:22:50 +02:00
Mokaddem	8682fcc29c	Added empty webpages for sentiments modules.	2016-08-11 11:34:22 +02:00
Mokaddem	5612a77af9	Separated webpage header code from all webpage	2016-08-11 10:55:51 +02:00
Mokaddem	0ba5637e06	Added bar chart hover binder in trending charts	2016-08-10 11:16:56 +02:00
Mokaddem	24318f6a86	Added the part 'other' in Trending chartscd	2016-08-10 10:42:06 +02:00
Mokaddem	1ca8cf69f6	Added trendingchart.js	2016-08-10 09:38:15 +02:00
Mokaddem	b249676fe9	Removed console log	2016-08-09 16:54:53 +02:00
Mokaddem	507c83e06d	In index webpage, reset value graph if no paste received	2016-08-09 16:48:57 +02:00
Mokaddem	943016d6ca	Fixed one of the small display bug in DUplicate_ssdeep_v2 (was displaying [tlsh, tlsh] instead of simply tlsh)	2016-08-09 15:06:55 +02:00
Mokaddem	0d16a8beb7	Fixed bug where Listener was not placed if the row was not displayed (BrowseWarningPaste)	2016-08-09 12:30:40 +02:00
Mokaddem	e2ba4060ee	restaured loading gif when new tab is shown (BrowseWarningPaste)	2016-08-09 12:07:20 +02:00
Mokaddem	a80f6ca0c2	Bug fix related with redis: ... Fixed typo key in redis for module creditcard and sqlinjection Modified Curve redisLvlDb server Modified Url.py so that it forwards name of protocol from saved protocolsfile Added Cache control in Flask Modified key-tab name into keys-tab	2016-08-09 11:59:36 +02:00
Mokaddem	084737dd26	Fixed bug in flask not correctly displaying the number of paste/providers	2016-08-08 11:39:17 +02:00
Mokaddem	78c611fead	Added warning_paste module and created related webpages. ... Fixed a Faup bug in credential (multiple instanciation) and added correc populate_set_out in concerned modules (creditcard, credential, ...). Linked browse_warning_paste module and Flask function with redis (created new sets).	2016-08-08 09:17:44 +02:00
Mokaddem	3523d79a05	Started browse important paste feature. Still need to link with redis. + Fixed a bug in Flask (String to list parser)	2016-08-04 16:57:34 +02:00
Mokaddem	55ef917ef1	Added few comments	2016-08-04 12:10:56 +02:00
Mokaddem	d9316771cd	Draft: added new duplicate hash comparison - tlsh	2016-08-04 11:55:38 +02:00
Mokaddem	50d2848a40	Tryed to fix the glob_tabvar bug	2016-08-02 16:39:57 +02:00
Mokaddem	9e82ec82b7	Fixed a bug in the hover of provider graph (happened when there was an 'other' in other graphs)	2016-08-02 16:17:25 +02:00
Mokaddem	9d37ebc860	Fixed a division by 0 in Flask + Harmonized webpage item positioning	2016-08-02 16:00:31 +02:00
Mokaddem	f3cf2f853a	Fixed a bug in the hover of providers graph. ... When we click on a part in providers graphs, we hover an item, then we click on a random part not belonging to providers graphs, and we re-hover one part of the providers graphs, there was an undefined variable (The random click overrided it).	2016-08-01 11:08:53 +02:00
Mokaddem	feb1717dc6	fixed size bug, which in some cases display the total size instead of the average + few cleanup + commented out log scale in moduleStats.js and added large number division in case of div by 0	2016-07-29 16:52:50 +02:00
Mokaddem	a827e8ca3a	Big refactoring and added lot of comments + fixed bug attaching multiple binder on barChart	2016-07-29 14:30:41 +02:00
Mokaddem	e8fae17cfd	Fixed small race condition bug in ModuleStat.py and Added highlight of bar belonging to the same serie in moduleStats.js	2016-07-29 10:36:44 +02:00
Mokaddem	c2bf2ba630	Added tooltip in moduleStat above each bar chart + Added highlight of the selected bar. (Still not working for category 'Other')	2016-07-28 16:35:30 +02:00
Mokaddem	09fdaa3e39	Added tooltip for moduleStats bar chart	2016-07-28 12:06:54 +02:00
Mokaddem	acec508f53	fixed multiple binding bug in moduleStats + Added multiple bar display for 'other pie part' + Added ModuleStats tab in all other pages	2016-07-28 09:52:07 +02:00
Mokaddem	5a02a7ffce	Clean up and refactoring for back-end moduleStats	2016-07-27 11:55:57 +02:00
Mokaddem	27e0d5c578	Clean up and refactoring for front-end moduleStats	2016-07-27 11:26:56 +02:00
Mokaddem	240bdd9cca	Added number of paste by provider in module stats	2016-07-27 09:27:32 +02:00
Mokaddem	63774cd160	In moduleStats, if there is data which have small percentage, display it in an 'other' part + Added stacked chart for them (still draft)	2016-07-26 16:56:52 +02:00
Mokaddem	5bab1a6f17	Added the click on a part in module stats	2016-07-26 12:12:26 +02:00
Mokaddem	c07c12088d	In moduleStat, display old data if there is no data today and notify the user.	2016-07-26 12:07:52 +02:00
Mokaddem	baa042827d	Removed useless comments + prevent trying to add an already present element in the set	2016-07-26 11:06:31 +02:00
Mokaddem	cc1b49baaf	Fixed variable bug in moduleStats and added draft of credential stats	2016-07-26 10:45:02 +02:00
Mokaddem	06be1f129a	Added Draft of ModuleStats + Paste size average	2016-07-25 16:38:57 +02:00
Mokaddem	b076765cf4	Added dependency flot.time	2016-07-21 16:35:49 +02:00
Mokaddem	7c4f4a2f79	Merge branch 'statistics-v2' into uptodate-statistics-v2	2016-07-21 15:16:03 +02:00
Mokaddem	b685f81752	Merge branch 'duplicate-module' into uptodate-duplicate-module	2016-07-21 14:59:52 +02:00
Mokaddem	9a34a587cc	bug global_tabvar seems solved: ... Caused by a race condition, Just switched two functions execution	2016-07-21 14:53:34 +02:00
Mokaddem	6f4bfeb4ef	restored deleted part of a failed merge-conflict	2016-07-21 14:45:41 +02:00
Mokaddem	37557da8a2	Merge remote-tracking branch 'upstream/master'	2016-07-21 14:04:18 +02:00
Mokaddem	ef76d7aba3	re-ordered tab in trending charts	2016-07-21 13:48:44 +02:00
Mokaddem	0ab7560477	Added top_progression chart for tld, domain and scheme + Small modification in config file.	2016-07-21 13:44:22 +02:00
Raphaël Vinot	d2557aae9a	Update web thirdparty modules	2016-07-20 14:11:39 +02:00
Raphaël Vinot	a0a4d0dff3	Cleanup and remove useless deps	2016-07-19 18:07:29 +02:00
mokaddem	7e5cf7cc55	Added dependency for flot chart	2016-07-19 16:51:29 +02:00
mokaddem	4bc84a2580	Added dependency for flot chart	2016-07-19 16:49:57 +02:00
Raphaël Vinot	8a69110c8e	Merge branch 'webpage-splitting' of https://github.com/mokaddem/AIL-framework into mokaddem-webpage-splitting	2016-07-19 16:35:31 +02:00
Mokaddem	a6996c0b23	Added related functions and display of duplicated paste in search.py	2016-07-19 10:48:44 +02:00
Mokaddem	4ecb9a4b44	Fixed a flexibility issue	2016-07-15 09:47:00 +02:00
Mokaddem	321064bf0d	Fixed a bug in processed_pastes graph	2016-07-14 11:17:08 +02:00
Mokaddem	fba14bfb4b	In index: Added number of processed pastes chart	2016-07-14 11:16:07 +02:00
Mokaddem	60552bca4d	Fixed a bug in processed_pastes graph	2016-07-14 10:31:47 +02:00
Mokaddem	594d2def35	In index: Added number of processed pastes chart	2016-07-13 15:57:33 +02:00
Mokaddem	921da8aeb0	Display the correct active tab in navbar.	2016-07-12 14:44:59 +02:00
Mokaddem	4e4dfb2782	Searching now works in trending graphs.	2016-07-12 14:38:22 +02:00
Mokaddem	6305f1eba7	Deleted redundant code and separeted all trendings chart from the main page.	2016-07-12 14:33:54 +02:00
Mokaddem	7e5ce0f17f	Optimized create_plot and removed test commemts	2016-07-12 11:47:51 +02:00
Mokaddem	4ac448e71e	restored working search>html + Added max curves display to all graphs.	2016-07-12 10:02:01 +02:00
Mokaddem	8cd36982b8	Added a dynamic limit on the number of elements to display. Not fully tested. (recovered old doc, searching not working)	2016-07-11 16:57:45 +02:00
Mokaddem	f6c7917149	Graphs now displayed the highest value. Plotting and filtering is done in its own script.	2016-07-11 15:05:04 +02:00
Mokaddem	880359265c	Renamed tldstrending into trending and added graphics into their respective pannels. Separated graph generation from html source code for wordtrending and protocoltrending	2016-07-08 15:08:37 +02:00
Mokaddem	0174d46788	Added loading GIF when searching and fixed small display bug in modal	2016-07-08 12:09:33 +02:00
Mokaddem	f475f18f06	Added comments and renamed variables and separeted chunks of codes into function	2016-07-08 10:19:24 +02:00
Mokaddem	f846255d84	fixed small sorting problem (date)	2016-07-08 09:16:43 +02:00
Mokaddem	6d760b8dfc	Added dataTable resources in update-third-party.sh	2016-07-08 09:04:19 +02:00
Mokaddem	e206d27f63	Added query search display	2016-07-07 16:43:18 +02:00
Mokaddem	465244e1ce	Added dynamic table sorting in search page. (Still need to add dependencies)	2016-07-07 16:38:00 +02:00
Mokaddem	f1979f6dcb	Search preview modal more dynamic and responsive	2016-07-07 15:34:08 +02:00
Mokaddem	74b337f1a1	search preview modal do not duplicate anymore but still needs improvements	2016-07-07 09:31:04 +02:00
Mokaddem	f29620cf96	Added load more content in search modal preview. Works fine but may duplicate content (need to fix).	2016-07-06 16:54:27 +02:00
Mokaddem	3345124219	Added pannel in search modal + small fix related to config	2016-07-06 14:48:27 +02:00
Mokaddem	9209d48e30	searching now working with preview, details and redirection to the paste display page.	2016-07-06 14:30:32 +02:00
Mokaddem	7ff9b9a583	Added DomainTrending seems working. ... Started search features with related html pages, not finish yet.	2016-07-05 16:53:03 +02:00
Mokaddem	8c1eeea6e6	created new graph pannel for further url stats and dissociate graph script from html	2016-07-04 11:43:38 +02:00
Mokaddem	5a9eca9291	Added few comments	2016-07-04 09:18:23 +02:00
Mokaddem	4b3101b7b6	Added template tld. Modified URL using Faup and refactored WebStats.	2016-07-01 16:59:08 +02:00
Mokaddem	beeeb76de9	Added new modules and started WebTrending web interface	2016-06-30 14:38:28 +02:00
Mokaddem	3dc356dc5e	Getting Started: Initial configuration working on the laptop	2016-06-30 14:36:47 +02:00
Alexandre Dulaunoy	d89ae365f9	web: basic search functionality added	2014-12-24 14:42:20 +00:00
Alexandre Dulaunoy	9b7e329888	Font awesome link fixed	2014-12-22 20:51:05 +00:00
Alexandre Dulaunoy	c2d4e8b437	logo added and layout changed	2014-12-22 17:08:02 +00:00
Alexandre Dulaunoy	dc57454d82	Update start-bootstrap urls	2014-12-22 15:15:56 +00:00
Alexandre Dulaunoy	f15caa70f5	ultag removed	2014-09-17 17:24:08 +02:00
Alexandre Dulaunoy	b36cf76889	Removed ultag	2014-09-17 17:24:08 +02:00
Raphaël Vinot	7542eaf739	Update starting script.	2014-09-02 15:21:36 +02:00
Raphaël Vinot	abfe13436b	Big refactoring, make the queues more flexible	2014-08-29 19:37:56 +02:00
Raphaël Vinot	d7a7da4814	Make sure the webserver fails properly if there is no config file. ... Create the queue list in a more pythonesque fashion.	2014-08-26 17:33:28 +02:00
Alexandre Dulaunoy	1567e452f5	Cleanup: removed unused parameter	2014-08-26 09:25:28 +02:00
Raphaël Vinot	078c8ea836	Big cleanup, pep8	2014-08-14 18:07:18 +02:00
Starow	7a3c216787	Adding a js library for the tag cloud (to install with update_thirdparty.sh	2014-08-14 10:04:39 +02:00
Starow	6cce9f7dac	Javascript modif (Tagclouds) ...	2014-08-13 17:32:24 +02:00
Starow	0d25b960af	logs display modifications	2014-08-13 10:59:47 +02:00
Starow	1df2ffd094	Splitting the graph in two one for words, one for paste monitoring	2014-08-12 16:44:35 +02:00