AIL/ail-framework
7
0
Fork 0
mirror of https://github.com/ail-project/ail-framework.git synced 2024-11-30 01:37:17 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
2806 commits 8 branches 43 tags 99 MiB
Commit graph

545 commits

Author SHA1 Message Date
Terrtia
afc7cfc77d
chg: [UI show Item] refactoring + bootstrap 4 migration 2020-10-13 16:02:30 +02:00
Terrtia
eec64c3bc7
chg: [UI show domain] add last origin table: domain + item 2020-10-05 14:56:50 +02:00
Terrtia
d8b7ab4de5
chg: [crawler_manager] UI edit config + fix crawler queues 2020-08-24 22:31:41 +02:00
Terrtia
488604ce4e
chg: [config] save config on DB + default values 2020-08-20 13:20:31 +02:00
Terrtia
65f6ee4911
chg: [crawlers manager] show setings 2020-08-18 19:10:38 +02:00
Terrtia
3ea14b29b8
chg: [crawler] show all crawlers type on dashboard 2020-08-17 21:52:57 +02:00
Terrtia
8283488b6d
chg: [submodule + YARA] add submodule auto update + update v3.1.1 2020-08-13 15:15:08 +02:00
Terrtia
e70ae376c5
chg: [trackers] add yara trackers 2020-08-12 09:28:36 +02:00
Terrtia
11c4ba6991
chg: [username correlation + login redirection] add twitter username correlation + redirect to the requested page on login 2020-07-09 17:50:43 +02:00
Terrtia
e938efa8d1
chg: [UI correlation] add username correlation card 2020-05-11 18:13:10 +02:00
Terrtia
19f7d8c1e8
chg: [UI correlation] add username correlation graph 2020-05-11 18:11:38 +02:00
Terrtia
0f7cfe8fb8
chg: [UI correlation] add username correlation: daterange pages 2020-05-11 17:00:37 +02:00
Terrtia
e1d1124396
chg: [AIL logo UI] 2020-04-20 11:56:59 +02:00
Terrtia
0a2d431c74
fix: [Cookiejar UI] fix typo 2020-04-06 16:34:39 +02:00
Terrtia
f97698ad44
Merge branch 'master' into crawler_v2 2020-04-01 09:59:33 +02:00
Terrtia
72f1f15659
chg: [crawler] edit cookie and cookiejar + add cookie to cookiejar + fix screenshot duplicate 2020-04-01 09:58:47 +02:00
Terrtia
5f289f04f3
chg: [Crawler core + UI] crawler lua: handle retry + fix cookie loader and selector 2020-03-30 18:43:50 +02:00
Terrtia
169c4a8ec7
chg: [cookiejar UI] add cookiejar + show all 2020-03-27 17:06:26 +01:00
Terrtia
bdbbcc64c0
fix: [MISP export UI] fix input: name + value overwrite 2020-03-26 18:06:45 +01:00
Terrtia
1f08467777
chg: [domain explorer UI] add shortcut button: misp export + correlation 2020-03-26 11:34:29 +01:00
Terrtia
1ce7b7c2a0
chg: [crawler cookies] use cookiejar 2020-03-26 09:53:07 +01:00
Terrtia
d87ecff4a0
chg: [crawler - cookies] add/show/select cookies 2020-03-24 17:15:43 +01:00
Terrtia
1c45571042
chg: [crawler] add cookies list by user/global, save cookies from file + dict(name, value), TODO: API + handle errors 2020-03-23 18:00:09 +01:00
Terrtia
6cfd3fe36d
chg: [crawler] bypass login: use cookie provided by user and accept cookie from server + refractor 2020-03-20 16:15:25 +01:00
Terrtia
301e7e67d1
chg: [UI MISP export] add object export picker by user 2020-02-19 16:15:41 +01:00
Terrtia
62e3d95f22
merge master => import_export_v1 2020-02-19 09:35:00 +01:00
Terrtia
b8342cfa69
chg: [UI MISP export] export to MISP instance 2020-02-18 17:02:00 +01:00
Terrtia
b0dde78c2e
chg: [UI MISP import]show error +imported uuid/global_id 2020-02-18 13:47:47 +01:00
Terrtia
1b861f55ee
chg: [UI MISP export] add error output 2020-02-18 11:27:00 +01:00
Terrtia
4d0e9a94d0
chg: [UI MISP export] add MISP export 2020-02-17 17:01:16 +01:00
Terrtia
ee15a9b5c6
chg: [UI MISP import] add MISP import 2020-02-17 10:52:25 +01:00
Terrtia
e19a3b3e63
fix: [Domain explorer UI] fix daterange pagination links 2020-02-03 09:37:08 +01:00
Terrtia
b63fa51166
chg: [domain explorer] domains explorer v2, filter domains by daterange 2020-01-24 15:03:04 +01:00
Terrtia
addb885674
chg: [domain core + UI] add domain explorer v1 2020-01-23 15:43:54 +01:00
Terrtia
165119883a
fix: [UI navbar] chg icon decoded tags 2020-01-20 16:48:19 +01:00
Terrtia
9357097d2f
chg: [UI + core] tag decoded items, fix: #455 2020-01-20 16:42:26 +01:00
Terrtia
9394ed7d43
fix: [UI show item min] fix empty modal 2020-01-20 15:19:55 +01:00
Terrtia
2b735e3b97
chg: [UI item tags search] refractor: search item tag by object, use new functions 2020-01-20 15:13:03 +01:00
Terrtia
17ee82d9ba
chg: [UI tags] add + delete image (screenshot) tags 2020-01-14 16:14:58 +01:00
Terrtia
f06551f1a1
chg: [UI tags] add + delete image (screenshot) tags 2020-01-14 16:14:21 +01:00
Terrtia
514911eb62
fix: [UI tags] fix domain links 2020-01-13 11:50:05 +01:00
Terrtia
fb320ca5d5
chg: [UI tags] search domains by tags 2020-01-13 11:10:03 +01:00
Terrtia
99897ffa9b
chg: [core + UI] search domain by tags 2020-01-10 16:52:55 +01:00
Terrtia
3a691a4af3
chg: [tags UI] edit object tags (delete tags) 2020-01-08 17:11:37 +01:00
Terrtia
85d5770e80
chg: [Tag core] objects tagging, Part 2/2 
TODO: UI tags domain + screenshot + object rename paste=>item
 2020-01-07 16:14:56 +01:00
Terrtia
2be06973ee
chg: [Tag core] objects tagging, Part 1/2 2020-01-06 17:07:52 +01:00
Terrtia
9ec610ecc3
chg: [correlation graph UI] add json error handler + add loading status 2019-12-19 11:09:22 +01:00
Terrtia
66f251d654
fix: [UI showDomain] fix screenshot accordeon 2019-12-18 16:45:44 +01:00
Terrtia
7dbc96cee2
chg: [UI correlation graph + UI domain] correlation screenshot: show img in toolip + show hash in ShowDomain 
TODO: pixelate images
 2019-12-18 16:17:29 +01:00
Terrtia
056bad7a49
chg: [screenshot correlation + v2.6] add screenshot-domain correlation + v2.6 update 2019-12-17 15:13:36 +01:00
Terrtia
a3939b77f9
fix: [UI correlation graph] typo 2019-12-16 15:58:57 +01:00
Terrtia
b4f49f9e81
fix: [UI showDomain] fix down domain history 2019-12-16 15:55:50 +01:00
Terrtia
fffb4464c6
fix: [Domain] domain was up 2019-12-16 15:24:47 +01:00
Terrtia
28ece38d82
chg: [API] get domain min metadata (first up, last up) + get crawled domain by daterange and status 2019-12-16 14:31:31 +01:00
Terrtia
d45d02b667
chg: [UI correlation graph] popover: add loading status + chg css 2019-12-10 15:41:47 +01:00
Terrtia
9702c12b7f
chg: [correlation UI] add basic popover 2019-12-09 16:56:07 +01:00
Terrtia
2d02251456
fix: [screenshot canevas + domain link] fix item domain link + screenshot canevas: chg colors and icons for unsafe tags 2019-12-05 10:00:52 +01:00
Terrtia
9898766ed7
fix: [Show Domain UI] fix screenshot link, fix #431 2019-12-02 14:26:59 +01:00
Terrtia
46f6f648a0
chg: [Correlation UI] btc address: get related transaction input/output 2019-11-22 15:30:11 +01:00
Terrtia
00c2b139c6
fix: [Correlation UI] fix decoded file type + exist_correlation_id 2019-11-21 10:32:51 +01:00
Terrtia
69457ca75e
fix: [showDomain UI] fix template 2019-11-20 13:25:01 +01:00
Terrtia
d573dfde1a
fix: [showDomain UI] fix template 2019-11-20 13:16:09 +01:00
Terrtia
8a974eac6c
fix: [showDomain UI] fix template 2019-11-20 13:10:01 +01:00
Terrtia
73afdfa227
chg: [Domain UI] add total_nb_correlation 2019-11-19 14:30:12 +01:00
Terrtia
15bd1cc78f
chg: [Domain UI] add unsafe_tags_check (taxo: dark-web + copine-scale) + hide unsafe domain img 2019-11-19 14:03:23 +01:00
Terrtia
2cdec205c7
fix: [correlation UI] clean script 2019-11-18 16:38:14 +01:00
Terrtia
7d442646c2
chg: [Correlation UI] add metadata card and item link: paste + domain 2019-11-18 16:35:40 +01:00
Terrtia
39be4ef916
chg: [Correlation UI + default taxonomies] add dark-web to default taxonomies + fix domain correlation url 2019-11-18 09:46:15 +01:00
Terrtia
2e921a12f2
chg: [UI] show correlation (pgp. decoded, cryptocurrency) migration 2019-11-15 17:22:50 +01:00
Terrtia
bb03ef532b
chg: [Correlation UI] add correlation blueprint + UI graph correlation 2019-11-14 17:05:58 +01:00
Terrtia
e42ec48380
chg: [Correlation Graph] add correlation by pgp, cryptocurrency, decoded and item + request correlation by type(pgp, ...) + objects(domain, paste) 2019-11-13 16:46:28 +01:00
Terrtia
504e45a43b
chg: [Correlation domain] add correlation graph by domain (union + intersection) 2019-11-12 17:08:52 +01:00
Terrtia
880c351c0c
chg: [update + show decoded items] add background update 2019-11-08 16:00:42 +01:00
Terrtia
6b9ba9d377
chg: [Domain] Show last origin 2019-11-08 09:25:09 +01:00
Terrtia
63b3d5a5f9
fix: [showDomain] fix url pgp + cryptocurrency 2019-11-05 16:53:30 +01:00
Terrtia
c8d5ce9a28
chg: [core] mv bin/packages/config.cfg configs/core.cfg + use ConfigLoader 2019-11-05 15:18:03 +01:00
Terrtia
3c6e424ac3
chg: [UI Domain] UI: tag domain 2019-11-05 09:49:51 +01:00
Terrtia
a3e5e44c9b
chg: [core + UI] refractor Domain + Show Domain, better handle of ports, select screenshot on the UI, ... 2019-10-31 17:14:23 +01:00
Terrtia
a2d6874417
chg: [Domain + UI Crawler] refractor show domain 2019-10-30 17:12:04 +01:00
Terrtia
9051c4081b
fix: [url_prefix] add root blueprint, fix:#403 2019-09-25 08:58:18 +02:00
Terrtia
0ced25f3be
chg: [trackers] filter trackers list by type + minor fix 2019-09-11 15:33:04 +02:00
Terrtia
7ed09bc923
chg: [UI term tracker] refractor term management: trackers list + show trackers + add new trackers 2019-08-14 09:44:49 +02:00
Terrtia
34786d54db
Merge branch 'master' into user_management 2019-07-02 14:12:28 +02:00
Terrtia
3357b855de
fix: [UI items_submit] add active tag + fix template name 2019-06-25 14:18:39 +02:00
Terrtia
9a883aef23
chg: [UI submit items] bootstrap 4 migration 2019-06-25 14:11:30 +02:00
Terrtia
27ae671b3d
fix: [UI login/change_password] add missing ail-logo 2019-06-24 17:14:16 +02:00
Terrtia
c759142ca2
fix: [UI settings] fix toggle_sidebar 2019-06-24 14:37:52 +02:00
Terrtia
bb65179e50
fix: [user_management] fix tokens duplicate + check user_acl_integrity + add login errors messages 2019-06-20 15:49:40 +02:00
Terrtia
a9837c6e27
chg: [user_management 2.0] add update scripts + fix create_default_user 2019-06-20 14:47:59 +02:00
Terrtia
821cf3cbea
chg: [UI user_management] user_role acl: hide admin panel 2019-06-20 11:15:56 +02:00
Terrtia
7ecd43db99
chg: [UI user_management] incorrect passwords: display errors 2019-06-20 10:56:31 +02:00
Terrtia
e4ab9b6a05
fix: [server endpoint] unknow users: avoid endpoint enumeration 2019-06-20 10:11:23 +02:00
Terrtia
ef716f22e5
chg: [user_management endpoint] check user roles + add 503 template 2019-06-19 17:02:09 +02:00
Terrtia
6eec0aabfe
Merge branch 'master' into user_management 2019-06-19 15:11:44 +02:00
Terrtia
34e57fe7af
chg: [user_managemant] clean code + check password and email length 2019-06-19 15:00:25 +02:00
Terrtia
8ca6e1a73c
chg: [UI dashboard + search] bootstrap 4 migration: dashbaord + fix search input 2019-06-18 16:19:27 +02:00
Terrtia
5b58872b15
chg: [user_management UI] add admin section: edit + create users 2019-06-11 17:37:20 +02:00
Terrtia
9c2d290580
chg: [user_management UI] edit my_profile + renew api tokens 2019-06-07 17:14:11 +02:00
Terrtia
3fe9d14e9f
chg: [user_management] create default admin user (temp passwd save in AIL_HOME) + change password UI + logout UI + create random password 2019-06-06 21:27:13 +02:00
Terrtia
99e35c51ec
Merge branch 'master' into user_management 2019-06-05 16:59:36 +02:00
Terrtia
9cb6312279
fix: [UI crawler endpoints] display crawler status + fix #353 2019-06-04 14:22:46 +02:00
Terrtia
bc6332dae4
fix: [correlation] fix endpoint 2019-05-24 13:19:11 +02:00
Terrtia
eb9c81acef
chg: [correlation] clean files 2019-05-24 13:08:10 +02:00
Terrtia
4794cafe01
chg: [correlation] add cryptocurrency + refractor correlation 2019-05-24 12:02:43 +02:00
Terrtia
9639a51abd
chg: [PgpDump] fix graph + add new tags: pgp-signature pgp-public-key-block + avoid keys injection in pgp user_id 2019-05-20 11:57:49 +02:00
Terrtia
7e8ba8cdaf
chg: [decoded UI] add PgpDump UI + fix hashdecoded js 2019-05-17 17:51:07 +02:00
Terrtia
cca69def71
chg: [decoded items] bootstrap 4 migration 2019-05-15 17:23:58 +02:00
Terrtia
1ab1a55a4f
chg: [UI] add basic user management 2019-05-02 17:31:14 +02:00
Terrtia
a183695ddb
chg: [crawler UI] bootstrap 4 migration: show domains by daterange + bug fix hidden services tags 2019-04-26 15:14:29 +02:00
Terrtia
6fdf7c2123
chg: [UI crawler] status/remove auto crawler 2019-04-18 16:57:51 +02:00
Terrtia
4bff603d4f
chg: [settings UI] add background update progress 2019-04-17 14:39:29 +02:00
Terrtia
3b11df7f90
chg: [UI] add server Management, check if new update/version are available + background update status + link to new realease/commits 2019-04-16 17:24:59 +02:00
Terrtia
ddf043059a
chg: [UI] update nav bar endpoint 2019-04-15 17:14:48 +02:00
Terrtia
c2bc72c72e
chg: [Tags alertHandler] remove alertHandler + add quick tag search sidebar + use tag last_seen to display tagged items 2019-03-21 11:11:53 +01:00
Terrtia
23d9cb2265
chg: [UI Tags search] bootstrap 4 migration 2019-03-14 17:04:55 +01:00
Terrtia
9e4813ca4b
chg: [UI Tags] start b4 migration + add date range selector 2019-03-12 13:37:15 +01:00
Terrtia
6f5f880b7d
chg: [Crawler UI] add basic tooltips 2019-03-01 11:40:43 +01:00
Terrtia
93c7db86e4
chg: [Crawler UI Flask] refractor functions, templates 2019-02-28 14:56:14 +01:00
Terrtia
460f70fee6
chg: [css] add basic toggle sidebar 2019-02-27 16:58:17 +01:00
Terrtia
674a9a2591
chg: [UI] font icon v5 + navbar + sidebar 2019-02-08 17:16:58 +01:00
Terrtia
c2885589cf
chg: [UI] basic navbar + sidebar + refractor 2019-02-07 17:22:44 +01:00
Terrtia
8522d50308
modify navbar + decompress file password 2018-06-11 10:21:11 +02:00
=
409eb25a64 Deleted data-flow graph and header.html from the index + Added fixed typo where 10min was in fact 3min 2017-08-21 10:51:56 +02:00
Mokaddem
ef741f85c0 Added similarity checks + started link webInterface 2017-07-19 11:52:06 +02:00
Mokaddem
9b8570e40b Dirty draft webpage credential_tracking 2017-07-17 17:26:19 +02:00
Mokaddem
f1a1e75c32 Restaured old example webpage 2017-07-17 16:18:21 +02:00
Mokaddem
9558aafe67 Prevent the loss of the 1 message in import_dir.py 2017-07-17 16:14:27 +02:00
Mokaddem
71b2757ed2 New script create_new_web_module permits to rapidly create a new pre-configured webpage from a template. 2017-04-25 15:22:04 +02:00
Mokaddem
6afbf77af0 Modified skeleton template name into rawSkeleton + Added possibility to hide modules in the header. 2017-04-25 12:18:08 +02:00
Mokaddem
f6e8582d9d Auto organisation of the navbar -> Web page are auto-inserted. Created skeleton webpage 2017-04-19 15:14:20 +02:00
Mokaddem
32906965d8 Draft of new organisation of the web interface. Usage of Flask's blueprint 2017-04-19 11:02:03 +02:00
Mokaddem
da081bae42 Merge branch 'regexInTerms' into production 2017-04-18 16:59:40 +02:00
Mokaddem
c8baabd882 Updated TermsFrequency related modules + Fixed bugs (encoding, behaviors, ...) 2017-04-18 15:28:21 +02:00
Mokaddem
2da4c572c7 New feature in Terms: regex and set of words support (draft) 2017-03-28 17:42:44 +02:00
Mokaddem
4005b72180 Added backward support + renamed index with timestamp 2017-03-15 11:51:35 +01:00
Mokaddem
381e72ee99 Added display of number of elements inside the index + changed variables names 2017-03-15 10:07:46 +01:00
Mokaddem
e4757f5ceb Added possibility to choose the index in search + Updated search page with jinja2 iter0 2017-03-15 09:39:48 +01:00
Mokaddem
41132fe0bc Added support of per_paste for term-management and plot-term 2017-02-28 15:54:39 +01:00
Mokaddem
4071bf2e91 fixed a bug in manage_term (usage of loop.index0) + fixed bug in top_set where graph was not displaying the correct per_paste value 2017-02-28 15:01:48 +01:00
Mokaddem
25adae0104 Added possibility to select in top_terms the data per_paste or not (need module testing) 2017-02-15 16:29:02 +01:00
Mokaddem
29241eb49f Added a line separator between the two graphs in dashboard. 2017-01-09 14:44:14 +01:00
Mokaddem
0e39f516a9 Added sleep in helper for multiple listening interfaces (reduce useless work), Added a simple way to pre-process feed before sending it to the global feed. 2017-01-09 14:12:26 +01:00
Mokaddem
1c2169d3bc Improved interface for multiple feeds and refresh_script. 2016-12-26 16:16:44 +01:00
Mokaddem
a18c046dea Fixed bug multiple refresh instances and harmonized interface. 2016-12-23 16:15:05 +01:00
Mokaddem
97292e0899 Updated web interface to handle new mixer module. and fixed one dependency bug. 2016-12-23 15:44:46 +01:00
Mokaddem
faa8f8302d Removed typo in the number of remaining pastes to display in browseImportantPaste 2016-12-22 09:28:55 +01:00
Mokaddem
d3ed1bbf40 Merge branch 'website-improvement' into production 2016-12-08 10:05:55 +01:00
Mokaddem
1abba4dcf9 Added support of re-plotting the plotted terms 2016-12-08 08:44:10 +01:00
Mokaddem
84dcd5586f Started plotting same data with different dates 2016-11-25 16:42:22 +01:00
Mokaddem
a3255d168c ModuleInfo correctly handle CurveManageTopSets, 
Changed queue coloring in dashboard,
ModuleInformation now have a history of executed command and better handle module killing.
 2016-11-25 11:54:16 +01:00
Mokaddem
5d269ea1ee Added date in Duplicate for better distinguish duplicate. Also, added a timeout for the dataTable in duplicate inside the modal. 2016-11-24 15:05:29 +01:00
Mokaddem
df8d978088 Added dynamic data loading in dataTable in search.html 2016-11-24 13:31:31 +01:00
Mokaddem
80ca49f018 Prevent browser to request reconnection for the eventStream + Added dynamic data loading in the dataTable of BrowseImportantPastes 2016-11-11 16:51:39 +01:00
Mokaddem
768fb6f2df removed server overhead for paste preview data 2016-11-10 16:41:07 +01:00
Mokaddem
699c819387 fixed bug in show concerned pastes previex en (terms managements) 2016-11-10 16:33:05 +01:00
Mokaddem
94e3034e7d Fixed bun in terms management, where action_button was not bind in other dataTable pages 2016-11-10 15:53:22 +01:00
Mokaddem
7763bfb4c7 Pastes dataTable now display only the latest clicked paste even if there were discarded queries 2016-11-10 15:39:45 +01:00
Mokaddem
2dd69fbb25 Fixed modal background stacking bug + button leading to saved paste bug fixed in search 2016-11-10 14:56:25 +01:00
Mokaddem
317005c2b4 tryed to fix html display problem in tooltip + fixed problem button showPaste in modal not pointing to the paste 2016-11-10 10:30:29 +01:00
Mokaddem
34221b083f Partially solved the browser freezing problem + tootlip is also binded at a new page generation of the DataTable 2016-11-10 09:28:55 +01:00
Mokaddem
acdd1367a3 Added event source for getImportantPaste 2016-10-28 16:55:56 +02:00
Mokaddem
c95000866d Dynamic table in search now load all the data + fixed bugs where tooltip where not shown on other than the first page displayed and 
tooltip interpret html (not supposed to...)
 2016-10-28 14:21:08 +02:00
Mokaddem
f51808d914 Added support of html formatting in search result dynamic loading table 2016-10-28 09:48:22 +02:00
Mokaddem
4be62a4e2d Added draft of dynamic update table with search result 2016-10-28 09:28:42 +02:00
Mokaddem
340624fe1e Fixed bug in modal show paste (show more button not showing) 2016-10-27 16:18:49 +02:00
Mokaddem
7e7e679ab6 Added dataTable for duplicate in show saved paste 2016-10-27 15:53:45 +02:00
Mokaddem
59a7000527 Bootstrap support in show saved paste 2016-10-27 12:38:39 +02:00
Mokaddem
1826b170ec Added support of local paste view in dashboard for Mails event only 2016-10-27 11:27:26 +02:00
Mokaddem
7c8d414948 modified provider name into no data when there is no data 2016-10-14 16:47:22 +02:00
Alexandre Dulaunoy
2781a2f0b7 Stuck not stucked 2016-09-21 08:35:20 +02:00
Mokaddem
79be8ab934 Fixed introduced bug relative to chart in index webpage. 2016-08-26 15:59:53 +02:00
Mokaddem
0c760d763b Added support of PID in ModuleInformation and index.html 2016-08-26 15:27:37 +02:00
Mokaddem
181c372131 Updated dependencies 2016-08-26 11:10:39 +02:00
Mokaddem
07d7559060 Added dataTable support in browse paste modal. 2016-08-26 08:30:09 +02:00
Mokaddem
991176fdfd Suppressed metismenu import. 2016-08-25 16:40:13 +02:00
Mokaddem
0b5a3e0cd2 Auto generate graph div + possibility to query all sentiments data. 2016-08-25 15:06:18 +02:00
Mokaddem
21f2c43572 Individualized sentiments-graph loading 2016-08-25 13:11:16 +02:00
Mokaddem
e3daa84196 Added icon in header 2016-08-23 16:09:34 +02:00
Mokaddem
e12244fb53 Added show/hide curve with legend in terms-top-set. 2016-08-23 15:39:13 +02:00
Mokaddem
e56187eb7e Added position of each top term in the other sets + highligth ones not present. 2016-08-23 14:52:02 +02:00
Mokaddem
a64d447b7b Auto hide button add_to_chart when no data plotted. 2016-08-23 12:09:41 +02:00
Mokaddem
e59b7c4e47 Added tooltip in graph for terms-plot-tool 2016-08-23 12:03:23 +02:00
Mokaddem
0eba419651 Added multiple terms plot in terms-plot-tool. 2016-08-23 11:56:32 +02:00
Mokaddem
9f2d672ec8 harmonized tooltip and popover display 2016-08-23 11:20:48 +02:00
Mokaddem
8c956c22b1 Added autohide curves in terms-top-set. 2016-08-23 11:02:36 +02:00
Mokaddem
32dfd2b181 Moved legend place in term-plot-top 2016-08-23 10:16:33 +02:00
Mokaddem
f9b27e4013 Fixed bug in curve preventing to track concerned_pastes. Now all tracked words are put in lower case. 2016-08-23 09:50:03 +02:00
Mokaddem
1766ced9e6 Fixed potential XSS problem with pastes display in 'search' and 'important_paste_by_module'. 2016-08-23 09:08:17 +02:00
Mokaddem
2fd2c8af39 Removed commented code 2016-08-22 20:59:56 +02:00
Mokaddem
2466f355ab Fixed bug in manage-terms-top-set + added auto sorting in important-paste-by-module 2016-08-22 14:54:37 +02:00
Mokaddem
e144e8e1c6 Fixed bug in terms-management-interface (only display one paste) + removed get_language of all pastes due to the huge overhead. 2016-08-22 13:59:12 +02:00
Mokaddem
d3c0fc5f94 Added terms trending module and web interface: 
- Curve module has been rewritten
- Added new module curve_manage_top_set
- Added all web-pages
 2016-08-22 13:35:49 +02:00
Mokaddem
841e87eb16 Fixed bug in sentiment trending, if there was no data for the avg -> there was one NaN leading to no display in the gauge. 2016-08-20 18:48:24 +02:00
Mokaddem
2ed60cb9bf Fixed typo 2016-08-20 16:44:36 +02:00
Mokaddem
3f1cf705fc Deleted alert() 2016-08-20 16:41:49 +02:00
Mokaddem
1c96eac2e4 Enter simulate button click on input field for terms management and plot tool 2016-08-20 16:38:51 +02:00
Mokaddem
465d18fc73 Added terms-plot tool 2016-08-20 16:23:06 +02:00
Mokaddem
fb3dea6bd2 Finnished terms-plot-top-set. Also added possibility to add terms to track or blacklist. 2016-08-20 15:59:22 +02:00
Mokaddem
a5117d7cad Added top set webpage 2016-08-20 11:46:22 +02:00
Mokaddem
0b6828fb16 Correctly handle and display add or remove a term in term-frequency + started sketch of terms-plot tool. 2016-08-19 16:53:46 +02:00
Mokaddem
8d41b109e7 Added query of the data for the new tracked word 2016-08-19 14:33:01 +02:00
Mokaddem
b78effe779 Added draft of terms_management + Added copyright in readme 2016-08-19 13:34:02 +02:00
Mokaddem
52b7124a6b - Modified redis connection (from levelDB to redis). 
- Added term frequency in curve.
- Modified ModuleStats and WebStats to use redis special command (incrby instead of get-set and zset) and Flask to perform the correct queries.
- Added panel color in sentiment trending
 2016-08-18 15:34:19 +02:00
Mokaddem
24072ece36 Added support of pasteName in search + added header in search.html + supressed mixed indent and trailing in Flask.py 2016-08-17 14:21:31 +02:00
Mokaddem
c10f28d9df Updated isolated launch scripts + Added switch displaying queue in index 2016-08-17 13:46:01 +02:00
Mokaddem
23b65eddca Auto unchecked info checkbox in index 2016-08-17 11:25:05 +02:00
Mokaddem
4d09ab0f6b Modified icon sentiment in web-header. 2016-08-17 11:13:37 +02:00
Mokaddem
c12e67a35a Added tooltips + slight gauge modification 2016-08-17 10:43:43 +02:00
Mokaddem
ecd834ffb6 Added autoreload in sentiment-trending. 2016-08-16 11:27:49 +02:00
Mokaddem
bb677b9061 Added avg text in sentiment-trending + fixed date range bug 2016-08-16 11:23:14 +02:00
Mokaddem
8fa3c2b147 Added stacked choice or not for plot-tool (sentiments) 2016-08-16 10:49:05 +02:00
Mokaddem
4baac0b994 Tool-plot for sentiment working + Splitted script and webpage 2016-08-16 10:31:18 +02:00
Mokaddem
1e7547d16c Created draft of search for plot tool 2016-08-15 16:32:02 +02:00
Mokaddem
88ed8a239d Linked plot button with server 2016-08-15 15:54:53 +02:00
Mokaddem
82f70e61f4 Added provider checkbox 2016-08-15 15:16:31 +02:00
Mokaddem
f90987d284 Added date on slider 2016-08-15 14:53:46 +02:00
Mokaddem
d8c84ec674 Added link to data in analysis trending + fixed tooltip bug in sparkline 2016-08-15 12:57:39 +02:00
Mokaddem
1a5158b081 Added sentiment analyser module (draft) 2016-08-13 15:24:57 +02:00
Mokaddem
0431ecf434 Modified webpage display and added js. 2016-08-12 10:22:24 +02:00
Mokaddem
9c3b573af2 Splited js from html + Added some ID + small display modification. 2016-08-12 07:49:24 +02:00
Mokaddem
87a86b38d1 Added page Plot-tool 2016-08-11 21:08:43 +02:00
Mokaddem
c028ca80da Separated options from the plot funcion for sparkline. 2016-08-11 17:57:23 +02:00
Mokaddem
98c4cacb98 Finished first panel in sentiment-today. 2016-08-11 17:22:50 +02:00
Mokaddem
8682fcc29c Added empty webpages for sentiments modules. 2016-08-11 11:34:22 +02:00
Mokaddem
5612a77af9 Separated webpage header code from all webpage 2016-08-11 10:55:51 +02:00
Mokaddem
0ba5637e06 Added bar chart hover binder in trending charts 2016-08-10 11:16:56 +02:00
Mokaddem
24318f6a86 Added the part 'other' in Trending chartscd 2016-08-10 10:42:06 +02:00
Mokaddem
0d16a8beb7 Fixed bug where Listener was not placed if the row was not displayed (BrowseWarningPaste) 2016-08-09 12:30:40 +02:00
Mokaddem
e2ba4060ee restaured loading gif when new tab is shown (BrowseWarningPaste) 2016-08-09 12:07:20 +02:00
Mokaddem
a80f6ca0c2 Bug fix related with redis: 
Fixed typo key in redis for module creditcard and sqlinjection
Modified Curve redisLvlDb server
Modified Url.py so that it forwards name of protocol from saved protocolsfile
Added Cache control in Flask
Modified key-tab name into keys-tab
 2016-08-09 11:59:36 +02:00
Mokaddem
78c611fead Added warning_paste module and created related webpages. 
Fixed a Faup bug in credential (multiple instanciation) and added correc populate_set_out in concerned modules (creditcard, credential, ...).
Linked browse_warning_paste module and Flask function with redis (created new sets).
 2016-08-08 09:17:44 +02:00
Mokaddem
3523d79a05 Started browse important paste feature. Still need to link with redis. + Fixed a bug in Flask (String to list parser) 2016-08-04 16:57:34 +02:00
Mokaddem
d9316771cd Draft: added new duplicate hash comparison - tlsh 2016-08-04 11:55:38 +02:00
Mokaddem
50d2848a40 Tryed to fix the glob_tabvar bug 2016-08-02 16:39:57 +02:00
Mokaddem
9d37ebc860 Fixed a division by 0 in Flask + Harmonized webpage item positioning 2016-08-02 16:00:31 +02:00
Mokaddem
a827e8ca3a Big refactoring and added lot of comments + fixed bug attaching multiple binder on barChart 2016-07-29 14:30:41 +02:00
Mokaddem
09fdaa3e39 Added tooltip for moduleStats bar chart 2016-07-28 12:06:54 +02:00
Mokaddem
acec508f53 fixed multiple binding bug in moduleStats + Added multiple bar display for 'other pie part' + Added ModuleStats tab in all other pages 2016-07-28 09:52:07 +02:00
Mokaddem
5a02a7ffce Clean up and refactoring for back-end moduleStats 2016-07-27 11:55:57 +02:00
Mokaddem
27e0d5c578 Clean up and refactoring for front-end moduleStats 2016-07-27 11:26:56 +02:00
Mokaddem
240bdd9cca Added number of paste by provider in module stats 2016-07-27 09:27:32 +02:00
Mokaddem
63774cd160 In moduleStats, if there is data which have small percentage, display it in an 'other' part + Added stacked chart for them (still draft) 2016-07-26 16:56:52 +02:00
Mokaddem
5bab1a6f17 Added the click on a part in module stats 2016-07-26 12:12:26 +02:00
Mokaddem
c07c12088d In moduleStat, display old data if there is no data today and notify the user. 2016-07-26 12:07:52 +02:00
Mokaddem
baa042827d Removed useless comments + prevent trying to add an already present element in the set 2016-07-26 11:06:31 +02:00
Mokaddem
cc1b49baaf Fixed variable bug in moduleStats and added draft of credential stats 2016-07-26 10:45:02 +02:00
Mokaddem
06be1f129a Added Draft of ModuleStats + Paste size average 2016-07-25 16:38:57 +02:00
Mokaddem
7c4f4a2f79 Merge branch 'statistics-v2' into uptodate-statistics-v2 2016-07-21 15:16:03 +02:00
Mokaddem
b685f81752 Merge branch 'duplicate-module' into uptodate-duplicate-module 2016-07-21 14:59:52 +02:00
Mokaddem
ef76d7aba3 re-ordered tab in trending charts 2016-07-21 13:48:44 +02:00
Mokaddem
0ab7560477 Added top_progression chart for tld, domain and scheme + Small modification in config file. 2016-07-21 13:44:22 +02:00
Raphaël Vinot
a0a4d0dff3 Cleanup and remove useless deps 2016-07-19 18:07:29 +02:00
Raphaël Vinot
8a69110c8e Merge branch 'webpage-splitting' of https://github.com/mokaddem/AIL-framework into mokaddem-webpage-splitting 2016-07-19 16:35:31 +02:00
Mokaddem
a6996c0b23 Added related functions and display of duplicated paste in search.py 2016-07-19 10:48:44 +02:00
Mokaddem
4ecb9a4b44 Fixed a flexibility issue 2016-07-15 09:47:00 +02:00
Mokaddem
fba14bfb4b In index: Added number of processed pastes chart 2016-07-14 11:16:07 +02:00
Mokaddem
594d2def35 In index: Added number of processed pastes chart 2016-07-13 15:57:33 +02:00
Mokaddem
921da8aeb0 Display the correct active tab in navbar. 2016-07-12 14:44:59 +02:00
Mokaddem
4e4dfb2782 Searching now works in trending graphs. 2016-07-12 14:38:22 +02:00
Mokaddem
6305f1eba7 Deleted redundant code and separeted all trendings chart from the main page. 2016-07-12 14:33:54 +02:00
Mokaddem
7e5ce0f17f Optimized create_plot and removed test commemts 2016-07-12 11:47:51 +02:00
Mokaddem
4ac448e71e restored working search>html + Added max curves display to all graphs. 2016-07-12 10:02:01 +02:00
Mokaddem
8cd36982b8 Added a dynamic limit on the number of elements to display. Not fully tested. (recovered old doc, searching not working) 2016-07-11 16:57:45 +02:00
Mokaddem
f6c7917149 Graphs now displayed the highest value. Plotting and filtering is done in its own script. 2016-07-11 15:05:04 +02:00
Mokaddem
880359265c Renamed tldstrending into trending and added graphics into their respective pannels. Separated graph generation from html source code for wordtrending and protocoltrending 2016-07-08 15:08:37 +02:00
Mokaddem
0174d46788 Added loading GIF when searching and fixed small display bug in modal 2016-07-08 12:09:33 +02:00
Mokaddem
f475f18f06 Added comments and renamed variables and separeted chunks of codes into function 2016-07-08 10:19:24 +02:00
Mokaddem
e206d27f63 Added query search display 2016-07-07 16:43:18 +02:00
Mokaddem
465244e1ce Added dynamic table sorting in search page. (Still need to add dependencies) 2016-07-07 16:38:00 +02:00
Mokaddem
f1979f6dcb Search preview modal more dynamic and responsive 2016-07-07 15:34:08 +02:00
Mokaddem
74b337f1a1 search preview modal do not duplicate anymore but still needs improvements 2016-07-07 09:31:04 +02:00
Mokaddem
f29620cf96 Added load more content in search modal preview. Works fine but may duplicate content (need to fix). 2016-07-06 16:54:27 +02:00
Mokaddem
3345124219 Added pannel in search modal + small fix related to config 2016-07-06 14:48:27 +02:00
Mokaddem
9209d48e30 searching now working with preview, details and redirection to the paste display page. 2016-07-06 14:30:32 +02:00
Mokaddem
7ff9b9a583 Added DomainTrending seems working. 
Started search features with related html pages, not finish yet.
 2016-07-05 16:53:03 +02:00
Mokaddem
8c1eeea6e6 created new graph pannel for further url stats and dissociate graph script from html 2016-07-04 11:43:38 +02:00
Mokaddem
5a9eca9291 Added few comments 2016-07-04 09:18:23 +02:00
Mokaddem
4b3101b7b6 Added template tld. Modified URL using Faup and refactored WebStats. 2016-07-01 16:59:08 +02:00
Mokaddem
beeeb76de9 Added new modules and started WebTrending web interface 2016-06-30 14:38:28 +02:00
Alexandre Dulaunoy
d89ae365f9 web: basic search functionality added 2014-12-24 14:42:20 +00:00
Alexandre Dulaunoy
9b7e329888 Font awesome link fixed 2014-12-22 20:51:05 +00:00
Alexandre Dulaunoy
c2d4e8b437 logo added and layout changed 2014-12-22 17:08:02 +00:00
Alexandre Dulaunoy
b36cf76889 Removed ultag 2014-09-17 17:24:08 +02:00
Starow
6cce9f7dac Javascript modif (Tagclouds) ... 2014-08-13 17:32:24 +02:00
Starow
0d25b960af logs display modifications 2014-08-13 10:59:47 +02:00
Starow
1df2ffd094 Splitting the graph in two one for words, one for paste monitoring 2014-08-12 16:44:35 +02:00
Starow
8d6c2f4288 Improving javascript and Fixing minor curves drawing bug 
Everything now is fully "dynamic"
 2014-08-12 14:00:00 +02:00
Starow
60cfc9789f Adding logging proc time inside the table 2014-08-11 16:29:38 +02:00
Starow
e96be56b82 Checkbox default checked at true. 2014-08-11 15:30:44 +02:00
Starow
25cebf314c Index.html log table modification 2014-08-11 15:07:55 +02:00
Starow
80fe77da26 Making bigger the graph 2014-08-11 13:46:02 +02:00
Starow
a7679787b7 Removing "Dashboard" Title to win some place for displaying infos.. 2014-08-11 13:41:58 +02:00
Starow
edd4ea9624 Queue name tab moved to left side of the dashboard 2014-08-11 11:15:44 +02:00
Starow
2306783882 Updating dashboard navigation menu list 2014-08-11 10:48:03 +02:00
Starow
1379ef705a Initial import of AIL framework - Analysis Information Leak framework 
AIL is a modular framework to analyse potential information leak from unstructured data source like pastes from Past
ebin or similar services. AIL framework is flexible and can be extended to support other functionalities to mine sen
sitive information
 2014-08-06 11:43:40 +02:00