AIL/ail-framework
7
0
Fork 0
mirror of https://github.com/ail-project/ail-framework.git synced 2024-11-23 14:37:17 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
916 commits 8 branches 43 tags 99 MiB
Commit graph

321 commits

Author SHA1 Message Date
Mokaddem
03dddbc359 Reduced refresh rate of processed_pastes, synchro graphs and adjusted max on each graphs. 2016-12-23 16:01:30 +01:00
Mokaddem
97292e0899 Updated web interface to handle new mixer module. and fixed one dependency bug. 2016-12-23 15:44:46 +01:00
Mokaddem
faa8f8302d Removed typo in the number of remaining pastes to display in browseImportantPaste 2016-12-22 09:28:55 +01:00
Mokaddem
9df12cdae8 Added sub-flask in a directory 2016-12-22 08:57:45 +01:00
Mokaddem
d30f3ca6c7 Added missing depency datetime in dashboard 2016-12-09 13:53:57 +01:00
Mokaddem
0054be5bab Added missing json dependency in dashboard 2016-12-09 08:50:36 +01:00
Mokaddem
8daa72789e Splitted Flask_server into module related to website sections 2016-12-09 08:46:37 +01:00
Mokaddem
d3ed1bbf40 Merge branch 'website-improvement' into production 2016-12-08 10:05:55 +01:00
Mokaddem
1abba4dcf9 Added support of re-plotting the plotted terms 2016-12-08 08:44:10 +01:00
Mokaddem
84dcd5586f Started plotting same data with different dates 2016-11-25 16:42:22 +01:00
Mokaddem
a3255d168c ModuleInfo correctly handle CurveManageTopSets, 
Changed queue coloring in dashboard,
ModuleInformation now have a history of executed command and better handle module killing.
 2016-11-25 11:54:16 +01:00
Mokaddem
5d269ea1ee Added date in Duplicate for better distinguish duplicate. Also, added a timeout for the dataTable in duplicate inside the modal. 2016-11-24 15:05:29 +01:00
Mokaddem
df8d978088 Added dynamic data loading in dataTable in search.html 2016-11-24 13:31:31 +01:00
Mokaddem
80ca49f018 Prevent browser to request reconnection for the eventStream + Added dynamic data loading in the dataTable of BrowseImportantPastes 2016-11-11 16:51:39 +01:00
Mokaddem
768fb6f2df removed server overhead for paste preview data 2016-11-10 16:41:07 +01:00
Mokaddem
699c819387 fixed bug in show concerned pastes previex en (terms managements) 2016-11-10 16:33:05 +01:00
Mokaddem
94e3034e7d Fixed bun in terms management, where action_button was not bind in other dataTable pages 2016-11-10 15:53:22 +01:00
Mokaddem
7763bfb4c7 Pastes dataTable now display only the latest clicked paste even if there were discarded queries 2016-11-10 15:39:45 +01:00
Mokaddem
2dd69fbb25 Fixed modal background stacking bug + button leading to saved paste bug fixed in search 2016-11-10 14:56:25 +01:00
Mokaddem
317005c2b4 tryed to fix html display problem in tooltip + fixed problem button showPaste in modal not pointing to the paste 2016-11-10 10:30:29 +01:00
Mokaddem
34221b083f Partially solved the browser freezing problem + tootlip is also binded at a new page generation of the DataTable 2016-11-10 09:28:55 +01:00
Mokaddem
acdd1367a3 Added event source for getImportantPaste 2016-10-28 16:55:56 +02:00
Mokaddem
c95000866d Dynamic table in search now load all the data + fixed bugs where tooltip where not shown on other than the first page displayed and 
tooltip interpret html (not supposed to...)
 2016-10-28 14:21:08 +02:00
Mokaddem
f51808d914 Added support of html formatting in search result dynamic loading table 2016-10-28 09:48:22 +02:00
Mokaddem
4be62a4e2d Added draft of dynamic update table with search result 2016-10-28 09:28:42 +02:00
Mokaddem
340624fe1e Fixed bug in modal show paste (show more button not showing) 2016-10-27 16:18:49 +02:00
Mokaddem
7e7e679ab6 Added dataTable for duplicate in show saved paste 2016-10-27 15:53:45 +02:00
Mokaddem
59a7000527 Bootstrap support in show saved paste 2016-10-27 12:38:39 +02:00
Mokaddem
ac254e0e63 Added support of browsing concerned paste in dashboard for all modules + Show in the page what was the concerned module 2016-10-27 11:50:24 +02:00
Mokaddem
1826b170ec Added support of local paste view in dashboard for Mails event only 2016-10-27 11:27:26 +02:00
Mokaddem
7c8d414948 modified provider name into no data when there is no data 2016-10-14 16:47:22 +02:00
Mokaddem
91678179fd Added msgs when queues or feed is not running/coming 2016-10-14 16:33:54 +02:00
Alexandre Dulaunoy
2781a2f0b7 Stuck not stucked 2016-09-21 08:35:20 +02:00
Jerome St-Hilaire
ea13f87c2c Fixed dependency fetching for the web interface 2016-09-15 12:14:55 -07:00
Raphaël Vinot
acfe9c1336 Update Flask_server.py 2016-08-26 18:06:48 +02:00
Raphaël Vinot
3290b51c91 Update update_thirdparty.sh 2016-08-26 18:05:18 +02:00
Mokaddem
79be8ab934 Fixed introduced bug relative to chart in index webpage. 2016-08-26 15:59:53 +02:00
Mokaddem
0c760d763b Added support of PID in ModuleInformation and index.html 2016-08-26 15:27:37 +02:00
Mokaddem
5c565068a6 Removed auto-reload in dashboard if window in undefined 2016-08-26 11:25:11 +02:00
Mokaddem
181c372131 Updated dependencies 2016-08-26 11:10:39 +02:00
Mokaddem
4cb3b672be Added comments 2016-08-26 10:28:35 +02:00
Mokaddem
86b655100e Deleted useless parsing function 2016-08-26 10:01:14 +02:00
Mokaddem
07d7559060 Added dataTable support in browse paste modal. 2016-08-26 08:30:09 +02:00
Mokaddem
813cc7031a Changed lots of code into zrank 2016-08-25 17:48:12 +02:00
Mokaddem
991176fdfd Suppressed metismenu import. 2016-08-25 16:40:13 +02:00
Mokaddem
fb22816236 Added module number info in index webpage 2016-08-25 16:27:32 +02:00
Mokaddem
0b5a3e0cd2 Auto generate graph div + possibility to query all sentiments data. 2016-08-25 15:06:18 +02:00
Mokaddem
21f2c43572 Individualized sentiments-graph loading 2016-08-25 13:11:16 +02:00
Mokaddem
f9bf00f022 Removed autokill feature if not specified 2016-08-25 11:09:31 +02:00
Mokaddem
611454ba82 Added color in web-index reprenting modules states. 2016-08-24 18:00:05 +02:00
Mokaddem
e3daa84196 Added icon in header 2016-08-23 16:09:34 +02:00
Mokaddem
e12244fb53 Added show/hide curve with legend in terms-top-set. 2016-08-23 15:39:13 +02:00
Mokaddem
e56187eb7e Added position of each top term in the other sets + highligth ones not present. 2016-08-23 14:52:02 +02:00
Mokaddem
a64d447b7b Auto hide button add_to_chart when no data plotted. 2016-08-23 12:09:41 +02:00
Mokaddem
e59b7c4e47 Added tooltip in graph for terms-plot-tool 2016-08-23 12:03:23 +02:00
Mokaddem
0eba419651 Added multiple terms plot in terms-plot-tool. 2016-08-23 11:56:32 +02:00
Mokaddem
9f2d672ec8 harmonized tooltip and popover display 2016-08-23 11:20:48 +02:00
Mokaddem
8c956c22b1 Added autohide curves in terms-top-set. 2016-08-23 11:02:36 +02:00
Mokaddem
32dfd2b181 Moved legend place in term-plot-top 2016-08-23 10:16:33 +02:00
Mokaddem
f9b27e4013 Fixed bug in curve preventing to track concerned_pastes. Now all tracked words are put in lower case. 2016-08-23 09:50:03 +02:00
Mokaddem
1766ced9e6 Fixed potential XSS problem with pastes display in 'search' and 'important_paste_by_module'. 2016-08-23 09:08:17 +02:00
Mokaddem
047331df3e Added save of paste_baseName in set for searches. This is done in ModuleStats to not surcharge the Global module. 2016-08-23 08:52:54 +02:00
Mokaddem
6be557890c Replaced negative hour by 24h based. 2016-08-23 07:19:51 +02:00
Mokaddem
85ab0e36ff In sentiment analysis. if today top provider set is empty, try to take yesterday data and then takes from all_providers. 2016-08-23 07:11:03 +02:00
Mokaddem
8359a6668f Suppressed useless comms 2016-08-22 21:36:19 +02:00
Mokaddem
2fd2c8af39 Removed commented code 2016-08-22 20:59:56 +02:00
Mokaddem
27ae577e00 Fixed stupid line remove in index.html... 2016-08-22 16:25:52 +02:00
Mokaddem
a424069c64 Fixed bug in flask with zrange (was taking the bottom of the set instead of the top leading to get only the min instead of max) 2016-08-22 16:12:20 +02:00
Mokaddem
003c72bd7c Fixed bug with redis where the inserted key was too long, causing a crash + fixed bug taking min instead of max in terms-top-set 2016-08-22 16:01:42 +02:00
Mokaddem
2466f355ab Fixed bug in manage-terms-top-set + added auto sorting in important-paste-by-module 2016-08-22 14:54:37 +02:00
Mokaddem
e144e8e1c6 Fixed bug in terms-management-interface (only display one paste) + removed get_language of all pastes due to the huge overhead. 2016-08-22 13:59:12 +02:00
Mokaddem
d3c0fc5f94 Added terms trending module and web interface: 
- Curve module has been rewritten
- Added new module curve_manage_top_set
- Added all web-pages
 2016-08-22 13:35:49 +02:00
Mokaddem
841e87eb16 Fixed bug in sentiment trending, if there was no data for the avg -> there was one NaN leading to no display in the gauge. 2016-08-20 18:48:24 +02:00
Mokaddem
ee8f26c7c4 In sentiment trending, if there are no providers in the today\'s set, get data from random providers 2016-08-20 18:14:19 +02:00
Mokaddem
2ed60cb9bf Fixed typo 2016-08-20 16:44:36 +02:00
Mokaddem
3f1cf705fc Deleted alert() 2016-08-20 16:41:49 +02:00
Mokaddem
1c96eac2e4 Enter simulate button click on input field for terms management and plot tool 2016-08-20 16:38:51 +02:00
Mokaddem
465d18fc73 Added terms-plot tool 2016-08-20 16:23:06 +02:00
Mokaddem
fb3dea6bd2 Finnished terms-plot-top-set. Also added possibility to add terms to track or blacklist. 2016-08-20 15:59:22 +02:00
Mokaddem
a5117d7cad Added top set webpage 2016-08-20 11:46:22 +02:00
Mokaddem
0b6828fb16 Correctly handle and display add or remove a term in term-frequency + started sketch of terms-plot tool. 2016-08-19 16:53:46 +02:00
Mokaddem
8d41b109e7 Added query of the data for the new tracked word 2016-08-19 14:33:01 +02:00
Mokaddem
b78effe779 Added draft of terms_management + Added copyright in readme 2016-08-19 13:34:02 +02:00
Mokaddem
52b7124a6b - Modified redis connection (from levelDB to redis). 
- Added term frequency in curve.
- Modified ModuleStats and WebStats to use redis special command (incrby instead of get-set and zset) and Flask to perform the correct queries.
- Added panel color in sentiment trending
 2016-08-18 15:34:19 +02:00
Mokaddem
24072ece36 Added support of pasteName in search + added header in search.html + supressed mixed indent and trailing in Flask.py 2016-08-17 14:21:31 +02:00
Mokaddem
c10f28d9df Updated isolated launch scripts + Added switch displaying queue in index 2016-08-17 13:46:01 +02:00
Mokaddem
23b65eddca Auto unchecked info checkbox in index 2016-08-17 11:25:05 +02:00
Mokaddem
4d09ab0f6b Modified icon sentiment in web-header. 2016-08-17 11:13:37 +02:00
Mokaddem
44f54b7b81 Added dependencies 2016-08-17 11:04:48 +02:00
Mokaddem
f0b527167a Added script flexgauge 2016-08-17 10:50:30 +02:00
Mokaddem
c12e67a35a Added tooltips + slight gauge modification 2016-08-17 10:43:43 +02:00
Mokaddem
894b9efda9 Added drop of really long line in sentiment-analysis module + Added description of sentiment module. Also, fixed bug in webpage sentiement-trending concerning avg and date range. 2016-08-17 09:46:25 +02:00
Mokaddem
1084e45f1b Added draft of filter in sentiment analysis (Discard syntaxical languages) + Added nice tooltip for sparkline. Trending displays avg in function of the number of elements processed and not for the complete week + fixed bug in gauge and canvasjs (was performing avg with only 1 graph instead of all 8). 2016-08-16 16:33:02 +02:00
Mokaddem
ecd834ffb6 Added autoreload in sentiment-trending. 2016-08-16 11:27:49 +02:00
Mokaddem
bb677b9061 Added avg text in sentiment-trending + fixed date range bug 2016-08-16 11:23:14 +02:00
Mokaddem
cdd08d7df0 Added all providers for plot_tool in moduleStats + fixed date range bug 2016-08-16 11:07:36 +02:00
Mokaddem
8fa3c2b147 Added stacked choice or not for plot-tool (sentiments) 2016-08-16 10:49:05 +02:00
Mokaddem
4baac0b994 Tool-plot for sentiment working + Splitted script and webpage 2016-08-16 10:31:18 +02:00
Mokaddem
1e7547d16c Created draft of search for plot tool 2016-08-15 16:32:02 +02:00
Mokaddem
88ed8a239d Linked plot button with server 2016-08-15 15:54:53 +02:00
Mokaddem
82f70e61f4 Added provider checkbox 2016-08-15 15:16:31 +02:00
Mokaddem
f90987d284 Added date on slider 2016-08-15 14:53:46 +02:00
Mokaddem
d8c84ec674 Added link to data in analysis trending + fixed tooltip bug in sparkline 2016-08-15 12:57:39 +02:00
Mokaddem
6c7f660052 Added support of week and day average. 2016-08-13 22:17:11 +02:00
Mokaddem
1a5158b081 Added sentiment analyser module (draft) 2016-08-13 15:24:57 +02:00
Mokaddem
0431ecf434 Modified webpage display and added js. 2016-08-12 10:22:24 +02:00
Mokaddem
9c3b573af2 Splited js from html + Added some ID + small display modification. 2016-08-12 07:49:24 +02:00
Mokaddem
87a86b38d1 Added page Plot-tool 2016-08-11 21:08:43 +02:00
Mokaddem
c028ca80da Separated options from the plot funcion for sparkline. 2016-08-11 17:57:23 +02:00
Mokaddem
98c4cacb98 Finished first panel in sentiment-today. 2016-08-11 17:22:50 +02:00
Mokaddem
8682fcc29c Added empty webpages for sentiments modules. 2016-08-11 11:34:22 +02:00
Mokaddem
5612a77af9 Separated webpage header code from all webpage 2016-08-11 10:55:51 +02:00
Mokaddem
0ba5637e06 Added bar chart hover binder in trending charts 2016-08-10 11:16:56 +02:00
Mokaddem
24318f6a86 Added the part 'other' in Trending chartscd 2016-08-10 10:42:06 +02:00
Mokaddem
1ca8cf69f6 Added trendingchart.js 2016-08-10 09:38:15 +02:00
Mokaddem
b249676fe9 Removed console log 2016-08-09 16:54:53 +02:00
Mokaddem
507c83e06d In index webpage, reset value graph if no paste received 2016-08-09 16:48:57 +02:00
Mokaddem
943016d6ca Fixed one of the small display bug in DUplicate_ssdeep_v2 (was displaying [tlsh, tlsh] instead of simply tlsh) 2016-08-09 15:06:55 +02:00
Mokaddem
0d16a8beb7 Fixed bug where Listener was not placed if the row was not displayed (BrowseWarningPaste) 2016-08-09 12:30:40 +02:00
Mokaddem
e2ba4060ee restaured loading gif when new tab is shown (BrowseWarningPaste) 2016-08-09 12:07:20 +02:00
Mokaddem
a80f6ca0c2 Bug fix related with redis: 
Fixed typo key in redis for module creditcard and sqlinjection
Modified Curve redisLvlDb server
Modified Url.py so that it forwards name of protocol from saved protocolsfile
Added Cache control in Flask
Modified key-tab name into keys-tab
 2016-08-09 11:59:36 +02:00
Mokaddem
084737dd26 Fixed bug in flask not correctly displaying the number of paste/providers 2016-08-08 11:39:17 +02:00
Mokaddem
78c611fead Added warning_paste module and created related webpages. 
Fixed a Faup bug in credential (multiple instanciation) and added correc populate_set_out in concerned modules (creditcard, credential, ...).
Linked browse_warning_paste module and Flask function with redis (created new sets).
 2016-08-08 09:17:44 +02:00
Mokaddem
3523d79a05 Started browse important paste feature. Still need to link with redis. + Fixed a bug in Flask (String to list parser) 2016-08-04 16:57:34 +02:00
Mokaddem
55ef917ef1 Added few comments 2016-08-04 12:10:56 +02:00
Mokaddem
d9316771cd Draft: added new duplicate hash comparison - tlsh 2016-08-04 11:55:38 +02:00
Mokaddem
50d2848a40 Tryed to fix the glob_tabvar bug 2016-08-02 16:39:57 +02:00
Mokaddem
9e82ec82b7 Fixed a bug in the hover of provider graph (happened when there was an 'other' in other graphs) 2016-08-02 16:17:25 +02:00
Mokaddem
9d37ebc860 Fixed a division by 0 in Flask + Harmonized webpage item positioning 2016-08-02 16:00:31 +02:00
Mokaddem
f3cf2f853a Fixed a bug in the hover of providers graph. 
When we click on a part in providers graphs, we hover an item, then we click on a random part not belonging to providers graphs, and we re-hover one part of the providers graphs, there was an undefined variable (The random click overrided it).
 2016-08-01 11:08:53 +02:00
Mokaddem
feb1717dc6 fixed size bug, which in some cases display the total size instead of the average + few cleanup + commented out log scale in moduleStats.js and added large number division in case of div by 0 2016-07-29 16:52:50 +02:00
Mokaddem
a827e8ca3a Big refactoring and added lot of comments + fixed bug attaching multiple binder on barChart 2016-07-29 14:30:41 +02:00
Mokaddem
e8fae17cfd Fixed small race condition bug in ModuleStat.py and Added highlight of bar belonging to the same serie in moduleStats.js 2016-07-29 10:36:44 +02:00
Mokaddem
c2bf2ba630 Added tooltip in moduleStat above each bar chart + Added highlight of the selected bar. (Still not working for category 'Other') 2016-07-28 16:35:30 +02:00
Mokaddem
09fdaa3e39 Added tooltip for moduleStats bar chart 2016-07-28 12:06:54 +02:00
Mokaddem
acec508f53 fixed multiple binding bug in moduleStats + Added multiple bar display for 'other pie part' + Added ModuleStats tab in all other pages 2016-07-28 09:52:07 +02:00
Mokaddem
5a02a7ffce Clean up and refactoring for back-end moduleStats 2016-07-27 11:55:57 +02:00
Mokaddem
27e0d5c578 Clean up and refactoring for front-end moduleStats 2016-07-27 11:26:56 +02:00
Mokaddem
240bdd9cca Added number of paste by provider in module stats 2016-07-27 09:27:32 +02:00
Mokaddem
63774cd160 In moduleStats, if there is data which have small percentage, display it in an 'other' part + Added stacked chart for them (still draft) 2016-07-26 16:56:52 +02:00
Mokaddem
5bab1a6f17 Added the click on a part in module stats 2016-07-26 12:12:26 +02:00
Mokaddem
c07c12088d In moduleStat, display old data if there is no data today and notify the user. 2016-07-26 12:07:52 +02:00
Mokaddem
baa042827d Removed useless comments + prevent trying to add an already present element in the set 2016-07-26 11:06:31 +02:00
Mokaddem
cc1b49baaf Fixed variable bug in moduleStats and added draft of credential stats 2016-07-26 10:45:02 +02:00
Mokaddem
06be1f129a Added Draft of ModuleStats + Paste size average 2016-07-25 16:38:57 +02:00
Mokaddem
b076765cf4 Added dependency flot.time 2016-07-21 16:35:49 +02:00
Mokaddem
7c4f4a2f79 Merge branch 'statistics-v2' into uptodate-statistics-v2 2016-07-21 15:16:03 +02:00
Mokaddem
b685f81752 Merge branch 'duplicate-module' into uptodate-duplicate-module 2016-07-21 14:59:52 +02:00
Mokaddem
9a34a587cc bug global_tabvar seems solved: 
Caused by a race condition, Just switched two functions execution
 2016-07-21 14:53:34 +02:00
Mokaddem
6f4bfeb4ef restored deleted part of a failed merge-conflict 2016-07-21 14:45:41 +02:00