Mokaddem
003c72bd7c
Fixed bug with redis where the inserted key was too long, causing a crash + fixed bug taking min instead of max in terms-top-set
2016-08-22 16:01:42 +02:00
Mokaddem
e144e8e1c6
Fixed bug in terms-management-interface (only display one paste) + removed get_language of all pastes due to the huge overhead.
2016-08-22 13:59:12 +02:00
Mokaddem
d3c0fc5f94
Added terms trending module and web interface:
...
- Curve module has been rewritten
- Added new module curve_manage_top_set
- Added all web-pages
2016-08-22 13:35:49 +02:00
Mokaddem
841e87eb16
Fixed bug in sentiment trending, if there was no data for the avg -> there was one NaN leading to no display in the gauge.
2016-08-20 18:48:24 +02:00
Mokaddem
ee8f26c7c4
In sentiment trending, if there are no providers in the today\'s set, get data from random providers
2016-08-20 18:14:19 +02:00
Mokaddem
465d18fc73
Added terms-plot tool
2016-08-20 16:23:06 +02:00
Mokaddem
fb3dea6bd2
Finnished terms-plot-top-set. Also added possibility to add terms to track or blacklist.
2016-08-20 15:59:22 +02:00
Mokaddem
a5117d7cad
Added top set webpage
2016-08-20 11:46:22 +02:00
Mokaddem
0b6828fb16
Correctly handle and display add or remove a term in term-frequency + started sketch of terms-plot tool.
2016-08-19 16:53:46 +02:00
Mokaddem
8d41b109e7
Added query of the data for the new tracked word
2016-08-19 14:33:01 +02:00
Mokaddem
b78effe779
Added draft of terms_management + Added copyright in readme
2016-08-19 13:34:02 +02:00
Mokaddem
52b7124a6b
- Modified redis connection (from levelDB to redis).
...
- Added term frequency in curve.
- Modified ModuleStats and WebStats to use redis special command (incrby instead of get-set and zset) and Flask to perform the correct queries.
- Added panel color in sentiment trending
2016-08-18 15:34:19 +02:00
Mokaddem
24072ece36
Added support of pasteName in search + added header in search.html + supressed mixed indent and trailing in Flask.py
2016-08-17 14:21:31 +02:00
Mokaddem
1084e45f1b
Added draft of filter in sentiment analysis (Discard syntaxical languages) + Added nice tooltip for sparkline. Trending displays avg in function of the number of elements processed and not for the complete week + fixed bug in gauge and canvasjs (was performing avg with only 1 graph instead of all 8).
2016-08-16 16:33:02 +02:00
Mokaddem
cdd08d7df0
Added all providers for plot_tool in moduleStats + fixed date range bug
2016-08-16 11:07:36 +02:00
Mokaddem
1e7547d16c
Created draft of search for plot tool
2016-08-15 16:32:02 +02:00
Mokaddem
88ed8a239d
Linked plot button with server
2016-08-15 15:54:53 +02:00
Mokaddem
82f70e61f4
Added provider checkbox
2016-08-15 15:16:31 +02:00
Mokaddem
1a5158b081
Added sentiment analyser module (draft)
2016-08-13 15:24:57 +02:00
Mokaddem
8682fcc29c
Added empty webpages for sentiments modules.
2016-08-11 11:34:22 +02:00
Mokaddem
24318f6a86
Added the part 'other' in Trending chartscd
2016-08-10 10:42:06 +02:00
Mokaddem
943016d6ca
Fixed one of the small display bug in DUplicate_ssdeep_v2 (was displaying [tlsh, tlsh] instead of simply tlsh)
2016-08-09 15:06:55 +02:00
Mokaddem
a80f6ca0c2
Bug fix related with redis:
...
Fixed typo key in redis for module creditcard and sqlinjection
Modified Curve redisLvlDb server
Modified Url.py so that it forwards name of protocol from saved protocolsfile
Added Cache control in Flask
Modified key-tab name into keys-tab
2016-08-09 11:59:36 +02:00
Mokaddem
084737dd26
Fixed bug in flask not correctly displaying the number of paste/providers
2016-08-08 11:39:17 +02:00
Mokaddem
78c611fead
Added warning_paste module and created related webpages.
...
Fixed a Faup bug in credential (multiple instanciation) and added correc populate_set_out in concerned modules (creditcard, credential, ...).
Linked browse_warning_paste module and Flask function with redis (created new sets).
2016-08-08 09:17:44 +02:00
Mokaddem
3523d79a05
Started browse important paste feature. Still need to link with redis. + Fixed a bug in Flask (String to list parser)
2016-08-04 16:57:34 +02:00
Mokaddem
55ef917ef1
Added few comments
2016-08-04 12:10:56 +02:00
Mokaddem
d9316771cd
Draft: added new duplicate hash comparison - tlsh
2016-08-04 11:55:38 +02:00
Mokaddem
9d37ebc860
Fixed a division by 0 in Flask + Harmonized webpage item positioning
2016-08-02 16:00:31 +02:00
Mokaddem
feb1717dc6
fixed size bug, which in some cases display the total size instead of the average + few cleanup + commented out log scale in moduleStats.js and added large number division in case of div by 0
2016-07-29 16:52:50 +02:00
Mokaddem
acec508f53
fixed multiple binding bug in moduleStats + Added multiple bar display for 'other pie part' + Added ModuleStats tab in all other pages
2016-07-28 09:52:07 +02:00
Mokaddem
5a02a7ffce
Clean up and refactoring for back-end moduleStats
2016-07-27 11:55:57 +02:00
Mokaddem
240bdd9cca
Added number of paste by provider in module stats
2016-07-27 09:27:32 +02:00
Mokaddem
c07c12088d
In moduleStat, display old data if there is no data today and notify the user.
2016-07-26 12:07:52 +02:00
Mokaddem
06be1f129a
Added Draft of ModuleStats + Paste size average
2016-07-25 16:38:57 +02:00
Mokaddem
7c4f4a2f79
Merge branch 'statistics-v2' into uptodate-statistics-v2
2016-07-21 15:16:03 +02:00
Mokaddem
0ab7560477
Added top_progression chart for tld, domain and scheme + Small modification in config file.
2016-07-21 13:44:22 +02:00
Mokaddem
a6996c0b23
Added related functions and display of duplicated paste in search.py
2016-07-19 10:48:44 +02:00
Mokaddem
594d2def35
In index: Added number of processed pastes chart
2016-07-13 15:57:33 +02:00
Mokaddem
4ac448e71e
restored working search>html + Added max curves display to all graphs.
2016-07-12 10:02:01 +02:00
Mokaddem
8cd36982b8
Added a dynamic limit on the number of elements to display. Not fully tested. (recovered old doc, searching not working)
2016-07-11 16:57:45 +02:00
Mokaddem
880359265c
Renamed tldstrending into trending and added graphics into their respective pannels. Separated graph generation from html source code for wordtrending and protocoltrending
2016-07-08 15:08:37 +02:00
Mokaddem
0174d46788
Added loading GIF when searching and fixed small display bug in modal
2016-07-08 12:09:33 +02:00
Mokaddem
f475f18f06
Added comments and renamed variables and separeted chunks of codes into function
2016-07-08 10:19:24 +02:00
Mokaddem
f846255d84
fixed small sorting problem (date)
2016-07-08 09:16:43 +02:00
Mokaddem
e206d27f63
Added query search display
2016-07-07 16:43:18 +02:00
Mokaddem
465244e1ce
Added dynamic table sorting in search page. (Still need to add dependencies)
2016-07-07 16:38:00 +02:00
Mokaddem
f1979f6dcb
Search preview modal more dynamic and responsive
2016-07-07 15:34:08 +02:00
Mokaddem
f29620cf96
Added load more content in search modal preview. Works fine but may duplicate content (need to fix).
2016-07-06 16:54:27 +02:00
Mokaddem
3345124219
Added pannel in search modal + small fix related to config
2016-07-06 14:48:27 +02:00
Mokaddem
9209d48e30
searching now working with preview, details and redirection to the paste display page.
2016-07-06 14:30:32 +02:00
Mokaddem
7ff9b9a583
Added DomainTrending seems working.
...
Started search features with related html pages, not finish yet.
2016-07-05 16:53:03 +02:00
Mokaddem
4b3101b7b6
Added template tld. Modified URL using Faup and refactored WebStats.
2016-07-01 16:59:08 +02:00
d89ae365f9
web: basic search functionality added
2014-12-24 14:42:20 +00:00
Raphaël Vinot
7542eaf739
Update starting script.
2014-09-02 15:21:36 +02:00
Raphaël Vinot
abfe13436b
Big refactoring, make the queues more flexible
2014-08-29 19:37:56 +02:00
Raphaël Vinot
d7a7da4814
Make sure the webserver fails properly if there is no config file.
...
Create the queue list in a more pythonesque fashion.
2014-08-26 17:33:28 +02:00
1567e452f5
Cleanup: removed unused parameter
2014-08-26 09:25:28 +02:00
Raphaël Vinot
078c8ea836
Big cleanup, pep8
2014-08-14 18:07:18 +02:00
Starow
af827a3402
Removing the hardcoded IP adress
2014-08-08 13:49:38 +02:00
Starow
1379ef705a
Initial import of AIL framework - Analysis Information Leak framework
...
AIL is a modular framework to analyse potential information leak from unstructured data source like pastes from Past
ebin or similar services. AIL framework is flexible and can be extended to support other functionalities to mine sen
sitive information
2014-08-06 11:43:40 +02:00
