Commit graph

430 commits

Author SHA1 Message Date
Terrtia
92977201fd create json metadata for base64 module 2018-04-27 15:46:41 +02:00
Terrtia
c3428df5dc add apiKeys module 2018-04-26 14:42:39 +02:00
Terrtia
29c368250e create new dashbord alert 2018-04-24 17:03:10 +02:00
Terrtia
8738b7cf75 fix track term and avoid duplicate mail address 2018-04-24 16:44:37 +02:00
Terrtia
a7bd01ed9a Merge branch 'python3' of https://github.com/CIRCL/AIL-framework into python3 2018-04-23 16:22:51 +02:00
Terrtia
4e55f6ee90 fix Onion module 2018-04-23 16:22:23 +02:00
Thirion Aurélien
ef3c335b62
Delete config.cfg.backup 2018-04-23 14:54:23 +02:00
Terrtia
f93fe9aeb2 add bitcoin module 2018-04-23 14:51:53 +02:00
Terrtia
3fc48db903 add Base64 module 2018-04-20 10:48:44 +02:00
Terrtia
41eb250278 fix python 3 compqtibility issues 2018-04-20 10:42:19 +02:00
Terrtia
8571a86344 frontend python 3.5 upgrade 2018-04-17 16:06:32 +02:00
Terrtia
19c90339e0 clean 2018-04-17 09:43:45 +02:00
Terrtia
d0261233aa fix ModulesInnformationV2 2018-04-17 09:37:58 +02:00
Terrtia
15ef02fe53 fix python3 types issue 2018-04-16 17:00:44 +02:00
Terrtia
9e07a0ebdb fix python3 types issue 2018-04-16 15:04:22 +02:00
Terrtia
9c82dd90ec python 3 backend upgrade 2018-04-16 14:50:04 +02:00
Terrtia
3395b16873 fix incoming encoding file issue 2018-04-13 09:17:56 +02:00
Terrtia
347588fdec python3.5 Mixer and Global module 2018-04-12 17:06:57 +02:00
Terrtia
4386cbbd34 fix travis 2018-04-11 10:48:22 +02:00
Terrtia
14583f702f create first test 2018-04-11 10:14:33 +02:00
Terrtia
e9b88b0656 Keys module improvement 2018-04-05 11:40:34 +02:00
CD Nguyen
96259c53bc refactor NotificationHelper code 2018-04-04 09:41:13 +02:00
CD Nguyen
e9e3f17363 support non TSL SMTP servers 2018-03-30 11:35:37 +02:00
Philipp Schmied
29608ab29b Fixed e-mail notificatins for sets and regexes 2018-02-28 11:31:16 +01:00
Philipp Schmied
fd329aaba9 config.cfg.sample: Merged overwritten changes from upstream 2018-02-27 16:16:57 +01:00
Philipp Schmied
5b1f0b0212 Implemented email notifications (bin: config.cfg additions, email sending via analyzer scripts; var: Changes to add notifications via terms management); terms_management: Fixed click handlers not being added to all tracked terms. 2018-02-27 15:12:02 +01:00
abdf41fe23
Merge pull request #164 from mokaddem/showDiff
Show differences between duplicates
2018-02-21 22:25:16 +01:00
0263b25da8
Merge pull request #163 from mokaddem/iss160
Moving more to config
2018-02-21 22:24:50 +01:00
Sami Mokaddem
cbb19f95e4 fix: asciimatics introduced the '_required_height' property in the Label class. Just updating here to mirror the change 2018-02-16 14:35:09 +01:00
Sami Mokaddem
3e117195a2 fix: Added a backoff time if an IOError happens 2018-01-15 17:45:13 +01:00
Sami Mokaddem
9a66a6111b Fixing no such file 2018-01-15 17:10:03 +01:00
Sami Mokaddem
c39e537cbe Merge branch 'iss160' into showDiff
Preemptively preventing merge-conflict with branch iss160 (moving to
configuration)
2017-12-12 11:33:22 +01:00
Sami Mokaddem
05b22e8963 typo: added word + deleted trailing spaces 2017-12-12 11:19:37 +01:00
Sami Mokaddem
ef1bd16a72 typo: added word + deleted trailing spaces 2017-12-12 11:16:40 +01:00
Sami Mokaddem
304213cfa4 update: Possibility to change the authorized max line length in the config for the diff of duplicates 2017-12-12 11:00:26 +01:00
Sami Mokaddem
860acbf7cf fix: Renamed Credentials into Credential sectiont title
config change: By default, zmq listen to both local and CRF
2017-12-12 09:29:15 +01:00
Sami Mokaddem
9d0d0b4303 update: Moved filtering operation (thresholds, number of matching in the
categ file) in the configuration file. It permits to better control the
flow of pastes.
Also set default mixer duplicate filtering to 3 (Do not filter)
2017-12-11 17:28:34 +01:00
Fabien Mathey
3105192312
Allow for multiple entries like 1 2 3 4 5
Should replace the need to type 
1<Enter>2<Enter> 
etc. and allows for 
1 2 3 4 5<Enter>
2017-11-28 15:15:12 +01:00
71922f9def
add: Python script to test if the ZMQ feed works as expected 2017-11-28 09:46:06 +01:00
Sami Mokaddem
83e082e62a update: removed useless comments 2017-11-24 08:57:41 +01:00
Sami Mokaddem
a0d07b1098 feature: try to send data to MISP if keys are provided, else do nothing 2017-11-23 13:47:02 +01:00
Sami Mokaddem
2a967c4d92 update/feature: Max number of duplicate push to MISP + duplicate are pushed as attachment 2017-11-23 07:13:44 +01:00
Sami Mokaddem
805171a8a5 Added a seemingly working version of ailleak to misp 2017-11-20 14:57:25 +01:00
Sami Mokaddem
e0b188c069 Better support of python3 in Helper.py 2017-11-20 14:55:36 +01:00
Sami Mokaddem
1e76e10c01 Support of add_object to a MISP instance 2017-11-20 12:12:53 +01:00
Sami Mokaddem
6f0227a78a Starting support of python3 2017-11-20 12:12:06 +01:00
Sami Mokaddem
ee7759be91 Updated alertHandler and ailleakObject 2017-11-16 11:18:13 +01:00
Sami Mokaddem
5c7c07fbea Merge branch 'launcher_update' into misp_obj 2017-11-16 10:09:05 +01:00
Sami Mokaddem
45a9897020 Added draft support of MISP ail-leak object 2017-11-16 09:52:37 +01:00
Sami Mokaddem
652b00f4b2 Renamed BrowseWarningPaste into alertHandler 2017-11-15 16:15:43 +01:00
Sami Mokaddem
ec7d2d49b2 Added seconds args in import_dir 2017-11-15 16:03:42 +01:00
Sami Mokaddem
13f1c676d6 Added '_AIL' to the end of screen session name to better check an kills sessions. Also, gracefully close redis server + Check 1 time if redis-servers are running. 2017-09-26 16:17:06 +02:00
=
a8dc9231c6 Typo2.. 2017-08-24 16:43:42 +02:00
=
b2d4dd4a1f Typo 2017-08-24 16:43:05 +02:00
=
74ff401e1d Fixed bug: No CR between indexes in all_index.txt file 2017-08-24 16:41:30 +02:00
bb128a5e94 Merge pull request #138 from mokaddem/import_dir_update
Improvement of import_dir
2017-08-24 09:40:52 +02:00
=
429cc96d2a Improvement of import_dir.py. Added feed name parameter, send the correct path (without potential ../) and gzipEncode it if needed. 2017-08-23 15:10:26 +02:00
=
e7c66d1aac Updated individual launch scripts 2017-08-23 12:28:12 +02:00
=
d632335760 Automatically start redis_levelDB with the correct date 2017-08-23 10:16:56 +02:00
=
64ec44085d Dynamically choose correct port for LevelDB in script 2017-08-22 17:52:15 +02:00
=
66d60a1f01 Added LevelDB Curve for 2017 (3017, used for backward compatibility) 2017-08-21 13:54:44 +02:00
=
92adea38d0 Semi-automated directory creation with date as name in LAUNCH and installing_deps 2017-08-21 13:48:02 +02:00
=
bc35747f00 Updated KillAll in LAUNCH 2017-08-21 13:19:26 +02:00
Mokaddem
c3632c7d86 Added operation mode 3 for Mixer (do not filter) and added possibility to recurse through dir for import_dir 2017-08-03 00:34:53 +02:00
Mokaddem
cbb2909156 Added comments 2017-07-20 10:24:48 +02:00
Mokaddem
05417f405c Finished basic link web interface + solved some bugs 2017-07-20 10:04:30 +02:00
Mokaddem
ef741f85c0 Added similarity checks + started link webInterface 2017-07-19 11:52:06 +02:00
Mokaddem
882ab88b00 Draft module + web link 2017-07-18 16:57:15 +02:00
Mokaddem
9558aafe67 Prevent the loss of the 1 message in import_dir.py 2017-07-17 16:14:27 +02:00
Mokaddem
4d59871f00 Merged with previous changes for PR 2017-07-17 13:48:16 +02:00
4986352099 Merge pull request #120 from PaulSec/master
Added Python Phonenumbers module to parse numbers and retrieves stats…
2017-06-08 07:05:52 +02:00
446a97c47a Merge pull request #115 from mokaddem/regexInTerms
New features for terms frequency
2017-06-08 07:04:17 +02:00
Mokaddem
3a4dcd691d Improved description of modules inside the scripts 2017-05-09 11:13:16 +02:00
Paul A
747fff1df1 Added Python Phonenumbers module to parse numbers and retrieves stats from countrycode 2017-05-03 14:25:18 +02:00
Mokaddem
3ea0924120 Improved phone regex to handle end with 4 digits and presence of parenthesis. 2017-04-26 12:41:23 +02:00
Mokaddem
b60e164380 Added support of onion in browseWarningPaste 2017-04-26 11:47:02 +02:00
Mokaddem
318a557c56 Added possibility to keep a backup of the old config + check if config is valid before starting scripts. 2017-04-25 09:32:05 +02:00
Mokaddem
72c1d903eb Merge branch 'newIndexer' into auto-conf 2017-04-25 08:14:31 +02:00
Mokaddem
eccc8fc88b modified check_size timeout + utilisation of shutil instead of os.system() 2017-04-19 16:37:04 +02:00
Mokaddem
da081bae42 Merge branch 'regexInTerms' into production 2017-04-18 16:59:40 +02:00
Mokaddem
2d907ae784 Merge branch 'newIndexer' into auto-conf 2017-04-18 16:20:00 +02:00
Mokaddem
b0f1cf84b7 remplaced usage of global variable by a function param 2017-04-18 16:02:22 +02:00
Mokaddem
6e8509a0ba Removed wierd line 2017-04-18 15:57:07 +02:00
Mokaddem
c8baabd882 Updated TermsFrequency related modules + Fixed bugs (encoding, behaviors, ...) 2017-04-18 15:28:21 +02:00
Mokaddem
2da4c572c7 New feature in Terms: regex and set of words support (draft) 2017-03-28 17:42:44 +02:00
Mokaddem
6e80eb0954 Typo 2017-03-28 09:55:59 +02:00
Mokaddem
c79d4d65c8 Keep original section order while updating 2017-03-28 09:54:24 +02:00
Mokaddem
e225090e07 Added script that checks configuration and may auto-fix it + added missing field in config.cfg.sample 2017-03-15 16:36:51 +01:00
Mokaddem
be93af6f5a Merge branch 'terms-improvements' 2017-03-15 14:55:44 +01:00
Mokaddem
3261eca836 Fixed all_index newline bug + added print of what's happening 2017-03-15 14:29:49 +01:00
Mokaddem
5b7d047622 Changed os.system by os.mkdir + fixed bug during rotation 2017-03-15 14:05:13 +01:00
Mokaddem
adc37ab50e Indexer max size now in config 2017-03-15 12:14:41 +01:00
Mokaddem
4005b72180 Added backward support + renamed index with timestamp 2017-03-15 11:51:35 +01:00
Mokaddem
248469d61e Indexer now create an index_dir when it became too large (search in index not updated yet) 2017-03-14 10:37:31 +01:00
1540b719ed Merge pull request #108 from mokaddem/newModuleInformation
New version of ModuleInformation
2017-03-14 08:29:09 +01:00
Mokaddem
3c9cdac39a Merge branch 'terms-improvements' into production 2017-02-28 16:51:39 +01:00
Mokaddem
dadc872f9f Merge branch 'newModuleInformation' into production 2017-02-28 16:51:08 +01:00
Mokaddem
a2849c1bcd Added a catch for psutils if process get stopped by user 2017-02-28 16:13:01 +01:00
Mokaddem
4071bf2e91 fixed a bug in manage_term (usage of loop.index0) + fixed bug in top_set where graph was not displaying the correct per_paste value 2017-02-28 15:01:48 +01:00
Mokaddem
a1c47d7a13 Merge branch 'production' into terms-improvements 2017-02-28 11:15:56 +01:00