ail-framework/bin/packages/modules.cfg

[Mixer]
subscribe = ZMQ_Global
publish = Redis_Mixer,Redis_preProcess1

[Importer_Json]
publish = Redis_Mixer,Redis_Tags

[Global]
subscribe = Redis_Mixer
publish = Redis_Global,Redis_ModuleStats

#[PreProcessFeed]
#subscribe = Redis_preProcess1
#publish = Redis_Mixer

[Duplicates]
subscribe = Redis_Duplicate

[Indexer]
subscribe = Redis_Global

[DomClassifier]
subscribe = Redis_Global
publish = Redis_D4_client

[D4_client]
subscribe = Redis_D4_client

[Tracker_Term]
subscribe = Redis_Global
publish = Redis_Tags

[Tracker_Regex]
subscribe = Redis_Global
publish = Redis_Tags

[Tracker_Yara]
subscribe = Redis_Global
publish = Redis_Tags

[Tools]
subscribe = Redis_Global
publish = Redis_Tags

[Telegram]
subscribe = Redis_Global
publish = Redis_Tags

[Languages]
subscribe = Redis_Global

[Categ]
subscribe = Redis_Global
publish = Redis_CreditCards,Redis_Mail,Redis_Onion,Redis_Urls,Redis_Credential,Redis_SourceCode,Redis_Cve,Redis_ApiKey

[CreditCards]
subscribe = Redis_CreditCards
publish = Redis_Duplicate,Redis_ModuleStats,Redis_Tags

[BankAccount]
subscribe = Redis_Global
publish = Redis_Duplicate,Redis_Tags

[Mail]
subscribe = Redis_Mail
publish = Redis_Duplicate,Redis_ModuleStats,Redis_Tags

[Onion]
subscribe = Redis_Onion
publish = Redis_ValidOnion,Redis_Tags,Redis_Crawler
#publish = Redis_ValidOnion,ZMQ_FetchedOnion,Redis_Tags,Redis_Crawler

# TODO remove me
[DumpValidOnion]
subscribe = Redis_ValidOnion

[Urls]
subscribe = Redis_Urls
publish = Redis_Url
#publish = Redis_Url,ZMQ_Url

[LibInjection]
subscribe = Redis_Url
publish = Redis_Duplicate,Redis_Tags

[SQLInjectionDetection]
subscribe = Redis_Url
publish = Redis_Duplicate,Redis_Tags

[ModuleStats]
subscribe = Redis_ModuleStats

[Tags]
subscribe = Redis_Tags
publish = Redis_Tags_feed

[MISP_The_hive_feeder]
subscribe = Redis_Tags_feed

#[send_to_queue]
#subscribe = Redis_Cve
#publish = Redis_Tags

[SentimentAnalysis]
subscribe = Redis_Global

[Release]
subscribe = Redis_Global

[Credential]
subscribe = Redis_Credential
publish = Redis_Duplicate,Redis_ModuleStats,Redis_Tags

[Cve]
subscribe = Redis_Cve
publish = Redis_Duplicate,Redis_Tags

[Phone]
subscribe = Redis_Global
publish = Redis_Duplicate,Redis_Tags

[Keys]
subscribe = Redis_Global
publish = Redis_Duplicate,Redis_PgpDump,Redis_Tags

[PgpDump]
subscribe = Redis_PgpDump
publish = Redis_Duplicate,Redis_Tags

[ApiKey]
subscribe = Redis_ApiKey
publish = Redis_Duplicate,Redis_Tags

[Decoder]
subscribe = Redis_Global
publish = Redis_Duplicate,Redis_Tags

[Bitcoin]
subscribe = Redis_Global
publish = Redis_Duplicate,Redis_Tags

[submit_paste]
subscribe = Redis
publish = Redis_Mixer

[Crawler]
subscribe = Redis_Crawler
publish = Redis_Mixer,Redis_Tags

[IP]
subscribe = Redis_Global
publish = Redis_Duplicate,Redis_Tags
Added basic mixer with confirugable behavior. It handles muliple feeders and performs some basic stats on them. 2016-12-23 09:31:26 +00:00			`[Mixer]`
Big refactoring, make the queues more flexible 2014-08-29 17:37:56 +00:00			`subscribe = ZMQ_Global`
Added sleep in helper for multiple listening interfaces (reduce useless work), Added a simple way to pre-process feed before sending it to the global feed. 2017-01-09 13:12:26 +00:00			`publish = Redis_Mixer,Redis_preProcess1`
Added basic mixer with confirugable behavior. It handles muliple feeders and performs some basic stats on them. 2016-12-23 09:31:26 +00:00
chg: [core import] add AIL JSON import format, API endpoint added (AIL feeders) 2020-04-28 12:14:45 +00:00			`[Importer_Json]`
			`publish = Redis_Mixer,Redis_Tags`

Added basic mixer with confirugable behavior. It handles muliple feeders and performs some basic stats on them. 2016-12-23 09:31:26 +00:00			`[Global]`
			`subscribe = Redis_Mixer`
Added Draft of ModuleStats + Paste size average 2016-07-25 14:38:57 +00:00			`publish = Redis_Global,Redis_ModuleStats`
Big refactoring, make the queues more flexible 2014-08-29 17:37:56 +00:00
fix: [MISP feeder] typo filename-config name 2018-09-21 09:02:08 +00:00			`#[PreProcessFeed]`
			`#subscribe = Redis_preProcess1`
			`#publish = Redis_Mixer`
Added sleep in helper for multiple listening interfaces (reduce useless work), Added a simple way to pre-process feed before sending it to the global feed. 2017-01-09 13:12:26 +00:00
Big refactoring, make the queues more flexible 2014-08-29 17:37:56 +00:00			`[Duplicates]`
Duplicate module takes its messages from other modules and no more from Global. 2016-07-18 14:22:33 +00:00			`subscribe = Redis_Duplicate`
Big refactoring, make the queues more flexible 2014-08-29 17:37:56 +00:00
			`[Indexer]`
			`subscribe = Redis_Global`

Add Domain Classifier module. Cleanup in the config files. 2014-09-05 08:41:00 +00:00			`[DomClassifier]`
			`subscribe = Redis_Global`
chg: [passiveDns D4 Client] add passiveDns D4 Client 2021-03-31 09:25:09 +00:00			`publish = Redis_D4_client`

			`[D4_client]`
			`subscribe = Redis_D4_client`
Add Domain Classifier module. Cleanup in the config files. 2014-09-05 08:41:00 +00:00
chg: [Tracker_Yara module] create module class 2021-06-02 14:04:52 +00:00			`[Tracker_Term]`
fix: [Term Tracker module] chg module flow 2019-08-07 10:19:42 +00:00			`subscribe = Redis_Global`
			`publish = Redis_Tags`

chg: [Tracker_Regex module] create module class + mv module 2021-06-02 14:53:17 +00:00			`[Tracker_Regex]`
Updated TermsFrequency related modules + Fixed bugs (encoding, behaviors, ...) 2017-04-18 13:28:21 +00:00			`subscribe = Redis_Global`
chg: [Terms] tag tracked terms 2018-11-06 12:38:37 +00:00			`publish = Redis_Tags`
New feature in Terms: regex and set of words support (draft) 2017-03-28 15:42:44 +00:00
chg: [trackers] add yara trackers 2020-08-12 07:28:36 +00:00			`[Tracker_Yara]`
			`subscribe = Redis_Global`
			`publish = Redis_Tags`

fix: [Tools] fix loop 2019-09-25 21:48:30 +00:00			`[Tools]`
			`subscribe = Redis_Global`
			`publish = Redis_Tags`

chg [telegram + correlation] new module: telegram (username + login code + join_chat) + add simple_correlation backend 2020-04-10 08:49:21 +00:00			`[Telegram]`
			`subscribe = Redis_Global`
			`publish = Redis_Tags`

chg: [Languages]detect + search domains languages 2020-12-11 20:02:07 +00:00			`[Languages]`
			`subscribe = Redis_Global`

Big refactoring, make the queues more flexible 2014-08-29 17:37:56 +00:00			`[Categ]`
Categ now listen to the Global queue 2014-09-05 15:05:45 +00:00			`subscribe = Redis_Global`
chg: [Urls (Web) module] fix regex + rename 2021-06-07 13:58:21 +00:00			`publish = Redis_CreditCards,Redis_Mail,Redis_Onion,Redis_Urls,Redis_Credential,Redis_SourceCode,Redis_Cve,Redis_ApiKey`
Big refactoring, make the queues more flexible 2014-08-29 17:37:56 +00:00
			`[CreditCards]`
Added script module-dataflow-graph + fixed bug in module.cfg preventing the credential module to receive data. 2016-08-24 09:32:48 +00:00			`subscribe = Redis_CreditCards`
chg: [Tags alertHandler] remove alertHandler + add quick tag search sidebar + use tag last_seen to display tagged items 2019-03-21 10:11:53 +00:00			`publish = Redis_Duplicate,Redis_ModuleStats,Redis_Tags`
Big refactoring, make the queues more flexible 2014-08-29 17:37:56 +00:00
add: [BankAccount] iban detection 2018-07-26 13:31:58 +00:00			`[BankAccount]`
			`subscribe = Redis_Global`
			`publish = Redis_Duplicate,Redis_Tags`

Big refactoring, make the queues more flexible 2014-08-29 17:37:56 +00:00			`[Mail]`
			`subscribe = Redis_Mail`
chg: [Tags alertHandler] remove alertHandler + add quick tag search sidebar + use tag last_seen to display tagged items 2019-03-21 10:11:53 +00:00			`publish = Redis_Duplicate,Redis_ModuleStats,Redis_Tags`
Big refactoring, make the queues more flexible 2014-08-29 17:37:56 +00:00
			`[Onion]`
			`subscribe = Redis_Onion`
fix: [redis cache] remove old Redis_Data_Merging db 2021-02-03 13:58:27 +00:00			`publish = Redis_ValidOnion,Redis_Tags,Redis_Crawler`
			`#publish = Redis_ValidOnion,ZMQ_FetchedOnion,Redis_Tags,Redis_Crawler`
Fix the onion module, log the valid onions. 2014-09-01 14:18:06 +00:00
fix: [redis cache] remove old Redis_Data_Merging db 2021-02-03 13:58:27 +00:00			`# TODO remove me`
Fix the onion module, log the valid onions. 2014-09-01 14:18:06 +00:00			`[DumpValidOnion]`
			`subscribe = Redis_ValidOnion`
Big refactoring, make the queues more flexible 2014-08-29 17:37:56 +00:00
chg: [Urls (Web) module] fix regex + rename 2021-06-07 13:58:21 +00:00			`[Urls]`
			`subscribe = Redis_Urls`
fix: [redis cache] remove old Redis_Data_Merging db 2021-02-03 13:58:27 +00:00			`publish = Redis_Url`
			`#publish = Redis_Url,ZMQ_Url`
Add modules Credential and Release 2016-02-05 15:15:09 +00:00
add LibInjection Module 2018-07-04 12:28:10 +00:00			`[LibInjection]`
			`subscribe = Redis_Url`
chg: [Tags alertHandler] remove alertHandler + add quick tag search sidebar + use tag last_seen to display tagged items 2019-03-21 10:11:53 +00:00			`publish = Redis_Duplicate,Redis_Tags`
add LibInjection Module 2018-07-04 12:28:10 +00:00
Added SQLInjectionDetection module 2016-08-02 13:43:11 +00:00			`[SQLInjectionDetection]`
			`subscribe = Redis_Url`
chg: [Tags alertHandler] remove alertHandler + add quick tag search sidebar + use tag last_seen to display tagged items 2019-03-21 10:11:53 +00:00			`publish = Redis_Duplicate,Redis_Tags`
Add modules Credential and Release 2016-02-05 15:15:09 +00:00
Added Draft of ModuleStats + Paste size average 2016-07-25 14:38:57 +00:00			`[ModuleStats]`
			`subscribe = Redis_ModuleStats`
Update module.cfg (adding Keys and Phone section) 2016-02-05 19:00:41 +00:00
add tag js and css 2018-05-16 12:48:15 +00:00			`[Tags]`
			`subscribe = Redis_Tags`
misp event creation, auto and manual + the hive alert auto creation, manual case creation 2018-06-14 14:51:06 +00:00			`publish = Redis_Tags_feed`

fix: [MISP feeder] typo filename-config name 2018-09-21 09:02:08 +00:00			`[MISP_The_hive_feeder]`
misp event creation, auto and manual + the hive alert auto creation, manual case creation 2018-06-14 14:51:06 +00:00			`subscribe = Redis_Tags_feed`
add tag js and css 2018-05-16 12:48:15 +00:00
Added warning_paste module and created related webpages. Fixed a Faup bug in credential (multiple instanciation) and added correc populate_set_out in concerned modules (creditcard, credential, ...). Linked browse_warning_paste module and Flask function with redis (created new sets). 2016-08-08 07:17:44 +00:00			`#[send_to_queue]`
Prod config 2016-07-25 07:49:14 +00:00			`#subscribe = Redis_Cve`
chg: [Tags alertHandler] remove alertHandler + add quick tag search sidebar + use tag last_seen to display tagged items 2019-03-21 10:11:53 +00:00			`#publish = Redis_Tags`
Added warning_paste module and created related webpages. Fixed a Faup bug in credential (multiple instanciation) and added correc populate_set_out in concerned modules (creditcard, credential, ...). Linked browse_warning_paste module and Flask function with redis (created new sets). 2016-08-08 07:17:44 +00:00
Added draft of filter in sentiment analysis (Discard syntaxical languages) + Added nice tooltip for sparkline. Trending displays avg in function of the number of elements processed and not for the complete week + fixed bug in gauge and canvasjs (was performing avg with only 1 graph instead of all 8). 2016-08-16 14:33:02 +00:00			`[SentimentAnalysis]`
			`subscribe = Redis_Global`
Added sentiment analyser module (draft) 2016-08-13 13:24:57 +00:00
Add modules Credential and Release 2016-02-05 15:15:09 +00:00			`[Release]`
			`subscribe = Redis_Global`
Getting Started: Initial configuration working on the laptop 2016-06-30 12:36:47 +00:00
Add modules Credential and Release 2016-02-05 15:15:09 +00:00			`[Credential]`
Add new category (Credential) 2016-02-10 15:39:56 +00:00			`subscribe = Redis_Credential`
chg: [Tags alertHandler] remove alertHandler + add quick tag search sidebar + use tag last_seen to display tagged items 2019-03-21 10:11:53 +00:00			`publish = Redis_Duplicate,Redis_ModuleStats,Redis_Tags`
Update module.cfg (adding Keys and Phone section) 2016-02-05 19:00:41 +00:00
Getting Started: Initial configuration working on the laptop 2016-06-30 12:36:47 +00:00			`[Cve]`
			`subscribe = Redis_Cve`
chg: [Tags alertHandler] remove alertHandler + add quick tag search sidebar + use tag last_seen to display tagged items 2019-03-21 10:11:53 +00:00			`publish = Redis_Duplicate,Redis_Tags`
Merge branch 'pgp' of https://github.com/Rafiot/AIL-framework Conflicts: bin/packages/modules.cfg 2016-02-08 09:13:44 +00:00
Update module.cfg (adding Keys and Phone section) 2016-02-05 19:00:41 +00:00			`[Phone]`
			`subscribe = Redis_Global`
chg: [Tags alertHandler] remove alertHandler + add quick tag search sidebar + use tag last_seen to display tagged items 2019-03-21 10:11:53 +00:00			`publish = Redis_Duplicate,Redis_Tags`
Merge branch 'pgp' of https://github.com/Rafiot/AIL-framework Conflicts: bin/packages/modules.cfg 2016-02-08 09:13:44 +00:00
Add module to find PGP encrypted blobs 2016-02-05 15:03:37 +00:00			`[Keys]`
			`subscribe = Redis_Global`
chg: [PgpDump] add PgpDump backend TODO: UI 2019-05-14 15:49:31 +00:00			`publish = Redis_Duplicate,Redis_PgpDump,Redis_Tags`

			`[PgpDump]`
			`subscribe = Redis_PgpDump`
chg: [Tags alertHandler] remove alertHandler + add quick tag search sidebar + use tag last_seen to display tagged items 2019-03-21 10:11:53 +00:00			`publish = Redis_Duplicate,Redis_Tags`
add Base64 module 2018-04-20 08:48:44 +00:00
add apiKeys module 2018-04-26 12:42:39 +00:00			`[ApiKey]`
			`subscribe = Redis_ApiKey`
chg: [Tags alertHandler] remove alertHandler + add quick tag search sidebar + use tag last_seen to display tagged items 2019-03-21 10:11:53 +00:00			`publish = Redis_Duplicate,Redis_Tags`
add apiKeys module 2018-04-26 12:42:39 +00:00
fix: decoder bdd 2018-07-20 07:43:09 +00:00			`[Decoder]`
add Base64 module 2018-04-20 08:48:44 +00:00			`subscribe = Redis_Global`
chg: [Tags alertHandler] remove alertHandler + add quick tag search sidebar + use tag last_seen to display tagged items 2019-03-21 10:11:53 +00:00			`publish = Redis_Duplicate,Redis_Tags`
add bitcoin module 2018-04-23 12:51:53 +00:00
			`[Bitcoin]`
			`subscribe = Redis_Global`
chg: [Tags alertHandler] remove alertHandler + add quick tag search sidebar + use tag last_seen to display tagged items 2019-03-21 10:11:53 +00:00			`publish = Redis_Duplicate,Redis_Tags`
submit users input paste 2018-06-05 14:58:04 +00:00
			`[submit_paste]`
fix: [Queues] module with no subscriber 2018-07-24 13:57:18 +00:00			`subscribe = Redis`
submit users input paste 2018-06-05 14:58:04 +00:00			`publish = Redis_Mixer`
chg: [Onion] add onion splash crawler 2018-08-09 15:42:21 +00:00
			`[Crawler]`
			`subscribe = Redis_Crawler`
			`publish = Redis_Mixer,Redis_Tags`
modules.cfg: Minor: Added \n to seperate sections 2019-09-24 08:30:33 +00:00
Added: IP matching module 2019-09-23 16:22:25 +00:00			`[IP]`
			`subscribe = Redis_Global`
			`publish = Redis_Duplicate,Redis_Tags`