ail-framework/bin/packages/modules.cfg

[Mixer]
subscribe = ZMQ_Global
publish = Redis_Mixer,Redis_preProcess1

[Global]
subscribe = Redis_Mixer
publish = Redis_Global,Redis_ModuleStats

[PreProcessFeed]
subscribe = Redis_preProcess1
publish = Redis_Mixer

[Duplicates]
subscribe = Redis_Duplicate

[Indexer]
subscribe = Redis_Global

[Attributes]
subscribe = Redis_Global

[Lines]
subscribe = Redis_Global
publish = Redis_LinesShort,Redis_LinesLong

[DomClassifier]
subscribe = Redis_Global

[Tokenize]
subscribe = Redis_LinesShort
publish = Redis_Words

[Curve]
subscribe = Redis_Words
publish = Redis_CurveManageTopSets,Redis_RegexForTermsFrequency

[RegexForTermsFrequency]
subscribe = Redis_RegexForTermsFrequency

[SetForTermsFrequency]
subscribe = Redis_Global

[CurveManageTopSets]
subscribe = Redis_CurveManageTopSets

[Categ]
subscribe = Redis_Global
publish = Redis_CreditCards,Redis_Mail,Redis_Onion,Redis_Web,Redis_Credential,Redis_SourceCode,Redis_Cve

[CreditCards]
subscribe = Redis_CreditCards
publish = Redis_Duplicate,Redis_ModuleStats,Redis_BrowseWarningPaste

[Mail]
subscribe = Redis_Mail
publish = Redis_Duplicate,Redis_ModuleStats,Redis_BrowseWarningPaste

[Onion]
subscribe = Redis_Onion
publish = Redis_ValidOnion,ZMQ_FetchedOnion
#publish = Redis_Global,Redis_ValidOnion,ZMQ_FetchedOnion

[DumpValidOnion]
subscribe = Redis_ValidOnion

[Web]
subscribe = Redis_Web
publish = Redis_Url,ZMQ_Url

[WebStats]
subscribe = Redis_Url

[SQLInjectionDetection]
subscribe = Redis_Url
publish = Redis_BrowseWarningPaste,Redis_Duplicate

[ModuleStats]
subscribe = Redis_ModuleStats

[BrowseWarningPaste]
subscribe = Redis_BrowseWarningPaste

#[send_to_queue]
#subscribe = Redis_Cve
#publish = Redis_BrowseWarningPaste

[SentimentAnalysis]
subscribe = Redis_Global

[Release]
subscribe = Redis_Global

[Credential]
subscribe = Redis_Credential
publish = Redis_Duplicate,Redis_ModuleStats,Redis_BrowseWarningPaste

[Cve]
subscribe = Redis_Cve
publish = Redis_BrowseWarningPaste,Redis_Duplicate

[Phone]
subscribe = Redis_Global
publish = Redis_Duplicate,Redis_BrowseWarningPaste

[Keys]
subscribe = Redis_Global
publish = Redis_Duplicate,Redis_BrowseWarningPaste
Added basic mixer with confirugable behavior. It handles muliple feeders and performs some basic stats on them. 2016-12-23 09:31:26 +00:00			`[Mixer]`
Big refactoring, make the queues more flexible 2014-08-29 17:37:56 +00:00			`subscribe = ZMQ_Global`
Added sleep in helper for multiple listening interfaces (reduce useless work), Added a simple way to pre-process feed before sending it to the global feed. 2017-01-09 13:12:26 +00:00			`publish = Redis_Mixer,Redis_preProcess1`
Added basic mixer with confirugable behavior. It handles muliple feeders and performs some basic stats on them. 2016-12-23 09:31:26 +00:00
			`[Global]`
			`subscribe = Redis_Mixer`
Added Draft of ModuleStats + Paste size average 2016-07-25 14:38:57 +00:00			`publish = Redis_Global,Redis_ModuleStats`
Big refactoring, make the queues more flexible 2014-08-29 17:37:56 +00:00
Added sleep in helper for multiple listening interfaces (reduce useless work), Added a simple way to pre-process feed before sending it to the global feed. 2017-01-09 13:12:26 +00:00			`[PreProcessFeed]`
			`subscribe = Redis_preProcess1`
			`publish = Redis_Mixer`

Big refactoring, make the queues more flexible 2014-08-29 17:37:56 +00:00			`[Duplicates]`
Duplicate module takes its messages from other modules and no more from Global. 2016-07-18 14:22:33 +00:00			`subscribe = Redis_Duplicate`
Big refactoring, make the queues more flexible 2014-08-29 17:37:56 +00:00
			`[Indexer]`
			`subscribe = Redis_Global`

			`[Attributes]`
			`subscribe = Redis_Global`

			`[Lines]`
			`subscribe = Redis_Global`
			`publish = Redis_LinesShort,Redis_LinesLong`

Add Domain Classifier module. Cleanup in the config files. 2014-09-05 08:41:00 +00:00			`[DomClassifier]`
			`subscribe = Redis_Global`

Big refactoring, make the queues more flexible 2014-08-29 17:37:56 +00:00			`[Tokenize]`
			`subscribe = Redis_LinesShort`
			`publish = Redis_Words`

			`[Curve]`
			`subscribe = Redis_Words`
New feature in Terms: regex and set of words support (draft) 2017-03-28 15:42:44 +00:00			`publish = Redis_CurveManageTopSets,Redis_RegexForTermsFrequency`

			`[RegexForTermsFrequency]`
			`subscribe = Redis_RegexForTermsFrequency`

			`[SetForTermsFrequency]`
			`subscribe = Redis_Global`
Added terms trending module and web interface: - Curve module has been rewritten - Added new module curve_manage_top_set - Added all web-pages 2016-08-22 11:35:49 +00:00
			`[CurveManageTopSets]`
			`subscribe = Redis_CurveManageTopSets`
Big refactoring, make the queues more flexible 2014-08-29 17:37:56 +00:00
			`[Categ]`
Categ now listen to the Global queue 2014-09-05 15:05:45 +00:00			`subscribe = Redis_Global`
Getting Started: Initial configuration working on the laptop 2016-06-30 12:36:47 +00:00			`publish = Redis_CreditCards,Redis_Mail,Redis_Onion,Redis_Web,Redis_Credential,Redis_SourceCode,Redis_Cve`
Big refactoring, make the queues more flexible 2014-08-29 17:37:56 +00:00
			`[CreditCards]`
Added script module-dataflow-graph + fixed bug in module.cfg preventing the credential module to receive data. 2016-08-24 09:32:48 +00:00			`subscribe = Redis_CreditCards`
Added warning_paste module and created related webpages. Fixed a Faup bug in credential (multiple instanciation) and added correc populate_set_out in concerned modules (creditcard, credential, ...). Linked browse_warning_paste module and Flask function with redis (created new sets). 2016-08-08 07:17:44 +00:00			`publish = Redis_Duplicate,Redis_ModuleStats,Redis_BrowseWarningPaste`
Big refactoring, make the queues more flexible 2014-08-29 17:37:56 +00:00
			`[Mail]`
			`subscribe = Redis_Mail`
Added warning_paste module and created related webpages. Fixed a Faup bug in credential (multiple instanciation) and added correc populate_set_out in concerned modules (creditcard, credential, ...). Linked browse_warning_paste module and Flask function with redis (created new sets). 2016-08-08 07:17:44 +00:00			`publish = Redis_Duplicate,Redis_ModuleStats,Redis_BrowseWarningPaste`
Big refactoring, make the queues more flexible 2014-08-29 17:37:56 +00:00
			`[Onion]`
			`subscribe = Redis_Onion`
Onion fetching loop deactivated by default 2014-12-22 16:06:38 +00:00			`publish = Redis_ValidOnion,ZMQ_FetchedOnion`
			`#publish = Redis_Global,Redis_ValidOnion,ZMQ_FetchedOnion`
Fix the onion module, log the valid onions. 2014-09-01 14:18:06 +00:00
			`[DumpValidOnion]`
			`subscribe = Redis_ValidOnion`
Big refactoring, make the queues more flexible 2014-08-29 17:37:56 +00:00
			`[Web]`
			`subscribe = Redis_Web`
			`publish = Redis_Url,ZMQ_Url`
Add modules Credential and Release 2016-02-05 15:15:09 +00:00
Getting Started: Initial configuration working on the laptop 2016-06-30 12:36:47 +00:00			`[WebStats]`
			`subscribe = Redis_Url`

Added SQLInjectionDetection module 2016-08-02 13:43:11 +00:00			`[SQLInjectionDetection]`
			`subscribe = Redis_Url`
Added warning_paste module and created related webpages. Fixed a Faup bug in credential (multiple instanciation) and added correc populate_set_out in concerned modules (creditcard, credential, ...). Linked browse_warning_paste module and Flask function with redis (created new sets). 2016-08-08 07:17:44 +00:00			`publish = Redis_BrowseWarningPaste,Redis_Duplicate`
Add modules Credential and Release 2016-02-05 15:15:09 +00:00
Added Draft of ModuleStats + Paste size average 2016-07-25 14:38:57 +00:00			`[ModuleStats]`
			`subscribe = Redis_ModuleStats`
Update module.cfg (adding Keys and Phone section) 2016-02-05 19:00:41 +00:00
Added support of PID in ModuleInformation and index.html 2016-08-26 13:27:37 +00:00			`[BrowseWarningPaste]`
Added warning_paste module and created related webpages. Fixed a Faup bug in credential (multiple instanciation) and added correc populate_set_out in concerned modules (creditcard, credential, ...). Linked browse_warning_paste module and Flask function with redis (created new sets). 2016-08-08 07:17:44 +00:00			`subscribe = Redis_BrowseWarningPaste`

			`#[send_to_queue]`
Prod config 2016-07-25 07:49:14 +00:00			`#subscribe = Redis_Cve`
Added warning_paste module and created related webpages. Fixed a Faup bug in credential (multiple instanciation) and added correc populate_set_out in concerned modules (creditcard, credential, ...). Linked browse_warning_paste module and Flask function with redis (created new sets). 2016-08-08 07:17:44 +00:00			`#publish = Redis_BrowseWarningPaste`

Added draft of filter in sentiment analysis (Discard syntaxical languages) + Added nice tooltip for sparkline. Trending displays avg in function of the number of elements processed and not for the complete week + fixed bug in gauge and canvasjs (was performing avg with only 1 graph instead of all 8). 2016-08-16 14:33:02 +00:00			`[SentimentAnalysis]`
			`subscribe = Redis_Global`
Added sentiment analyser module (draft) 2016-08-13 13:24:57 +00:00
Add modules Credential and Release 2016-02-05 15:15:09 +00:00			`[Release]`
			`subscribe = Redis_Global`
Getting Started: Initial configuration working on the laptop 2016-06-30 12:36:47 +00:00
Add modules Credential and Release 2016-02-05 15:15:09 +00:00			`[Credential]`
Add new category (Credential) 2016-02-10 15:39:56 +00:00			`subscribe = Redis_Credential`
Added warning_paste module and created related webpages. Fixed a Faup bug in credential (multiple instanciation) and added correc populate_set_out in concerned modules (creditcard, credential, ...). Linked browse_warning_paste module and Flask function with redis (created new sets). 2016-08-08 07:17:44 +00:00			`publish = Redis_Duplicate,Redis_ModuleStats,Redis_BrowseWarningPaste`
Update module.cfg (adding Keys and Phone section) 2016-02-05 19:00:41 +00:00
Getting Started: Initial configuration working on the laptop 2016-06-30 12:36:47 +00:00			`[Cve]`
			`subscribe = Redis_Cve`
Fixed bug CVE, CVE was not sending its data to BrowseWarningPaste. 2016-08-08 08:05:21 +00:00			`publish = Redis_BrowseWarningPaste,Redis_Duplicate`
Merge branch 'pgp' of https://github.com/Rafiot/AIL-framework Conflicts: bin/packages/modules.cfg 2016-02-08 09:13:44 +00:00
Update module.cfg (adding Keys and Phone section) 2016-02-05 19:00:41 +00:00			`[Phone]`
			`subscribe = Redis_Global`
Added warning_paste module and created related webpages. Fixed a Faup bug in credential (multiple instanciation) and added correc populate_set_out in concerned modules (creditcard, credential, ...). Linked browse_warning_paste module and Flask function with redis (created new sets). 2016-08-08 07:17:44 +00:00			`publish = Redis_Duplicate,Redis_BrowseWarningPaste`
Merge branch 'pgp' of https://github.com/Rafiot/AIL-framework Conflicts: bin/packages/modules.cfg 2016-02-08 09:13:44 +00:00
Add module to find PGP encrypted blobs 2016-02-05 15:03:37 +00:00			`[Keys]`
			`subscribe = Redis_Global`
Added warning_paste module and created related webpages. Fixed a Faup bug in credential (multiple instanciation) and added correc populate_set_out in concerned modules (creditcard, credential, ...). Linked browse_warning_paste module and Flask function with redis (created new sets). 2016-08-08 07:17:44 +00:00			`publish = Redis_Duplicate,Redis_BrowseWarningPaste`