ail-framework/OVERVIEW.md

62 lines
1.7 KiB
Markdown
Raw Normal View History

2017-05-03 12:25:58 +00:00
Overview
========
Redis and ARDB overview
2017-05-03 12:25:58 +00:00
--------------------------
2017-05-03 12:42:37 +00:00
* Redis on TCP port 6379
- DB 0 - Cache hostname/dns
- DB 1 - Paste meta-data
2017-05-03 12:25:58 +00:00
* Redis on TCP port 6380 - Redis Log only
2017-05-03 12:42:37 +00:00
* Redis on TCP port 6381
- DB 0 - PubSub + Queue and Paste content LRU cache
- DB 1 - _Mixer_ Cache
2018-06-20 08:48:13 +00:00
* ARDB on TCP port 6382
2017-05-03 12:42:37 +00:00
- DB 1 - Curve
- DB 2 - Trending
- DB 3 - Terms
- DB 4 - Sentiments
2018-06-20 08:48:13 +00:00
* ARDB on TCP port <year>
2017-05-03 12:42:37 +00:00
- DB 0 - Lines duplicate
2018-06-20 08:48:13 +00:00
- DB 1 - Hashes
2017-05-03 12:25:58 +00:00
ARDB overview
---------------------------
* DB 7 - Metadata:
----------------------------------------- BASE64 ----------------------------------------
HSET - 'metadata_hash:'+hash 'saved_path' saved_path
'size' size
'first_seen' first_seen
'last_seen' last_seen
'estimated_type' estimated_type
'vt_link' vt_link
'vt_report' vt_report
'nb_seen_in_all_pastes' nb_seen_in_all_pastes
2018-07-20 08:32:52 +00:00
'base64_decoder' nb_encoded
'binary_decoder' nb_encoded
SET - 'all_decoder' decoder*
SET - 'hash_all_type' hash_type *
2018-07-18 09:45:19 +00:00
SET - 'hash_base64_all_type' hash_type *
SET - 'hash_binary_all_type' hash_type *
2018-07-20 07:43:09 +00:00
SET - 'hash_paste:'+paste hash *
SET - 'base64_paste:'+paste hash *
2018-07-18 09:45:19 +00:00
SET - 'binary_paste:'+paste hash *
2018-07-20 07:43:09 +00:00
ZADD - 'hash_date:'+20180622 hash * nb_seen_this_day
ZADD - 'base64_date:'+20180622 hash * nb_seen_this_day
ZADD - 'binary_date:'+20180622 hash * nb_seen_this_day
2018-07-20 07:43:09 +00:00
ZADD - 'nb_seen_hash:'+hash paste * nb_seen_in_paste
ZADD - 'base64_hash:'+hash paste * nb_seen_in_paste
ZADD - 'binary_hash:'+hash paste * nb_seen_in_paste
2018-07-20 07:43:09 +00:00
ZADD - 'hash_type:'+type date nb_seen
ZADD - 'base64_type:'+type date nb_seen
2018-07-18 09:45:19 +00:00
ZADD - 'binary_type:'+type date nb_seen