From 0ce4489ed2e6aa2c39bf3503988db27480d70d80 Mon Sep 17 00:00:00 2001 From: Terrtia Date: Mon, 15 Apr 2019 11:46:20 +0200 Subject: [PATCH] chg: [OVERVIEW] add doc termfred DB --- OVERVIEW.md | 68 ++++++++++++++++++++++++++++++++++------------------- 1 file changed, 44 insertions(+), 24 deletions(-) diff --git a/OVERVIEW.md b/OVERVIEW.md index 0e0dfc4a..882d6b54 100644 --- a/OVERVIEW.md +++ b/OVERVIEW.md @@ -30,12 +30,54 @@ Redis and ARDB overview # Database Map: -## Tags: +## DB2 - TermFreq: (TODO: update/refractor DB) + +##### Set: +| Key | Value | +| ------ | ------ | +| TrackedSetTermSet | **tracked_term** | +| TrackedSetSet | **tracked_set** | +| TrackedRegexSet | **tracked_regex** | +| | | +| tracked_**tracked_term** | **item_path** | +| set_**tracked_set** | **item_path** | +| regex_**tracked_regex** | **item_path** | +| | | +| TrackedNotifications | **tracked_trem / set / regex** | +| | | +| TrackedNotificationTags_**tracked_trem / set / regex** | **tag** | +| | | +| TrackedNotificationEmails_**tracked_trem / set / regex** | **email** | + +##### Zset: +| Key | Field | Value | +| ------ | ------ | ------ | +| per_paste_TopTermFreq_set_month | **term** | **nb_seen** | +| per_paste_TopTermFreq_set_week | **term** | **nb_seen** | +| per_paste_TopTermFreq_set_day_**epoch** | **term** | **nb_seen** | +| | | | +| TopTermFreq_set_month | **term** | **nb_seen** | +| TopTermFreq_set_week | **term** | **nb_seen** | +| TopTermFreq_set_day_**epoch** | **term** | **nb_seen** | + ##### Hset: | Key | Field | Value | | ------ | ------ | ------ | -| daily_tags:**date** | **tag** | **nb tagged this day** | +| TrackedTermDate | **tracked_term** | **epoch** | +| TrackedSetDate | **tracked_set** | **epoch** | +| TrackedRegexDate | **tracked_regex** | **epoch** | +| | | | +| BlackListTermDate | **blacklisted_term** | **epoch** | +| | | | +| **epoch** | **term** | **nb_seen** | + +## DB6 - Tags: + +##### Hset: +| Key | Field | Value | +| ------ | ------ | ------ | +| per_paste_**epoch** | **term** | **nb_seen** | | | | | tag_metadata:**tag** | first_seen | **date** | | tag_metadata:**tag** | last_seen | **date** | @@ -121,26 +163,6 @@ Redis and ARDB overview ARDB overview -* DB 2 - TermFreq - ----------------------------------------- TERM ---------------------------------------- - - SET - 'TrackedRegexSet' term - - HSET - 'TrackedRegexDate' tracked_regex today_timestamp - - SET - 'TrackedSetSet' set_to_add - - HSET - 'TrackedSetDate' set_to_add today_timestamp - - SET - 'TrackedSetTermSet' term - - HSET - 'TrackedTermDate' tracked_regex today_timestamp - - SET - 'TrackedNotificationEmails_'+term/set email - - SET - 'TrackedNotifications' term/set - -* DB 4 - Sentiment ----------------------------------------- SENTIMENT ------------------------------------ SET - 'Provider_set' Provider @@ -151,8 +173,6 @@ ARDB overview SET - UniqID avg_score - DB 5 - TermCred - * DB 7 - Metadata: