Commit graph

1705 commits

Author SHA1 Message Date
terrtia
d0f4247c2b
chg: [test] log if flask is reachable 2025-01-07 14:24:10 +01:00
terrtia
b4491270b9
fix: [chat messages by year] fix subchannel nb_max
Some checks are pending
CI / ail_test (3.10) (push) Waiting to run
CI / ail_test (3.7) (push) Waiting to run
CI / ail_test (3.8) (push) Waiting to run
CI / ail_test (3.9) (push) Waiting to run
2025-01-06 16:48:24 +01:00
Thirion Aurélien
9e8ff182e7
Merge pull request #250 from FafnerKeyZee/patch-1
Some checks failed
CI / ail_test (3.10) (push) Has been cancelled
CI / ail_test (3.7) (push) Has been cancelled
CI / ail_test (3.8) (push) Has been cancelled
CI / ail_test (3.9) (push) Has been cancelled
Update Tracker.py
2024-12-23 23:40:14 +01:00
terrtia
66de987c99
fix: [chat forum] fix get years daterange 2024-12-23 23:35:08 +01:00
Fafner [_KeyZee_]
11e75b80d4
Update abstract_chat_object.py
9a388dc9cb broke the Forum view, we can not do stat on forum, only on subchan :)
2024-12-23 15:03:38 +01:00
Fafner [_KeyZee_]
75b2d97504
Update Tracker.py
If self._get_field('level') is None, trying to convert it into int will crash the system :)

2024-12-23 14:22:46,232 Flask_server ERROR:Exception on /trackers [GET]
Traceback (most recent call last):
  File "/home/user/ail-framework/AILENV/lib/python3.12/site-packages/flask/app.py", line 1511, in wsgi_app
    response = self.full_dispatch_request()
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/ail-framework/AILENV/lib/python3.12/site-packages/flask/app.py", line 919, in full_dispatch_request
    rv = self.handle_user_exception(e)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/ail-framework/AILENV/lib/python3.12/site-packages/flask/app.py", line 917, in full_dispatch_request
    rv = self.dispatch_request()
         ^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/ail-framework/AILENV/lib/python3.12/site-packages/flask/app.py", line 902, in dispatch_request
    return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args)  # type: ignore[no-any-return]
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/ail-framework/AILENV/lib/python3.12/site-packages/flask_login/utils.py", line 290, in decorated_view
    return current_app.ensure_sync(func)(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/ail-framework/var/www/Role_Manager.py", line 81, in decorated_view
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/ail-framework/var/www/blueprints/hunters.py", line 74, in trackers_dashboard
    trackers = Tracker.get_trackers_dashboard(user_org, user_id)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/ail-framework/bin/lib/Tracker.py", line 785, in get_trackers_dashboard
    if not tracker.check_level(user_org, user_id):
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/ail-framework/bin/lib/Tracker.py", line 220, in check_level
    level = self.get_level()
            ^^^^^^^^^^^^^^^^
  File "/home/user/ail-framework/bin/lib/Tracker.py", line 183, in get_level
    level = int(self._get_field('level'))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: int() argument must be a string, a bytes-like object or a real number, not 'NoneType'
2024-12-23 14:29:20 +01:00
terrtia
68c0355850
chg: [user-account viewer] add messages heatmap by year
Some checks failed
CI / ail_test (3.10) (push) Has been cancelled
CI / ail_test (3.7) (push) Has been cancelled
CI / ail_test (3.8) (push) Has been cancelled
CI / ail_test (3.9) (push) Has been cancelled
2024-12-20 14:45:18 +01:00
terrtia
d21ace8f66
chg: [chat viewer] heatmap messages, add year selector 2024-12-20 13:52:15 +01:00
terrtia
9a388dc9cb
chg: [chat viewer] add chat messages by current year heatmap
Some checks are pending
CI / ail_test (3.10) (push) Waiting to run
CI / ail_test (3.7) (push) Waiting to run
CI / ail_test (3.8) (push) Waiting to run
CI / ail_test (3.9) (push) Waiting to run
2024-12-20 11:50:53 +01:00
terrtia
55a35bf3f4
chg: [message description] add chat name and username 2024-12-19 14:54:49 +01:00
terrtia
ab54924bba
fix: [chat explorer] fix protocols name list order 2024-12-16 11:15:10 +01:00
terrtia
3faea7997c
fix: [crawler] fix reload_crawlers_stats queues stats 2024-12-16 10:59:17 +01:00
terrtia
5b5ee502d0
chg: [cryptocurrency] add ripple address subtype + correlation
Some checks failed
CI / ail_test (3.10) (push) Has been cancelled
CI / ail_test (3.7) (push) Has been cancelled
CI / ail_test (3.8) (push) Has been cancelled
CI / ail_test (3.9) (push) Has been cancelled
2024-12-11 14:51:44 +01:00
terrtia
6f964d7f8b
fix: [exifs module] Mp4 UnidentifiedImageError 2024-12-11 10:13:11 +01:00
terrtia
f4584f7e98
fix: [investigation] add object with spaces in id to an investigation 2024-12-11 09:57:24 +01:00
terrtia
4167b36d1a
chg: [blur unsafe images] blur violence and pornography-illicit-or-illegal tags + add warning message 2024-12-10 15:42:46 +01:00
terrtia
f7c92348bb
fix: [module_extractor] fix onion extraction
Some checks are pending
CI / ail_test (3.10) (push) Waiting to run
CI / ail_test (3.7) (push) Waiting to run
CI / ail_test (3.8) (push) Waiting to run
CI / ail_test (3.9) (push) Waiting to run
2024-12-10 11:28:25 +01:00
terrtia
f77c9268bb
fix: [module_extractor] don't extract onion from crawled items
Some checks are pending
CI / ail_test (3.9) (push) Waiting to run
CI / ail_test (3.10) (push) Waiting to run
CI / ail_test (3.7) (push) Waiting to run
CI / ail_test (3.8) (push) Waiting to run
2024-12-09 17:25:23 +01:00
terrtia
f4fca05524
chg: [search domain by name] sanityze domain name + show domain 2024-12-09 17:04:11 +01:00
terrtia
ea12a44836
fix: [crawler] avoid crawler loop if a capture end up in an invalid state 2024-12-09 16:44:40 +01:00
terrtia
849977f0c2
chg: [pubsublogger] remove old redis_logger 2024-12-09 13:54:54 +01:00
terrtia
feabe9f5df
chg: [dashboard] filter submission tags 2024-12-09 10:13:26 +01:00
terrtia
9dde795c12
chg: [dashboard] show tracker description 2024-12-06 16:42:17 +01:00
terrtia
802cb35085
chg: [queue] save module start time + pid 2024-12-06 14:08:47 +01:00
terrtia
14b0675330
chg: [dashboard] add crawler stats 2024-11-27 15:26:07 +01:00
terrtia
3d14bac434
chg: [dashboard] add objects tooltip 2024-11-27 14:17:22 +01:00
terrtia
e0ae20968d
fix: [retro hunts] remove objects 2024-11-25 15:15:10 +01:00
terrtia
72afd3ef62
fix: [retro hunt] fix add tags 2024-11-20 15:10:48 +01:00
terrtia
edfd48b8e6
chg: [dashboard] nb objects per days + websocket update 2024-11-20 14:41:36 +01:00
terrtia
73543ae5ad
chg: [dashboard] add echart feeder graph + cleanup olg graph libs + dashboard, show today nb objects 2024-11-19 15:58:40 +01:00
terrtia
055bc1a1b2
fix: [barcode] fix message card
Some checks failed
CI / ail_test (3.10) (push) Has been cancelled
CI / ail_test (3.7) (push) Has been cancelled
CI / ail_test (3.8) (push) Has been cancelled
CI / ail_test (3.9) (push) Has been cancelled
2024-11-05 16:43:03 +01:00
terrtia
79a187b039
chg: [barcode] add and extract barcode object 2024-11-05 14:10:30 +01:00
terrtia
b988f46c90
chg: [dom-hash] add dom-hash object compute dom-hash for domains and crawled items
Some checks are pending
CI / ail_test (3.10) (push) Waiting to run
CI / ail_test (3.7) (push) Waiting to run
CI / ail_test (3.8) (push) Waiting to run
CI / ail_test (3.9) (push) Waiting to run
2024-10-17 12:14:48 +02:00
terrtia
35dd487281
chg: [CEDetector] tag domains
Some checks are pending
CI / ail_test (3.10) (push) Waiting to run
CI / ail_test (3.7) (push) Waiting to run
CI / ail_test (3.8) (push) Waiting to run
CI / ail_test (3.9) (push) Waiting to run
2024-10-16 11:35:16 +02:00
terrtia
bc5a96b3ad
chg: [CEDetector] add detect message 2024-10-16 11:06:06 +02:00
terrtia
6d3d331fb3
chg: [titles] setup Titles queues + CEDetector module 2024-10-16 11:02:18 +02:00
terrtia
3f78457dff
chg: [tools] add reprocess title + CEDetector 2024-10-16 10:56:35 +02:00
terrtia
1112615ec3
chg: [crawler] disable unsafe title auto tagging
Some checks failed
CI / ail_test (3.10) (push) Has been cancelled
CI / ail_test (3.7) (push) Has been cancelled
CI / ail_test (3.8) (push) Has been cancelled
CI / ail_test (3.9) (push) Has been cancelled
2024-10-14 14:27:45 +02:00
terrtia
e55aeab11c
chg: [module] debug
Some checks failed
CI / ail_test (3.10) (push) Has been cancelled
CI / ail_test (3.7) (push) Has been cancelled
CI / ail_test (3.8) (push) Has been cancelled
CI / ail_test (3.9) (push) Has been cancelled
2024-10-11 14:55:04 +02:00
terrtia
44d1860b87
fix: [module] typo 2024-10-11 14:39:19 +02:00
terrtia
3fb281f6c3
chg: [module] add CEDetector 2024-10-11 14:36:02 +02:00
terrtia
2ead8c21aa
chg: [crawler] tag domain by vanity
Some checks failed
CI / ail_test (3.10) (push) Has been cancelled
CI / ail_test (3.7) (push) Has been cancelled
CI / ail_test (3.8) (push) Has been cancelled
CI / ail_test (3.9) (push) Has been cancelled
2024-10-10 11:03:07 +02:00
terrtia
72f4733242
chg: [crawler] crawl list urls: filter duplicates
Some checks are pending
CI / ail_test (3.10) (push) Waiting to run
CI / ail_test (3.7) (push) Waiting to run
CI / ail_test (3.8) (push) Waiting to run
CI / ail_test (3.9) (push) Waiting to run
2024-10-09 15:37:37 +02:00
terrtia
1505bf0157
chg: [crawler] submit free text of urls to crawl 2024-10-09 15:05:27 +02:00
terrtia
9d26a47c17
chg: [onion module] filter onion v2
Some checks are pending
CI / ail_test (3.10) (push) Waiting to run
CI / ail_test (3.7) (push) Waiting to run
CI / ail_test (3.8) (push) Waiting to run
CI / ail_test (3.9) (push) Waiting to run
2024-10-08 16:26:46 +02:00
terrtia
faea17572c
fix: [tag] tag delete: fix update first/last seen 2024-10-08 16:10:14 +02:00
terrtia
554897e1d8
chg: [crawler] update tor user agent 2024-10-08 10:27:03 +02:00
terrtia
d9fc014a1d
fix: [crawler] filter lookup tags
Some checks are pending
CI / ail_test (3.10) (push) Waiting to run
CI / ail_test (3.7) (push) Waiting to run
CI / ail_test (3.8) (push) Waiting to run
CI / ail_test (3.9) (push) Waiting to run
2024-10-07 14:53:13 +02:00
terrtia
83e11082b5
fix: [crawler] filter lookup parent + domain daterange 2024-10-07 11:03:56 +02:00
terrtia
c8b1c67a08
chg: [message image] show qrcodes extracted
Some checks failed
CI / ail_test (3.10) (push) Has been cancelled
CI / ail_test (3.7) (push) Has been cancelled
CI / ail_test (3.8) (push) Has been cancelled
CI / ail_test (3.9) (push) Has been cancelled
2024-10-04 15:10:29 +02:00