1712 commits

Author	SHA1	Message	Date
terrtia	109ce56a4a	fix: [crawler] title extraction, sigalarm raised by signal.alarm and sleep	2025-01-09 11:09:36 +01:00
terrtia	9425e01c85	fix: [crawler] debug signal timeout	2025-01-08 15:25:41 +01:00
terrtia	0287a1380b	fix: [crawler] log timeout + debug signal timeout	2025-01-08 15:14:54 +01:00
terrtia	38d1d01d8a	fix: [title beautifullsoup] sigalrm	2025-01-07 17:43:49 +01:00
terrtia	868da3c6bc	fix: [title beautifullsoup] add signal, BeautifulSoup html.parser is stuck	2025-01-07 17:21:58 +01:00
terrtia	8692d9b45b	fix: [crawler] crawler queued capture loop	2025-01-07 15:31:10 +01:00
terrtia	e6e48c69f5	fix: [crawler] debug crawler queued capture loop	2025-01-07 15:23:06 +01:00
terrtia	d0f4247c2b	chg: [test] log if flask is reachable	2025-01-07 14:24:10 +01:00
terrtia	b4491270b9	fix: [chat messages by year] fix subchannel nb_max	2025-01-06 16:48:24 +01:00
Thirion Aurélien	9e8ff182e7	Merge pull request #250 from FafnerKeyZee/patch-1 ... Update Tracker.py	2024-12-23 23:40:14 +01:00
terrtia	66de987c99	fix: [chat forum] fix get years daterange	2024-12-23 23:35:08 +01:00
Fafner [_KeyZee_]	11e75b80d4	Update abstract_chat_object.py ... 9a388dc9cb broke the Forum view, we can not do stat on forum, only on subchan :)	2024-12-23 15:03:38 +01:00
Fafner [_KeyZee_]	75b2d97504	Update Tracker.py ... If self._get_field('level') is None, trying to convert it into int will crash the system :) 2024-12-23 14:22:46,232 Flask_server ERROR:Exception on /trackers [GET] Traceback (most recent call last): File "/home/user/ail-framework/AILENV/lib/python3.12/site-packages/flask/app.py", line 1511, in wsgi_app response = self.full_dispatch_request() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/user/ail-framework/AILENV/lib/python3.12/site-packages/flask/app.py", line 919, in full_dispatch_request rv = self.handle_user_exception(e) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/user/ail-framework/AILENV/lib/python3.12/site-packages/flask/app.py", line 917, in full_dispatch_request rv = self.dispatch_request() ^^^^^^^^^^^^^^^^^^^^^^^ File "/home/user/ail-framework/AILENV/lib/python3.12/site-packages/flask/app.py", line 902, in dispatch_request return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/user/ail-framework/AILENV/lib/python3.12/site-packages/flask_login/utils.py", line 290, in decorated_view return current_app.ensure_sync(func)(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/user/ail-framework/var/www/Role_Manager.py", line 81, in decorated_view return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/user/ail-framework/var/www/blueprints/hunters.py", line 74, in trackers_dashboard trackers = Tracker.get_trackers_dashboard(user_org, user_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/user/ail-framework/bin/lib/Tracker.py", line 785, in get_trackers_dashboard if not tracker.check_level(user_org, user_id): ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/user/ail-framework/bin/lib/Tracker.py", line 220, in check_level level = self.get_level() ^^^^^^^^^^^^^^^^ File "/home/user/ail-framework/bin/lib/Tracker.py", line 183, in get_level level = int(self._get_field('level')) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ TypeError: int() argument must be a string, a bytes-like object or a real number, not 'NoneType'	2024-12-23 14:29:20 +01:00
terrtia	68c0355850	chg: [user-account viewer] add messages heatmap by year	2024-12-20 14:45:18 +01:00
terrtia	d21ace8f66	chg: [chat viewer] heatmap messages, add year selector	2024-12-20 13:52:15 +01:00
terrtia	9a388dc9cb	chg: [chat viewer] add chat messages by current year heatmap	2024-12-20 11:50:53 +01:00
terrtia	55a35bf3f4	chg: [message description] add chat name and username	2024-12-19 14:54:49 +01:00
terrtia	ab54924bba	fix: [chat explorer] fix protocols name list order	2024-12-16 11:15:10 +01:00
terrtia	3faea7997c	fix: [crawler] fix reload_crawlers_stats queues stats	2024-12-16 10:59:17 +01:00
terrtia	5b5ee502d0	chg: [cryptocurrency] add ripple address subtype + correlation	2024-12-11 14:51:44 +01:00
terrtia	6f964d7f8b	fix: [exifs module] Mp4 UnidentifiedImageError	2024-12-11 10:13:11 +01:00
terrtia	f4584f7e98	fix: [investigation] add object with spaces in id to an investigation	2024-12-11 09:57:24 +01:00
terrtia	4167b36d1a	chg: [blur unsafe images] blur violence and pornography-illicit-or-illegal tags + add warning message	2024-12-10 15:42:46 +01:00
terrtia	f7c92348bb	fix: [module_extractor] fix onion extraction	2024-12-10 11:28:25 +01:00
terrtia	f77c9268bb	fix: [module_extractor] don't extract onion from crawled items	2024-12-09 17:25:23 +01:00
terrtia	f4fca05524	chg: [search domain by name] sanityze domain name + show domain	2024-12-09 17:04:11 +01:00
terrtia	ea12a44836	fix: [crawler] avoid crawler loop if a capture end up in an invalid state	2024-12-09 16:44:40 +01:00
terrtia	849977f0c2	chg: [pubsublogger] remove old redis_logger	2024-12-09 13:54:54 +01:00
terrtia	feabe9f5df	chg: [dashboard] filter submission tags	2024-12-09 10:13:26 +01:00
terrtia	9dde795c12	chg: [dashboard] show tracker description	2024-12-06 16:42:17 +01:00
terrtia	802cb35085	chg: [queue] save module start time + pid	2024-12-06 14:08:47 +01:00
terrtia	14b0675330	chg: [dashboard] add crawler stats	2024-11-27 15:26:07 +01:00
terrtia	3d14bac434	chg: [dashboard] add objects tooltip	2024-11-27 14:17:22 +01:00
terrtia	e0ae20968d	fix: [retro hunts] remove objects	2024-11-25 15:15:10 +01:00
terrtia	72afd3ef62	fix: [retro hunt] fix add tags	2024-11-20 15:10:48 +01:00
terrtia	edfd48b8e6	chg: [dashboard] nb objects per days + websocket update	2024-11-20 14:41:36 +01:00
terrtia	73543ae5ad	chg: [dashboard] add echart feeder graph + cleanup olg graph libs + dashboard, show today nb objects	2024-11-19 15:58:40 +01:00
terrtia	055bc1a1b2	fix: [barcode] fix message card	2024-11-05 16:43:03 +01:00
terrtia	79a187b039	chg: [barcode] add and extract barcode object	2024-11-05 14:10:30 +01:00
terrtia	b988f46c90	chg: [dom-hash] add dom-hash object compute dom-hash for domains and crawled items	2024-10-17 12:14:48 +02:00
terrtia	35dd487281	chg: [CEDetector] tag domains	2024-10-16 11:35:16 +02:00
terrtia	bc5a96b3ad	chg: [CEDetector] add detect message	2024-10-16 11:06:06 +02:00
terrtia	6d3d331fb3	chg: [titles] setup Titles queues + CEDetector module	2024-10-16 11:02:18 +02:00
terrtia	3f78457dff	chg: [tools] add reprocess title + CEDetector	2024-10-16 10:56:35 +02:00
terrtia	1112615ec3	chg: [crawler] disable unsafe title auto tagging	2024-10-14 14:27:45 +02:00
terrtia	e55aeab11c	chg: [module] debug	2024-10-11 14:55:04 +02:00
terrtia	44d1860b87	fix: [module] typo	2024-10-11 14:39:19 +02:00
terrtia	3fb281f6c3	chg: [module] add CEDetector	2024-10-11 14:36:02 +02:00
terrtia	2ead8c21aa	chg: [crawler] tag domain by vanity	2024-10-10 11:03:07 +02:00
terrtia	72f4733242	chg: [crawler] crawl list urls: filter duplicates	2024-10-09 15:37:37 +02:00