1508 commits

Author	SHA1	Message	Date
terrtia	f586baa0c5	fix: [Language] fix language source	2024-01-16 12:04:39 +01:00
terrtia	1c46bb4296	chg: [Language] replace pycld3 by gcld3 + clean text before language detection	2024-01-15 14:17:15 +01:00
terrtia	d6d67f6a4c	chg: [hosts] filter onion	2024-01-09 14:31:55 +01:00
terrtia	bdaa4c51c9	fix: [hosts] fix number of hosts extracted	2024-01-09 12:15:40 +01:00
terrtia	5094b2dcbb	fix: [DomClassifier] improve perf	2024-01-09 11:38:54 +01:00
terrtia	7263a9777c	fix: [DomClassifier] improve perf	2024-01-09 11:26:05 +01:00
terrtia	5c25ec0fea	fix: [DomClassifier] improve perf	2024-01-09 11:24:54 +01:00
terrtia	f851cc9f42	fix: [queue] save last timout in cache	2024-01-09 11:19:01 +01:00
terrtia	bd2ca4b319	fix: [crawler] fix api create_task	2024-01-09 09:47:49 +01:00
terrtia	a14c0484af	fix: [tags] debug	2024-01-08 15:34:32 +01:00
terrtia	be4feb7799	fix: [tags] debug	2024-01-08 15:28:31 +01:00
terrtia	259f29c10c	fix: [tags] debug	2024-01-08 15:27:08 +01:00
terrtia	bfc018f929	fix: [tags] debug	2024-01-08 15:21:37 +01:00
terrtia	f95d32d6dc	fix: [tags] debug	2024-01-08 15:02:39 +01:00
terrtia	4b21cc2939	fix: [tags] debug	2024-01-08 15:01:40 +01:00
terrtia	07c51e111f	fix: [tags] debug	2024-01-08 14:59:58 +01:00
terrtia	efb8b2d0d3	fix: [tags] debug	2024-01-08 14:58:18 +01:00
terrtia	0abc3fee0e	fix: [tags] debug	2024-01-08 14:56:20 +01:00
terrtia	8bf67cf3b6	fix: [tags] remove invalid tags	2024-01-08 14:51:40 +01:00
terrtia	d7c8262653	fix: [keys module] fix tags	2024-01-08 14:24:51 +01:00
terrtia	9716351196	Merge branch 'master' into dev	2024-01-08 14:05:34 +01:00
terrtia	0af5ea9d48	chg: [queues] timeout obj after 2 days	2024-01-08 13:50:56 +01:00
terrtia	c05f4d7833	chg: [chats] get user message ids by chat	2024-01-02 17:15:45 +01:00
Markus Lassfolk	81f9a860d4	Fix IndexError in get_last_tag_from_remote function ... This commit adds a check to ensure that the output from the subprocess command in the get_last_tag_from_remote function has a sufficient number of lines before attempting to access specific indices. This change prevents the IndexError that occurred when the git command's output was shorter than expected.	2024-01-01 21:54:29 +01:00
terrtia	70bb6757f8	chg: [correlation] UI chats filters + correation user-account/username	2023-12-13 11:51:53 +01:00
terrtia	9221e532c4	fix: [crawlers] fix task start	2023-12-12 11:32:33 +01:00
terrtia	7e9ea48c81	fix: [crawler] debug	2023-12-12 11:20:21 +01:00
terrtia	cdfc9f64e5	fix: [crawler] debug	2023-12-12 11:13:58 +01:00
terrtia	847d004c13	fix: [crawler] debug	2023-12-12 11:05:23 +01:00
terrtia	c20c41c50f	fix: [libinjection] memory leak, disable module	2023-12-12 10:30:40 +01:00
terrtia	4529a76d13	fix: [zmq importer] fix object source name	2023-12-12 10:14:59 +01:00
terrtia	235539ea42	fix: [crawler] fix capture start time	2023-12-11 09:30:09 +01:00
terrtia	5fc9b1403f	chg: [chats] add pagination	2023-12-11 00:46:15 +01:00
terrtia	943a873124	chg: [tags] searech messages tags by daterange	2023-12-09 16:50:43 +01:00
terrtia	73185f19fd	chg: [categ] messages, bypass categ module + fix correlation	2023-12-08 15:40:05 +01:00
terrtia	5b808ed416	fix: [translate] fix exception	2023-12-08 14:38:55 +01:00
terrtia	1c52c187ad	fix: [api] fix add crawler capture return	2023-12-08 10:37:58 +01:00
terrtia	cea96863ba	fix: [language] libretranslate unreachable	2023-12-07 14:59:40 +01:00
terrtia	3e591d95bc	fix: [retro_hunt] fix daterange	2023-12-07 14:40:51 +01:00
terrtia	a382b572c6	chg: [crawler] push onion discovery capture_uuid to another AIL	2023-12-07 11:28:35 +01:00
terrtia	38ce17bc8a	chg: [chats] add chats participants + user-accounts basic template	2023-12-06 16:26:26 +01:00
terrtia	bef4e69a68	chg: [chats] translate messages on demand	2023-12-04 15:47:58 +01:00
terrtia	941838ab76	chg: [chats] add discord threads, Forum channel	2023-12-04 10:26:02 +01:00
terrtia	93ef541862	chg: [chats] add messages threads	2023-11-29 16:28:25 +01:00
terrtia	f766cbebda	chg: [chats] add message file-name object + str emoticon reactions	2023-11-27 16:25:09 +01:00
terrtia	fa4f1269cd	chg: [chat users] add users icons	2023-11-24 16:35:45 +01:00
terrtia	2b8e9b43f3	chg: [chats] factorise heatmap + chat icon	2023-11-24 15:05:19 +01:00
terrtia	9fbd3f4bb6	chg: [chats] add message and blur blocks	2023-11-16 14:50:03 +01:00
terrtia	2ea5f82760	chg: [queues] add new image queue + add exif module	2023-11-15 15:45:25 +01:00
terrtia	4142ad9884	chg: [chats] add image object + show message image	2023-11-15 14:12:50 +01:00
terrtia	7bf0fe8992	chg: [chats] add heatmap nb week messages by hour	2023-11-13 14:10:24 +01:00
terrtia	54c57ea35b	chg: [chats] message object template	2023-11-08 15:46:05 +01:00
terrtia	e0f70c5072	fix: [investigations] delete obj	2023-11-08 13:35:13 +01:00
terrtia	ce989adbd3	fix: [chats] fix username meta	2023-11-08 13:07:00 +01:00
terrtia	207a6524d7	fix: [languages] fix language module	2023-11-08 11:59:06 +01:00
terrtia	6c77ca5136	fix: [chats] fix chat username	2023-11-08 11:25:30 +01:00
terrtia	5068287c76	Merge branch 'master' into dev	2023-11-08 10:42:02 +01:00
terrtia	acef57bb36	fix: [tags] fix galaxies synonyms	2023-11-08 10:41:32 +01:00
terrtia	e7f060c23d	chg: [messages] refactor get_messages_meta + add basic message template	2023-11-08 10:31:51 +01:00
terrtia	4cc9608a3f	chg: [chats explorer] show chats/subchannels creation date	2023-11-07 15:24:40 +01:00
terrtia	3fb1d0ad74	fix: [chats] fix messages replies	2023-11-07 11:24:24 +01:00
terrtia	b1d5399607	chg: [chats] add UI shortcut + networks list + show chats/subchannels info	2023-11-06 16:38:31 +01:00
terrtia	789210bcba	chg: [chats] improve UI + fix importer	2023-11-06 14:08:23 +01:00
terrtia	9125119764	chg: [chats] add chats explorer v0	2023-11-02 16:28:33 +01:00
terrtia	c5cef5fd00	chg: [core] merge master + fix object subtype correlation stats	2023-10-12 13:53:00 +02:00
terrtia	6978764b02	fix: [module] fix module obj type: language + mail	2023-10-11 14:53:12 +02:00
terrtia	623ba455ff	fix: [queues] fix ended duplicate + sync queue	2023-10-11 14:31:13 +02:00
terrtia	676b0f84ef	chg: [module + queues] track + rename object global ID by module	2023-10-11 12:06:01 +02:00
terrtia	eae57fb813	chg: [importers obj_type] importers queues: add feeder source + object global ID	2023-10-05 16:24:28 +02:00
terrtia	daf9f6fb5d	fix: [chats] message css + reply ID	2023-10-04 14:40:13 +02:00
terrtia	fee3332edb	fix: [tracker] delete yara rule, fix filter by object type	2023-09-29 15:43:37 +02:00
terrtia	c19b1f34e3	chg: [ail queues] merge	2023-09-08 10:52:55 +02:00
terrtia	bb3dad2873	chg: [objs processed] xxhash messages	2023-09-07 10:38:03 +02:00
Jean-Louis Huynen	68c17c3fbc	chg: [crawlers] submit cookies to the crawler task API	2023-08-31 16:13:20 +02:00
Jean-Louis Huynen	ed0423118e	chg: [crawlers] submit a single cookie to the crawler task API	2023-08-31 15:42:44 +02:00
Terrtia	7c73f0944a	fix: [items source] filter invalid item sources	2023-08-29 14:03:26 +02:00
Terrtia	099253f854	fix: [json importer] fix empty source name	2023-08-29 13:50:16 +02:00
Terrtia	24969610cc	fix: [items source] fix empty sources list	2023-08-29 11:59:39 +02:00
Terrtia	b32f110285	chg: [chat + user-account] correlations + usernames timeline	2023-08-28 16:29:38 +02:00
Terrtia	546d6538fd	chg: [mail exporter] add obj content extract for each regex match	2023-08-24 14:37:50 +02:00
Terrtia	c01b806ae3	chg: [mail exporter] add obj content extract for each yara rule match	2023-08-24 11:11:57 +02:00
Terrtia	843b2d3134	fix: correlations	2023-08-23 16:13:20 +02:00
Terrtia	4e3784922c	fix: typo	2023-08-23 11:47:39 +02:00
Terrtia	2145eb7b8a	fix: [title] fix None title	2023-08-23 11:46:37 +02:00
Terrtia	f44c5509da	chg: [titles] add yara tracker on title + tags domains if unsafe title tags	2023-08-23 11:16:22 +02:00
Terrtia	045aab6f34	fix: [module pasties] fix module name	2023-08-21 15:52:33 +02:00
Terrtia	0cb7431e10	chg: [modules] crawl pasties domains	2023-08-21 15:49:32 +02:00
Terrtia	3c1813ba02	chg: [core] add telegram importer + Chat object + message Object + add timeline engine	2023-08-18 11:05:21 +02:00
Terrtia	f05c7b6a93	fix: [module extractor] fix invalid yara offset	2023-08-08 11:27:57 +02:00
Terrtia	4dc5527c1a	fix: [module extractor] fix invalid yara offset	2023-08-08 11:26:16 +02:00
Terrtia	529a24c191	chg: [module extrator] add debug	2023-08-08 10:40:44 +02:00
Terrtia	bd7aa979bd	chg: [module extrator] add debug	2023-08-08 10:36:58 +02:00
Terrtia	2691000d0c	chg: [telegram fedeer] use meta of the new feeder	2023-08-02 15:49:12 +02:00
Terrtia	14a76a91d9	fix: [tags ui] fix galaxy, get number of tags enabled + add toolip helper	2023-08-01 11:07:06 +02:00
Terrtia	1aa0bd8a0e	fix: [settings] fix edit user	2023-07-31 16:25:28 +02:00
Terrtia	64252ddf75	fix: [Tracker] edit tracker filters	2023-07-31 16:00:31 +02:00
Terrtia	4eb5b4c4b9	fix: [MailExporter] improve logs + SMTP over SSL: add an option to validate self signed CA ... This exporter use STARTTLS by defaults. If the SMTP server does not support the STARTTLS extension, the client will switch to SSL instead.	2023-07-28 11:10:21 +02:00
Terrtia	68dffcd26b	chg: [api crawler] fix response + add cookiejar, proxy and frequency parameters	2023-07-25 15:57:11 +02:00
Terrtia	fe2769308b	fix: [crawler] fix down domain + domain redirection history	2023-07-18 14:30:00 +02:00
Terrtia	77e8cc6c02	Merge branch 'master' of github.com:ail-project/ail-framework	2023-07-17 15:47:32 +02:00