Commit graph

1675 commits

Author SHA1 Message Date
Terrtia
2145eb7b8a
fix: [title] fix None title 2023-08-23 11:46:37 +02:00
Terrtia
f44c5509da
chg: [titles] add yara tracker on title + tags domains if unsafe title tags 2023-08-23 11:16:22 +02:00
Terrtia
045aab6f34
fix: [module pasties] fix module name 2023-08-21 15:52:33 +02:00
Terrtia
0cb7431e10
chg: [modules] crawl pasties domains 2023-08-21 15:49:32 +02:00
Terrtia
3c1813ba02
chg: [core] add telegram importer + Chat object + message Object + add timeline engine 2023-08-18 11:05:21 +02:00
Terrtia
f05c7b6a93
fix: [module extractor] fix invalid yara offset 2023-08-08 11:27:57 +02:00
Terrtia
4dc5527c1a
fix: [module extractor] fix invalid yara offset 2023-08-08 11:26:16 +02:00
Terrtia
529a24c191
chg: [module extrator] add debug 2023-08-08 10:40:44 +02:00
Terrtia
bd7aa979bd
chg: [module extrator] add debug 2023-08-08 10:36:58 +02:00
Terrtia
2691000d0c
chg: [telegram fedeer] use meta of the new feeder 2023-08-02 15:49:12 +02:00
Terrtia
14a76a91d9
fix: [tags ui] fix galaxy, get number of tags enabled + add toolip helper 2023-08-01 11:07:06 +02:00
Terrtia
1aa0bd8a0e
fix: [settings] fix edit user 2023-07-31 16:25:28 +02:00
Terrtia
64252ddf75
fix: [Tracker] edit tracker filters 2023-07-31 16:00:31 +02:00
Terrtia
4eb5b4c4b9
fix: [MailExporter] improve logs + SMTP over SSL: add an option to validate self signed CA
This exporter use STARTTLS by defaults. If the SMTP server does not support the STARTTLS extension, the client will switch to SSL instead.
2023-07-28 11:10:21 +02:00
Terrtia
68dffcd26b
chg: [api crawler] fix response + add cookiejar, proxy and frequency parameters 2023-07-25 15:57:11 +02:00
Terrtia
fe2769308b
fix: [crawler] fix down domain + domain redirection history 2023-07-18 14:30:00 +02:00
Terrtia
77e8cc6c02
Merge branch 'master' of github.com:ail-project/ail-framework 2023-07-17 15:47:32 +02:00
Terrtia
a9485928db
chg: [HHHash] add HHHash object and correlation https://www.foo.be/2023/07/HTTP-Headers-Hashing_HHHash 2023-07-17 15:47:17 +02:00
fukusuket
22dff19004 fix: [domain search] returns an empty string when searched with invalid characters 2023-07-14 18:28:34 +09:00
Terrtia
780b4f9f9c
fix: [background update] fix logger 2023-07-12 14:37:59 +02:00
Terrtia
73bfe614df
chg: [updater] refactor background updater + add v5.2 update 2023-07-12 11:36:47 +02:00
Terrtia
28c647d370
chg: [crawler har] compress HAR 2023-07-10 15:56:34 +02:00
Terrtia
c719990125
fix: [crawler] add timeout to Unknown captures 2023-07-10 11:23:44 +02:00
Thirion Aurélien
8f0e7f1434
Merge pull request #174 from fukusuket/fix-500-erro-when-invalid-lacus-url
fix: [crawler] add exception handing for `ping_lacus`
2023-07-10 10:05:20 +02:00
fukusuket
fcd6a98fb0 fix: [crawler] added existence check for screenshot set 2023-07-09 12:50:13 +09:00
fukusuket
e35924ec22 fix: [crawler] add exception handing for ping_lacus 2023-07-08 12:11:25 +09:00
Terrtia
482fc21b5e
chg: [correlation] correlation graph, add an option to hide an object/node by pressing H + reset correlation graph 2023-07-07 16:29:32 +02:00
Terrtia
450ebdd789
chg: [etag] add new etag object 2023-07-06 11:26:32 +02:00
Terrtia
35f678245f
fix: [decoded] fix download file 2023-06-30 16:22:30 +02:00
Terrtia
0fa0984ec4
fix: [updater] fix db checker 2023-06-30 16:19:38 +02:00
Terrtia
fa8b4a67d9
fix: [correlation tags] fix tag all objects 2023-06-29 15:02:57 +02:00
Terrtia
279ec00990
fix: [correlation card decoded meta] mimetype + size 2023-06-29 11:40:57 +02:00
Terrtia
fce63d52a0
fix: [updater] remove old ARDB env 2023-06-29 09:07:00 +02:00
Terrtia
d6a24c0357
fix: [hunter + misp export] fix misp event json export + retro hunt date search and description 2023-06-29 08:48:50 +02:00
Terrtia
b4d536f174
chg: [investigation] add object comment 2023-06-26 16:28:31 +02:00
Terrtia
a0686eefcf
fix: [pystemon importer] fix base64 encoding 2023-06-26 11:24:04 +02:00
Terrtia
f1f33d6c1b
chg: [pystemon importer] fix gzipped pastes 2023-06-22 16:34:14 +02:00
Terrtia
47e1343187
fix: [crawler] same capture uuid if a domain is already crawled 2023-06-22 16:09:18 +02:00
Terrtia
b459498db2
chg: [queues] track object + check if object processed 2023-06-22 15:38:04 +02:00
Terrtia
4567c9d400
chg: [correlation graph] show message if max_nodes reached + fix cookie-name sparkline 2023-06-20 11:23:58 +02:00
Terrtia
501d10bbbd
chg: [crawler] auto tag crawled domains 2023-06-20 08:11:44 +02:00
Terrtia
c02b9f2a81
fix: [IPAdress module] empty queue if no IP ranges provided 2023-06-19 15:17:41 +02:00
Terrtia
b64c70e0cd
fix: [retro hunt] fix object tag queue + decoded content 2023-06-19 10:53:15 +02:00
Terrtia
6c21a8f8cf
fix: [daterange object] fix objects by date 2023-06-19 08:55:56 +02:00
Terrtia
84bc2c0669
chg: [correlation] add an option to remove max number of nodes if max_node == 0 2023-06-18 16:09:57 +02:00
Terrtia
e9539e640b
fix: [crawler] fix incomplete response 2023-06-18 15:09:09 +02:00
Terrtia
f8fd037bd2
chg: [object cookie-name] add new cookie-name object + correlation 2023-06-16 15:39:13 +02:00
Terrtia
ee76d20277
fix: [user] fix get user token #163 2023-06-14 14:53:07 +02:00
Terrtia
b38819fdaa
fix: [user] fix user delete #163 2023-06-14 14:40:01 +02:00
Terrtia
d4152462f5
chg: [titles] add title IDs and contents search 2023-06-13 15:29:11 +02:00
Terrtia
94961f2eba
chg: [favicon object] add favicon object 2023-06-12 16:51:45 +02:00
Terrtia
580879ee5c
fix: [MISP export] fix ail object first/last seen + obj logger 2023-06-09 11:19:22 +02:00
Terrtia
f540df0ff2
chg: [sow item] show item investigations 2023-06-07 14:17:06 +02:00
Terrtia
70802205f2
fix: [d4] change enable d4 2023-06-07 11:03:32 +02:00
Terrtia
4cd2b6517b
chg: [kvrocks migration] mv update/v.50 2023-06-07 10:33:45 +02:00
Terrtia
a22e6f6180
fix: [kvrocks migration] 2023-06-07 10:21:49 +02:00
Terrtia
f3c3cb5d05
fix: [objects] fix investigation + ail2ail + screenshot MISP export 2023-06-04 17:34:21 +02:00
Terrtia
62880e3a1c
fix: [show domains] fix down domains 2023-06-02 13:30:59 +02:00
Terrtia
9efc348506
chg: [correlation] filter blank screenshots 2023-06-02 11:23:52 +02:00
Terrtia
7c7799564f
chg: [importers] improve abstract class and logs 2023-06-02 11:03:32 +02:00
Terrtia
50abff66b4
chg: [HOWTO] improve HOWTO 2023-05-30 14:48:06 +02:00
Terrtia
2ebe4845a7
fix: [module extractor] fix tracker extractor 2023-05-30 10:11:12 +02:00
Terrtia
8252d6b69e
fix: [tracker] fix tracker delete 2023-05-26 14:09:12 +02:00
Terrtia
1e7b527e41
fix: [tracker] fix webhook 2023-05-26 13:57:34 +02:00
Terrtia
b3cafd2a1d
chg: [correlation graph] update node legend 2023-05-26 11:44:29 +02:00
Terrtia
b4f1a43208
chg: [correlation] correlation graph: filter title objects 2023-05-26 10:47:58 +02:00
Terrtia
405d097024
fix: [crawler] fix undefined capture status 2023-05-25 16:26:48 +02:00
Terrtia
9a4feb93a0
fix: [correlation btc info] catch btc txs error 2023-05-25 16:11:55 +02:00
Terrtia
ee951ca948
chg: [correlation] add direct correlation stats 2023-05-25 16:00:27 +02:00
Terrtia
c008366f02
chg: [new title object] add new title object + correlation on page title 2023-05-25 14:33:12 +02:00
Terrtia
f7e0a357ea
fix: [Phone module] Filter Invalid Phone numbers 2023-05-24 13:31:10 +02:00
Terrtia
2c8b239eec
fix: [phone] fix phone module 2023-05-24 13:26:47 +02:00
Terrtia
19f154a81a
fix: [domain search] fix template domain types filter 2023-05-24 11:55:31 +02:00
Terrtia
a30cc1539d
fix: [MISP auto export] fix module input message 2023-05-24 11:12:02 +02:00
Terrtia
353b290899
chg: [Phone module] Filter Invalid Phone numbers + UI Show extracted 2023-05-24 10:48:29 +02:00
Terrtia
7a52aec884
fix: [tests] replace unmaintened nose by nose2 2023-05-23 14:47:02 +02:00
Terrtia
94d7eaf11d
fix: [tests] fix tests 2023-05-23 13:38:33 +02:00
Terrtia
af719d1d94
chg: [importers] add Dir/File Importer 2023-05-22 15:31:48 +02:00
Terrtia
175963e371
merge master 2023-05-17 16:07:32 +02:00
Terrtia
20fad97d6a
chg: [update] bump version < 5.0 roll back commit 2023-05-17 15:59:52 +02:00
Terrtia
2127b4363f
chg: [kvrocks] add migration notice 2023-05-17 15:46:44 +02:00
Terrtia
5b6a7f15ce
chg: [update] older versions: filter 5.0 updates 2023-05-17 11:40:42 +02:00
Terrtia
88d3870230
chg: [ail] cleanup 2023-05-17 10:26:54 +02:00
Terrtia
5ef29d8abb
chg: [MISP] refactor MISP thehive auto push 2023-05-16 16:34:22 +02:00
Terrtia
5d84b347bc
fix: [cves] fix cve search timeout 2023-05-16 13:28:31 +02:00
Terrtia
ed9682798e
chg: [IPAddress module] migrate IPAddress module 2023-05-15 11:39:16 +02:00
Terrtia
7669c16c74
fix: [Onion module] fix kvrocks sismeber 2023-05-15 10:42:46 +02:00
Terrtia
2ae3ffd6d2
fix: [core] fix instance ail:uuid 2023-05-15 10:37:03 +02:00
Terrtia
8ec4370043
fix: [telegram] fix regex 2023-05-15 10:12:58 +02:00
Terrtia
1aa63e8a08
fix: [logger] rename default logger file + fix log messages 2023-05-15 09:51:10 +02:00
Terrtia
e365555905
fix: [trackers] fix pgp yara tracker 2023-05-12 15:43:41 +02:00
Terrtia
9b2e8718d7
chg: [logs] add new logger 2023-05-12 15:29:53 +02:00
Terrtia
98cbaad1ad
fix: [cves] catch cve search errors 2023-05-12 09:59:18 +02:00
Terrtia
f4d20533cc
chg: [trackers UI] add admin endpoint 2023-05-12 09:25:17 +02:00
Terrtia
d4766c5adc
fix: [trackers] fix trackers edit 2023-05-11 16:49:09 +02:00
Terrtia
4473086f89
chg: [trackers] refactor trackers 2023-05-11 16:21:43 +02:00
Terrtia
6b60041db2
chg: [crawler] add unsafe tag if domain contain unsafe screenshot 2023-05-10 16:28:19 +02:00
Terrtia
37c71b8438
chg: [objects + retro hunt] refactor retro hunt + objects retro hunts + get objects generator by filters (date_from, sources, mimetypes, ...) 2023-05-10 16:26:46 +02:00
Terrtia
0daf5bad44
chg: [trackers] refactor trackers: track objects + filter by object types/sources/subtypes 2023-05-04 16:35:56 +02:00
Terrtia
8f65fd5fe7
fix: [search domains] fix search domains by daterange 2023-04-24 13:35:55 +02:00
Terrtia
10fbf228c1
fix: [domain explorer] fix search by daterange 2023-04-24 10:55:58 +02:00
Terrtia
3f8656a835
fix: [api] fix token length 2023-04-21 16:16:10 +02:00
Terrtia
e0899e6e0d
chg: [corellation graph] hide unsafe screenshots 2023-04-21 15:38:48 +02:00
Terrtia
6c6a3b48e2
fix: [modules] log level 2023-04-21 14:53:33 +02:00
Terrtia
6338268e8c
fix: [domain UI] fix correlation card + language search 2023-04-21 10:26:14 +02:00
Terrtia
79fa5dc30b
fix: [investigation] fix create investigation 2023-04-20 16:17:54 +02:00
Terrtia
7ed7b4c63e
fix: [module extractor] fix cache + fix yara match 2023-04-20 16:05:58 +02:00
Terrtia
86b1fda59b
fix: [MISP exporter] fix MISP exporter CIRCL/AIL-framework#590 2023-04-20 10:44:17 +02:00
Terrtia
ab7b2bdbab
chg: [pystemon importer] create new PystemonImporter module, refactor pystemon feeder 2023-04-14 14:43:07 +02:00
Terrtia
ccf935700a
fix: [objects] show/add subtype objects tags 2023-04-14 10:50:58 +02:00
Terrtia
02814e7f81
chg: [UI settings] add ail modules svg + fix admin view 2023-04-13 15:59:44 +02:00
Terrtia
6b5e833fc1
fix: [tracker modulew] fix duplicate module stats 2023-04-13 14:42:57 +02:00
Terrtia
6f9e0c2f66
chg: [AIL queues] rewrite module queues. remove PUBSUB 2023-04-13 14:25:02 +02:00
Terrtia
bc73b0ca27
fix: [crawler] typo 2023-04-11 09:44:49 +02:00
Terrtia
e3171c8178
fix: [tags] fix delete subtype tags 2023-04-06 16:26:56 +02:00
Terrtia
2e11b04b6c
fix: [correlation] fix UI cve, decoded tags 2023-04-06 16:18:06 +02:00
Terrtia
c7eeae2a44
chg: [correlation] new admin enpoint delete correlation + add screenshot correlation filter 2023-04-06 15:13:27 +02:00
Terrtia
ab01de76e5
fix: [credential module] fix logging message 2023-04-06 09:18:57 +02:00
Terrtia
f45f9e5836
chg: [correlation] tags all objects 2023-04-05 16:09:06 +02:00
Terrtia
3b1fc0fd2a
fix: [tags] enabled tags selector 2023-04-05 11:27:51 +02:00
Terrtia
885bdb115b
fix: [tags] fix UI enabled tags selector 2023-04-05 10:46:31 +02:00
Terrtia
5cfe7fffc9
fix: [tags] fix UI enabled tags selector 2023-04-05 10:26:21 +02:00
Terrtia
d2fdc6107e
fix: [cve + crawler] fix crawler lacus client refresh + typo 2023-04-05 09:51:42 +02:00
Terrtia
427a6fbfa1
fix: [submit] fix UI submit 2023-04-04 15:25:59 +02:00
Terrtia
94a4aeebb1
fix: [queues] fix Mixer queue 2023-04-04 15:20:08 +02:00
Terrtia
72d774f37b
fix: [queues] fix Mixer queue 2023-04-04 15:18:15 +02:00
Terrtia
4c5b1b668f
fix: [submit] fix UI submit 2023-04-04 14:36:38 +02:00
Terrtia
2ace57c5a7
fix: [modules] small fixs 2023-04-04 14:15:35 +02:00
Terrtia
c7aeb0c646
fix: [modules] small fixs 2023-04-04 14:12:23 +02:00
Terrtia
83ab4a93cd
fix: [LAUNCH] remove ardb check 2023-04-04 13:53:16 +02:00
Terrtia
80efc9cdbb
chg: [DB] remove ARDB + temp disable MISP import and auto export 2023-04-04 10:25:01 +02:00
Terrtia
54a0bcb022
chg: [crawler] update default user agent 2023-04-04 09:23:52 +02:00
Terrtia
d01780dd95
chg: [Mixer] refactor Mixer + fix ZMQImporter config 2023-03-31 14:53:20 +02:00
Terrtia
47da4aa62c
chg: [crawle] migrate domains settings 2023-03-31 09:25:06 +02:00
Terrtia
ac484bed71
chg: [stats] disable statistics 2023-03-30 15:23:41 +02:00
Terrtia
5f150489b6
fix: [tracker] fix exporters 2023-03-30 14:58:55 +02:00
Terrtia
126ecb2e39
fix: [core] fix merge 2023-03-16 16:49:53 +01:00
Terrtia
524a404dc8
chg: [core] merge conflict 2023-03-16 15:50:42 +01:00
Terrtia
55d71e0a0b
fix: [exporter] thehive exporter, create case 2023-03-16 14:51:53 +01:00
Terrtia
c2a4224375
fix: [user] fix user creation 2023-03-16 14:47:59 +01:00
Terrtia
925d67a35e
chg: [crawler] add crawler scheduler 2023-03-14 17:36:42 +01:00
Terrtia
ae6f8af09f
chg: [subtype objects] migrate UI cryptocurrency, pgp, username 2023-02-28 11:01:27 +01:00
Terrtia
0fa27c6a51
chg: [extractor] add cache + UI extractor + word/set extractor 2023-02-23 16:25:15 +01:00
Terrtia
ab24343b48
fix: [modules] fix modules 2023-02-22 11:08:29 +01:00
Terrtia
6842efc15d
chg: [crawler] refactor crawler tasks + migrate cookiejars + add proxy option 2023-02-21 12:22:49 +01:00
Terrtia
c04bc7bb57
chg: [crawler] cookies migration + refactor 2023-02-17 14:50:20 +01:00
Terrtia
11cd571f44
chg: [exporter] add TheHive exporter 2023-02-15 15:18:10 +01:00
Terrtia
24ffcae690
chg: [exporter] refactor + add a new way to create and use exporters 2023-02-15 11:02:47 +01:00
Terrtia
de0a60ba8b
chg: [importer] refactor ZMQ + Feeder importer 2023-02-03 16:13:57 +01:00
Terrtia
3365a054a8
chg: [cleanup] remove ARDB + fix hive case 2023-01-18 16:28:08 +01:00
Terrtia
0e41c95b5c
chg: [MISP export + redis] refactor MISP, export all relationships between objects, relationships between investigated objects + bump redis-py version + theHive export 2023-01-16 16:27:49 +01:00
Terrtia
7fa19efc1e
fix: [data_rentention_engine] fix object first/last seen 2023-01-10 11:41:21 +01:00
Terrtia
b0891f45ec
chg: [Item] change parent-child key 2023-01-10 10:32:01 +01:00
Terrtia
d295c084c6
chg: [decoded migration] migrate Decoded Objects 2023-01-09 16:03:06 +01:00
Terrtia
b5d285b5b4
chg: [CVE] CVE search integration 2022-12-21 16:48:08 +01:00
Terrtia
82ff568feb
chg: [CVE] migrate CVE + get CVEs by daterange 2022-12-21 14:20:13 +01:00
Terrtia
bf71c9ba99
chg: [DB Migration] UI: Extract + highlight leaks and trackers match, Data Retention save object first/last date, Refactor Tools 2022-12-19 16:38:20 +01:00
Terrtia
f9715408be
chg: [migration] migrate Item + Domain metas 2022-11-30 15:50:10 +01:00
Terrtia
af583939d8
chg: [migration] migrate Screenshots + Trackers + Duplicates + fix zadd zincrby 2022-11-29 16:01:01 +01:00
Terrtia
25a8eb09c0
chg: [modules] migrate D4_client + PgpDump modules 2022-11-28 15:44:26 +01:00
Terrtia
73dbef2700
chg: [all] remove old objects + migrate cryptocurrencies module + cleanup code 2022-11-28 15:01:40 +01:00
Terrtia
4c2746a2d6
chg: [telegram] migration 2022-11-22 10:49:38 +01:00
Terrtia
aac024565f
chg: [tags] refactor tags + cleanup 2022-11-22 10:47:15 +01:00
Terrtia
104eaae793
chg: [crawler + core + cve] migrate crawler to lacus + add new CVE object and correlation + migrate core 2022-10-25 16:31:38 +02:00
Terrtia
eeff786ea5
chg: [modules + correlation] migrate Cve,Iban,Language + fix correlation graph 2022-09-20 16:11:48 +02:00
Terrtia
3b07d88709
chg: [module] refactor Iban module + fix pgp migration 2022-09-19 09:50:46 +02:00
Terrtia
01f459109f
chg: [feeder] rename bgp_monitor 2022-09-15 12:00:22 +02:00
Terrtia
c04d12cb2d
fix: [feeder] bgp_monitor class 2022-09-15 11:26:05 +02:00
Terrtia
32d19347b9
chg: [feeder] add bgp_monitor importer 2022-09-15 10:47:45 +02:00
Terrtia
f8f785970f
chg: [pgpdump] check trackers on extracted metadata 2022-09-14 11:41:24 +02:00
Terrtia
1372b1ef68
fix: [api] fix crawler api response 2022-09-14 10:27:17 +02:00
Terrtia
1254c1c9c0
chg: [api] send url to crawler 2022-09-14 10:02:38 +02:00
Terrtia
2fadbc8b87
chg: [trackers] add warnings logs 2022-09-09 11:25:51 +02:00
Terrtia
2d2e4a653e
chg: [logs] add syslog level + facility + script startup message 2022-09-08 13:40:02 +02:00
Terrtia
aa6ba61050
chg: [statistics] ARDB migration 2022-09-08 10:31:57 +02:00
Terrtia
afa23ec724
chg: [logs] add syslog server option 2022-09-02 14:26:18 +02:00
Terrtia
d27d47dc70
chg: [Kvrocks migration] rewrite obj tags + migration 2022-09-01 14:04:00 +02:00
Terrtia
9c1bfb7073
DB migration 2022-08-19 16:53:31 +02:00
Terrtia
2f8a5a333a
chg; [Duplicates module] refactor module + DB keys 2022-07-13 15:10:27 +02:00
Terrtia
8672671e51
fix: [Tracker migration] clean old Term library 2022-07-11 11:37:16 +02:00
Terrtia
1b6a9febc8
fix: [tracker typo squatting] fix perf 2022-07-08 11:27:04 +02:00
Terrtia
7a5c7dc14e
fix: [tracker typo squatting] fix cache 2022-07-08 11:23:31 +02:00
Terrtia
8eec6fc8ce
fix: [tracker typo squatting] 2022-07-08 10:55:19 +02:00
Terrtia
5725d39ed8
chg: [launcher] disable SentimentAnalysis 2022-07-08 09:53:04 +02:00
Terrtia
50f7a31820
chg: [Kvrocks migration] add users + updates + trackers + retro_hunts + investigation migration 2022-07-08 09:47:47 +02:00
Terrtia
591a2abdf3
chg: [custom tags] create + select custom tags 2022-06-24 16:50:21 +02:00
Terrtia
4660a8e88b
chg: [kvrocks] launch + install 2022-06-24 16:45:35 +02:00
Thirion Aurélien
a597eece83
Merge pull request #147 from ail-project/typo
Integration of the typo-squatting tracker
2022-06-24 16:34:48 +02:00
Thirion Aurélien
f29f33982f
fix: [typosquatting] remove unused import 2022-06-24 16:14:28 +02:00
Thirion Aurélien
885f1196ee
fix: [tracker] clean import 2022-06-24 16:08:18 +02:00
Thirion Aurélien
8908b2189e
fix; [set tracker] missing function 2022-06-24 16:07:31 +02:00
Thirion Aurélien
c0b233030e
fix: [tracker term] fix typosquatting key 2022-06-24 16:02:20 +02:00
Terrtia
5ae35c2a86
fix: [Language] fix cld3 import 2022-06-24 09:16:11 +02:00
Terrtia
860ad9b67d
chg: [investigation] fix investigation by user + delete an obj from all investigation 2022-06-22 15:35:09 +02:00
Terrtia
91010dddf1
fix: [launcher] kill AIL_2_AIL screen 2022-06-21 16:19:42 +02:00
Terrtia
a32928643b
fix: [cld3] enable cld3 2022-06-21 16:15:18 +02:00
Terrtia
4d39b2c813
fix: [cld3 python3.10] temp disable cld3 2022-06-21 14:41:36 +02:00
Terrtia
3b333826e5
fix: [launcher] remove Travis test 2022-06-21 14:38:01 +02:00
Terrtia
90862c4834
fix: [Retro Hunt] item directory 2022-06-16 17:15:41 +02:00
Terrtia
bdf2c1ff83
fix: [Retro Hunt] item directory 2022-06-16 17:11:40 +02:00
Terrtia
e54cbb3114
fix: [Retro Hunt] fix item directory 2022-06-16 16:58:07 +02:00
Terrtia
1ddf5a73ce
chg: [Retro Hunt] add logs 2022-06-16 16:31:58 +02:00
Terrtia
99a3d248e1
chg: [Retro Hunt] add logs 2022-06-16 16:19:44 +02:00
Terrtia
f1d4dd8af0
chg: [Retro Hunt] add logs 2022-06-16 15:46:53 +02:00
David Cruciani
ae83f4b0d4 chg: [Tracker} Tracker_Typo_Squatting 2022-06-15 15:28:34 +02:00
Terrtia
0900bf5b02
fix: [AIL exchange mime-type] 2022-06-08 15:22:37 +02:00
Terrtia
07cb745255
Merge branch 'master' of github.com:ail-project/ail-framework 2022-06-08 15:18:37 +02:00
David Cruciani
6e1c92e9f0 fix: [Typo] tracker typo 2022-06-07 16:18:52 +02:00
David Cruciani
9d78721f7a Merge branch 'master' into typo 2022-06-07 16:03:58 +02:00
huynenjl@gmail.com
d816f5fa08 add: [modules] zerobinz 2022-06-03 13:30:48 +00:00
Terrtia
2300751e9c
chg: [AIL2AIL Sync] update exchange format 2022-06-02 17:41:01 +02:00
Terrtia
b9ad0b1bce
chg: [AIL2AIL Sync] update exchange format 2022-06-02 16:42:20 +02:00
Terrtia
f4102dd242
fix: [Hosts module] module + launcher 2022-05-30 09:15:50 +02:00
Terrtia
43c2a27538
chg: [add Hosts module] 2022-05-30 09:03:27 +02:00
Terrtia
512e61cadc
fix: [abstract module] exception traceback #145 2022-05-20 14:45:46 +02:00
Terrtia
df4bb531d2
fix: [ui tag selector] force custom tags 2022-05-19 13:57:07 +02:00
Terrtia
34ec48e58a
fix: [sync module] fix redis tag queue 2022-05-18 15:46:27 +02:00
Terrtia
c765c86728
fix: [sync module] fix tags filter 2022-05-18 14:59:51 +02:00
Terrtia
c116713dc9
fix: [sync client] debug 2022-05-17 14:51:35 +02:00
Terrtia
7e62d0f857
fix: [sync client] debug 2022-05-17 14:46:19 +02:00
Terrtia
234148f005
fix: [sync module] debug 2022-05-17 14:39:22 +02:00
Terrtia
0635bfedb6
chg: [sync module] debug 2022-05-17 14:35:28 +02:00
Terrtia
188747417f
chg: [sync client] debug 2022-05-17 14:26:09 +02:00
Terrtia
30fdc95362
fix: [websockets client] fix client bind 2022-05-10 13:36:35 +02:00
Terrtia
19969a02b2
chg: [websockets client] bind client ip 2022-05-10 13:24:32 +02:00
Terrtia
1dfa796dca
chg: [websocket server] add host and port config 2022-05-10 11:14:29 +02:00
Terrtia
bbff018fdb
fix: [websockets] remove size limit 2022-05-10 09:50:54 +02:00
Terrtia
3cafc5eae7
chg: [telegram importer] add username correlation 2022-05-05 16:58:05 +02:00
David Cruciani
e2953fa5d1 add: [tracker] typo-squatting 2022-05-02 16:20:55 +02:00
Terrtia
c2281828d1
chg: [misp export] add username 2022-03-22 09:50:41 +01:00
Terrtia
7470792902
fix: [Investigation] edit misp event + add misp instance url 2022-03-11 15:46:29 +01:00
Terrtia
1d9fba49e8
fix: [Investigation] fix MISP Export + UI sidebar 2022-03-11 09:29:48 +01:00
Terrtia
0b426f2cfd
fix: [UI inestigations] add items link 2022-03-08 10:55:09 +01:00
Terrtia
bcac50dd7c
fix: [UI inestigations] add objects link 2022-03-08 10:44:41 +01:00
Terrtia
2d09636fbe
fix: [telegram launcher] 2022-03-08 08:50:01 +01:00
Terrtia
13d424adfa
fix: [items] abstract class 2022-03-08 08:44:34 +01:00
Terrtia
68c96ef7a7
fix: [v4.1] fix ardb # tracking DB 2022-03-07 15:54:56 +01:00
Terrtia
7e6577961b
Merge branch 'master' of github.com:ail-project/ail-framework 2022-03-07 15:12:25 +01:00
Terrtia
f40d8f47c2
chg: [v4.1] add Investigation with MISP Export + v4.1 update 2022-03-07 15:12:01 +01:00
Jean-Louis Huynen
36772372b9 add: [username] jabber support 2022-03-04 11:18:36 +01:00
Terrtia
be1eaf0dc4
fix: [Term tracker] fix item date 2022-02-16 10:19:53 +01:00
Terrtia
a75bf94a78
fix: [Telegram module] fix launcher 2022-01-19 16:25:17 +01:00
Terrtia
3d8d18bbe1
chg: [Telegram module] refactor module + fix str format 2022-01-19 16:20:18 +01:00
Terrtia
19846997d9
fix: [trackers] fix get_all_items_sources 2021-12-08 15:15:02 +01:00
Terrtia
ebcffd4b95
fix: [crawler] fix is_splash_manager_connected #133 2021-12-03 15:36:47 +01:00
Terrtia
eb6f60f033
chg: [sync UI] disable pull 2021-12-01 15:37:28 +01:00
Terrtia
b7ff905e59
chg: [sync UI] dashboard, show nb of imported items + launch/kill ail servers when a queue is subscribed/unsubscribed 2021-11-30 18:08:48 +01:00
Terrtia
0a9caf75c9
fix: [sync client] don't launch client if ail server not linked with a sync queue 2021-11-30 16:49:44 +01:00
Terrtia
23ad74c591
fix: [sync server] remove hardcoded host 2021-11-30 16:36:00 +01:00
Terrtia
e4344898b4
fix: [sync server] host 2021-11-30 16:15:25 +01:00
Terrtia
d4cf2a7cf9
fix: [sync client] fix websockets client connect for python >= 3.8 2021-11-30 15:57:28 +01:00
Terrtia
e075794fd0
fix: [ail sync] fix refresh_ail_instance_connection 2021-11-30 15:45:45 +01:00
Terrtia
7f02ade6a7
fix: [ail sync] fix refresh_ail_instance_connection 2021-11-30 15:38:55 +01:00
Terrtia
f597e1aaa2
fix: [ail sync] server + client: resend object in queue on ConnectionClosedError 2021-11-30 15:07:41 +01:00
Terrtia
d9e0d4acc5
chg: [ail sync UI] restarr/launch/kill sync connections + show sync mode api/pull/push 2021-11-30 09:32:24 +01:00
Terrtia
57f5afe831
chg: [ail sync server] add server controller + list connected clients ail_uuid->sync_modes 2021-11-29 16:18:47 +01:00
Terrtia
1412e1afef
chg: [ail sync] edit ail_servers/sync_queues + fix logs 2021-11-29 10:19:33 +01:00
Terrtia
054df7c495
chg: [api] rename endpoints 2021-11-26 17:54:15 +01:00
Thirion Aurélien
7346f81460
Merge branch 'dev' into master 2021-11-26 16:41:33 +01:00
Terrtia
cb45fe9fab
fix: [crawler] add comment 2021-11-26 16:35:51 +01:00
Terrtia
658cb73d4e
chg: [ail sync] add sync api (ping, version) + UI/client error handler 2021-11-26 16:13:46 +01:00
Terrtia
997a2c602a
chg: [v4.0 AIL SYNC / AIL 2 AIL] SYNC Manager + fixs + views 2021-11-22 23:45:41 +01:00
TonyJabbour
de9799e7ff add tracker fixed api function replaced it with internal function 2021-11-19 10:55:47 +01:00
Terrtia
966f61bb94
chg_ [AIL 2 AIL] add backend 2021-10-29 18:48:12 +02:00
Terrtia
4e481603b5
Merge branch 'master' of github.com:ail-project/ail-framework 2021-10-14 14:23:24 +02:00
Terrtia
57fbacc49c
chg: [crawler] add auto crawler functions 2021-10-14 14:23:11 +02:00
TonyJabbour
a0c978f2c7 Added get_tracker_metadata_api
Removed unnecessarily parentheses
2021-10-06 14:32:45 +02:00
TonyJabbour
fc817a5389 New API Endpoint:
Fixed get_item_content_encoded_text
Added get_item_sources
Added get_check_item_source
Added get_default_yara_rule_content
2021-10-06 11:14:11 +02:00
TonyJabbour
3c24c636f8 Removed unnecessarily parentheses 2021-10-06 11:11:10 +02:00
TonyJabbour
ddd2c81a97 New API Endpoint:
Return Item Content in base64 in non JSON format
2021-10-05 14:17:39 +02:00
TonyJabbour
4af54b7ff2 unnecessarily parenthesis removed 2021-10-04 16:19:58 +02:00
TonyJabbour
7fb796172c Base64 Problem 2021-10-04 15:54:57 +02:00
TonyJabbour
bc8df8e671 Base64 Problem 2021-10-04 15:44:41 +02:00
TonyJabbour
dd9cee83db Type fixed 2021-10-04 15:39:32 +02:00
TonyJabbour
e66b7aa19a Type fixed 2021-10-04 15:31:18 +02:00
TonyJabbour
7669373002 Error Fixed 2021-10-04 15:25:14 +02:00
TonyJabbour
c2bf5aebdf Add new API endpoint that return only content encoded in base64 2021-10-04 15:01:14 +02:00
TonyJabbour
d7c1587263 Webhook unnecessarily line removed
Removed unnecessarily parentheses
2021-10-04 13:58:04 +02:00
TonyJabbour
a2b28db32e Added a try/catch to handle exceptions
Replaced the raise to send message to redis_logger
2021-10-04 12:55:40 +02:00
TonyJabbour
912956c73c Fixed Webhook integration with Trackers 2021-09-30 14:20:08 +02:00
TonyJabbour
743dae54b6 -Fixed "description" arg
-Typo Fixed
2021-09-30 13:40:12 +02:00
TonyJabbour
4b2e9f5cfb -Fixed the 500 error issue when installing new instance of ail when adding new trackers
-Fixed missing arguments
-Typo Fixed
2021-09-30 13:37:12 +02:00
TonyJabbour
ecc16d1004 remove dict from Trackers 2021-09-28 22:56:28 +02:00
TonyJabbour
2e880c79ca Add webhook post support in yara and regex trackers 2021-09-28 22:53:09 +02:00
TonyJabbour
2319b34dcc Fix get_term_webhook 2021-09-28 22:22:59 +02:00
TonyJabbour
70ccb3cf25 Add some changes for webhook 2021-09-28 22:01:17 +02:00
TonyJabbour
30d66ef3a8 Add initial support for Webhook in Term Trackers 2021-09-28 21:11:20 +02:00
TonyJabbour
bc91c202a8 Add more support for Webhook URL 2021-09-28 20:48:47 +02:00
TonyJabbour
06a886732c Add initial UI support for Webhook in tracker 2021-09-28 20:31:19 +02:00
osagit
e063dc1ee3
fix: inherit AbstractModule to prevent stuck queues
regex compiled only at start, not in the loop
no duplicate warning string
comments
2021-09-08 10:32:47 +02:00
osagit
fc2c3ea08f
fix: error message contains http protocol twice
Error Can't connect to AIL Splash Manager, http://https://localhost:7001/
2021-09-07 11:57:17 +02:00
Terrtia
57a69fa1f4
fix: [tracker] global tracker list: fix first/last seen 2021-08-27 18:53:12 +02:00
Terrtia
564280935b
chg: [tracker + update] add update v3.7 + add map item_id:tracker_uuid (data retention) + fix tracker first_seen/last_seen 2021-08-27 18:05:21 +02:00
Terrtia
92cfe300f8
Merge branch 'master' of github.com:ail-project/ail-framework 2021-08-23 15:25:05 +02:00
Terrtia
31619a1f45
fix: [trackers] items by daterange 2021-08-23 15:24:34 +02:00
8c812fd1a8
chg: [tracker] typo fixed 2021-08-23 11:50:49 +02:00
Terrtia
ab20752d0a
fix: [Credential] fix moduleStats 2021-08-18 15:36:05 +02:00
Terrtia
adb19ea0ce
chg: [Credential + tags] add misp-taxonomies submodule + fix typo 2021-08-17 15:59:27 +02:00
Terrtia
caaa5d363f
fix: [Credemtial module] fix stats 2021-07-22 15:12:20 +02:00
Terrtia
fd98ba8226
fix: [Yara + regex trackers] remove tests 2021-07-20 14:55:45 +02:00
Terrtia
7fa018b1a0
fix: [Decoder] log level 2021-07-20 11:22:11 +02:00
Terrtia
bce6463d17
fix: [abstract_modules + Global] log message on error + fix Global exception on invalid gzip 2021-07-20 11:15:52 +02:00
Terrtia
6ade3b85dc
fix: [Credential] fix old funct call 2021-07-20 10:56:00 +02:00
Terrtia
f5332bbc5a
fix: [UI Item submit] tags input: avoid browser and password managers autocomplete 2021-07-15 15:49:04 +02:00
Terrtia
bf5c2deed2
fix: [term tracker] typo 2021-07-15 15:08:11 +02:00
Terrtia
d97305acc1
fix: [Term tracker] fix fct args 2021-07-14 16:05:51 +02:00
Terrtia
7a652b5195
fix: [crawler] fix new crawled item id 2021-07-14 15:48:17 +02:00
Terrtia
b29767a020
merge 2021-07-14 14:08:15 +02:00
Terrtia
b1793f18e4
chg: add Retro Hunt 2021-07-14 13:58:00 +02:00
Terrtia
24bc99218a
Merge branch 'dev' of https://github.com/ail-project/ail-framework into dev 2021-06-18 15:24:48 +02:00
Terrtia
a5a4de0965
chg: [UI trackers] add/edit/remove tracker source/target #43 #102 2021-06-18 15:23:18 +02:00
lpwm9803
c9a5a41a17 fix: Change module name Web to Urls 2021-06-17 18:16:31 +02:00
Terrtia
56e670077a
chg: [Trackers regex + yara] filter by item source 2021-06-17 14:48:26 +02:00
Terrtia
ec727338e6
fix: [crawlers] get_all_splash return type 2021-06-16 10:06:04 +02:00
Terrtia
759ec73f84
fix: [Splash_Manager errors] catch invalid response 2021-06-15 17:25:51 +02:00
Terrtia
2abe5217aa
fix: [Splash_Manager errors] catch invalid response 2021-06-15 17:19:57 +02:00
Terrtia
a17ab90511
chg: [Tracker term] track terms by sources 2021-06-14 17:36:30 +02:00
Terrtia
89316e1eb5
Merge branch 'master' into dev 2021-06-10 17:10:02 +02:00
Terrtia
42a23da182
chg: [modules + tests] fix modules + test modules on samples 2021-06-08 16:46:36 +02:00
Terrtia
925356f356
chg: [Launcher] update modules directory 2021-06-07 16:14:18 +02:00
Terrtia
b50c7103e7
chg: [SQLInjectionDetection LibInjection modules] add module class 2021-06-07 16:07:08 +02:00
Terrtia
73da7ae4c5
chg: [Urls (Web) module] fix regex + rename 2021-06-07 15:58:21 +02:00
Terrtia
fc11c1769b
fix: [modules] print + save traceback in logs 2021-06-07 15:08:39 +02:00
Terrtia
2f52bdb9af
chg: [Tracker_Regex module] create module class + mv module 2021-06-02 16:53:17 +02:00
Terrtia
5acb583701
chg: [Tracker_Yara module] create module class 2021-06-02 16:04:52 +02:00
Terrtia
ed37232a2d
chg: [modules] create new modules repository + small fixs 2021-06-02 14:42:23 +02:00
Terrtia
a2ebd09c2a
fix: [submit_paste] restrict source name 2021-05-28 17:37:46 +02:00
Terrtia
75bc585242
chg: [Keys] add test 2021-05-28 17:23:51 +02:00
Terrtia
0c29e1e4fa
chg: [modules] add tests: CreditCard, Global, DomClassifier 2021-05-27 17:28:20 +02:00
Terrtia
20727fff77
chg: [Categ] tests + docs 2021-05-19 16:57:20 +02:00
Terrtia
4a9bda2ee8
chg: [ApiKey] refactor module + tests 2021-05-19 14:54:34 +02:00
Terrtia
4896db98a3
chg: [launcher + modules] add module tests (Onion module) 2021-05-17 18:03:30 +02:00
Thirion Aurélien
8a95bbba87
Merge branch 'dev' into scriptsenhance 2021-05-14 14:50:42 +02:00
Terrtia
4bbff47989
chg: [AIL items + Onion] create AIL item objects + Onion module refactor 2021-05-14 14:42:16 +02:00
Lesley De Keyser
4552e4a033
Submit file contents to TheHive 2021-05-10 16:51:06 +02:00
osagit
abbde8a46a
fix: replace redis init with generic ConfigLoader
StrictRedis() replaced by ConfigLoader.get_redis_conn()
2021-05-07 14:43:25 +02:00
osagit
22693dca1c
perf: use defined compiled regex
re.compile(regex) definition was not used
use compile_regex.findAll() directely instead of re.findall(regex)
2021-05-07 14:24:41 +02:00
osagit
4d6de7a397
log message split error + perf
fix: log message split errors
perf: string affected at start
doc: comments
2021-04-30 14:14:46 +02:00
osagit
519560b0c8
fix: debug() string takes 1 positional argument 2021-04-30 10:57:48 +02:00
Terrtia
ab14ec0144
chg: [tools extract_cryptocurrency] filter by correlation objects + errors messages 2021-04-28 15:28:13 +02:00
Olivier SAGIT
f88e53925e fix: stuck queues and submit paste 2021-04-28 15:24:33 +02:00
Terrtia
00c7ec2d91
chg: [tools extract_cryptocurrency] new input: list of addresses to extract 2021-04-28 11:29:48 +02:00
Terrtia
3d620a6548
Merge branch 'master' of https://github.com/ail-project/ail-framework 2021-04-26 15:09:23 +02:00
Terrtia
f94159b684
fix: [tags] invalid tags 2021-04-26 15:08:36 +02:00
Olivier SAGIT
5404a0aa89 fix: name pystemon feeder in feeder monitor dashboard 2021-04-19 15:49:11 +02:00
Terrtia
e27f722996
chg: [tools] add 2 new tools: extract cryptocurrency correlation by type + trigger manual update 2021-04-14 16:27:39 +02:00
Terrtia
0137893882
fix: [Updater] don't check if modified config files (redis and ardb config) 2021-04-09 16:17:12 +02:00
Terrtia
010a73e273
fix: [Web module] resolver, change log level 2021-04-06 17:11:24 +02:00
Terrtia
1d222ddc9a
fix: [WebStats] typo 2021-04-02 17:23:10 +02:00
Terrtia
cb4d901be3
fix: [Indexer] debug messages 2021-04-02 17:20:03 +02:00