terrtia
|
b988f46c90
|
chg: [dom-hash] add dom-hash object compute dom-hash for domains and crawled items
CI / ail_test (3.10) (push) Waiting to run
CI / ail_test (3.7) (push) Waiting to run
CI / ail_test (3.8) (push) Waiting to run
CI / ail_test (3.9) (push) Waiting to run
|
2024-10-17 12:14:48 +02:00 |
|
terrtia
|
6d3d331fb3
|
chg: [titles] setup Titles queues + CEDetector module
|
2024-10-16 11:02:18 +02:00 |
|
terrtia
|
1112615ec3
|
chg: [crawler] disable unsafe title auto tagging
CI / ail_test (3.10) (push) Has been cancelled
CI / ail_test (3.7) (push) Has been cancelled
CI / ail_test (3.8) (push) Has been cancelled
CI / ail_test (3.9) (push) Has been cancelled
|
2024-10-14 14:27:45 +02:00 |
|
terrtia
|
2ead8c21aa
|
chg: [crawler] tag domain by vanity
CI / ail_test (3.10) (push) Has been cancelled
CI / ail_test (3.7) (push) Has been cancelled
CI / ail_test (3.8) (push) Has been cancelled
CI / ail_test (3.9) (push) Has been cancelled
|
2024-10-10 11:03:07 +02:00 |
|
terrtia
|
83e11082b5
|
fix: [crawler] filter lookup parent + domain daterange
|
2024-10-07 11:03:56 +02:00 |
|
terrtia
|
9f45202658
|
chg: [qrcode] extract qrcode content from images and screenshots + qrcode object + correlation
|
2024-10-01 15:12:15 +02:00 |
|
terrtia
|
a20b6054e8
|
fix: [crawler] fix crawler queue stats
CI / ail_test (3.10) (push) Waiting to run
CI / ail_test (3.7) (push) Waiting to run
CI / ail_test (3.8) (push) Waiting to run
CI / ail_test (3.9) (push) Waiting to run
|
2024-09-17 15:36:15 +02:00 |
|
terrtia
|
ba61d1ae69
|
chg: [modules] disable LibInjection
|
2024-09-17 14:53:50 +02:00 |
|
terrtia
|
81c4dde7b0
|
fix: [favicon] crawler favicon
|
2024-02-21 14:34:20 +01:00 |
|
terrtia
|
88fbe36f70
|
fix: [vanity] update id domains is up + min vanity = 4
|
2024-02-19 15:23:16 +01:00 |
|
terrtia
|
f07a4b422b
|
chg: [vanity] add vanity domain explorer + fix blurred screenshot + fix languages search filter
|
2024-02-19 15:14:37 +01:00 |
|
terrtia
|
b6eb6c9016
|
fix: [crawler] fix capture None domain name
|
2024-02-02 14:48:19 +01:00 |
|
terrtia
|
194ae960fc
|
fix: [crawlers] fix capture return error code
|
2024-01-30 11:35:43 +01:00 |
|
terrtia
|
d1608e89e1
|
fix: [crawlers] fix errored capture queue
|
2024-01-30 11:29:42 +01:00 |
|
terrtia
|
9c6619aed3
|
fix: [crawler] log UNKNOWN timeout
|
2024-01-26 15:31:32 +01:00 |
|
terrtia
|
7e9ea48c81
|
fix: [crawler] debug
|
2023-12-12 11:20:21 +01:00 |
|
terrtia
|
cdfc9f64e5
|
fix: [crawler] debug
|
2023-12-12 11:13:58 +01:00 |
|
terrtia
|
847d004c13
|
fix: [crawler] debug
|
2023-12-12 11:05:23 +01:00 |
|
terrtia
|
235539ea42
|
fix: [crawler] fix capture start time
|
2023-12-11 09:30:09 +01:00 |
|
terrtia
|
a382b572c6
|
chg: [crawler] push onion discovery capture_uuid to another AIL
|
2023-12-07 11:28:35 +01:00 |
|
terrtia
|
c5cef5fd00
|
chg: [core] merge master + fix object subtype correlation stats
|
2023-10-12 13:53:00 +02:00 |
|
terrtia
|
676b0f84ef
|
chg: [module + queues] track + rename object global ID by module
|
2023-10-11 12:06:01 +02:00 |
|
terrtia
|
eae57fb813
|
chg: [importers obj_type] importers queues: add feeder source + object global ID
|
2023-10-05 16:24:28 +02:00 |
|
Terrtia
|
b32f110285
|
chg: [chat + user-account] correlations + usernames timeline
|
2023-08-28 16:29:38 +02:00 |
|
Terrtia
|
f44c5509da
|
chg: [titles] add yara tracker on title + tags domains if unsafe title tags
|
2023-08-23 11:16:22 +02:00 |
|
Terrtia
|
fe2769308b
|
fix: [crawler] fix down domain + domain redirection history
|
2023-07-18 14:30:00 +02:00 |
|
Terrtia
|
a9485928db
|
chg: [HHHash] add HHHash object and correlation https://www.foo.be/2023/07/HTTP-Headers-Hashing_HHHash
|
2023-07-17 15:47:17 +02:00 |
|
Terrtia
|
c719990125
|
fix: [crawler] add timeout to Unknown captures
|
2023-07-10 11:23:44 +02:00 |
|
Terrtia
|
450ebdd789
|
chg: [etag] add new etag object
|
2023-07-06 11:26:32 +02:00 |
|
Terrtia
|
501d10bbbd
|
chg: [crawler] auto tag crawled domains
|
2023-06-20 08:11:44 +02:00 |
|
Terrtia
|
e9539e640b
|
fix: [crawler] fix incomplete response
|
2023-06-18 15:09:09 +02:00 |
|
Terrtia
|
f8fd037bd2
|
chg: [object cookie-name] add new cookie-name object + correlation
|
2023-06-16 15:39:13 +02:00 |
|
Terrtia
|
9efc348506
|
chg: [correlation] filter blank screenshots
|
2023-06-02 11:23:52 +02:00 |
|
Terrtia
|
b4f1a43208
|
chg: [correlation] correlation graph: filter title objects
|
2023-05-26 10:47:58 +02:00 |
|
Terrtia
|
c008366f02
|
chg: [new title object] add new title object + correlation on page title
|
2023-05-25 14:33:12 +02:00 |
|
Terrtia
|
9b2e8718d7
|
chg: [logs] add new logger
|
2023-05-12 15:29:53 +02:00 |
|
Terrtia
|
6b60041db2
|
chg: [crawler] add unsafe tag if domain contain unsafe screenshot
|
2023-05-10 16:28:19 +02:00 |
|
Terrtia
|
6f9e0c2f66
|
chg: [AIL queues] rewrite module queues. remove PUBSUB
|
2023-04-13 14:25:02 +02:00 |
|
Terrtia
|
bc73b0ca27
|
fix: [crawler] typo
|
2023-04-11 09:44:49 +02:00 |
|
Terrtia
|
c7eeae2a44
|
chg: [correlation] new admin enpoint delete correlation + add screenshot correlation filter
|
2023-04-06 15:13:27 +02:00 |
|
Terrtia
|
d2fdc6107e
|
fix: [cve + crawler] fix crawler lacus client refresh + typo
|
2023-04-05 09:51:42 +02:00 |
|
Terrtia
|
72d774f37b
|
fix: [queues] fix Mixer queue
|
2023-04-04 15:18:15 +02:00 |
|
Terrtia
|
2ace57c5a7
|
fix: [modules] small fixs
|
2023-04-04 14:15:35 +02:00 |
|
Terrtia
|
c7aeb0c646
|
fix: [modules] small fixs
|
2023-04-04 14:12:23 +02:00 |
|
Terrtia
|
d01780dd95
|
chg: [Mixer] refactor Mixer + fix ZMQImporter config
|
2023-03-31 14:53:20 +02:00 |
|
Terrtia
|
925d67a35e
|
chg: [crawler] add crawler scheduler
|
2023-03-14 17:36:42 +01:00 |
|
Terrtia
|
6842efc15d
|
chg: [crawler] refactor crawler tasks + migrate cookiejars + add proxy option
|
2023-02-21 12:22:49 +01:00 |
|
Terrtia
|
f9715408be
|
chg: [migration] migrate Item + Domain metas
|
2022-11-30 15:50:10 +01:00 |
|
Terrtia
|
104eaae793
|
chg: [crawler + core + cve] migrate crawler to lacus + add new CVE object and correlation + migrate core
|
2022-10-25 16:31:38 +02:00 |
|