Terrtia
7f278bd315
fix: [Flask server + cookie session] chg default cookie name (also use port number) + add Flask port number to config
2020-01-21 11:39:08 +01:00
Terrtia
165119883a
fix: [UI navbar] chg icon decoded tags
2020-01-20 16:48:19 +01:00
Terrtia
9357097d2f
chg: [UI + core] tag decoded items, fix : #455
2020-01-20 16:42:26 +01:00
Terrtia
9394ed7d43
fix: [UI show item min] fix empty modal
2020-01-20 15:19:55 +01:00
Terrtia
2b735e3b97
chg: [UI item tags search] refractor: search item tag by object, use new functions
2020-01-20 15:13:03 +01:00
mangelft
b5beb89a94
fix: change name popper.js-1.14.3 to popper-core-1.14.3
2020-01-18 12:59:40 +01:00
Terrtia
a77d16f6d7
fix: [UI] screenshot url
2020-01-14 16:46:53 +01:00
Terrtia
17ee82d9ba
chg: [UI tags] add + delete image (screenshot) tags
2020-01-14 16:14:58 +01:00
Terrtia
f06551f1a1
chg: [UI tags] add + delete image (screenshot) tags
2020-01-14 16:14:21 +01:00
Terrtia
5f8b81fd85
chg: [UI domain] add input: show domain by name
2020-01-13 14:24:35 +01:00
Terrtia
514911eb62
fix: [UI tags] fix domain links
2020-01-13 11:50:05 +01:00
Terrtia
12bac87cf3
chg: [tags blueprint] clean code
2020-01-13 11:29:45 +01:00
Terrtia
fb320ca5d5
chg: [UI tags] search domains by tags
2020-01-13 11:10:03 +01:00
Terrtia
99897ffa9b
chg: [core + UI] search domain by tags
2020-01-10 16:52:55 +01:00
Terrtia
b4a36d812f
Merge branch 'master' into tags_v2
2020-01-09 15:11:37 +01:00
Terrtia
ce3d98d620
chg: [Update v2.7] add update v2.7 scripts
2020-01-09 15:07:51 +01:00
Terrtia
91ce045d91
fix: [UI term] remove deprecated trending charts, fix #446 #447
2020-01-09 11:12:58 +01:00
Terrtia
3a691a4af3
chg: [tags UI] edit object tags (delete tags)
2020-01-08 17:11:37 +01:00
Terrtia
85d5770e80
chg: [Tag core] objects tagging, Part 2/2
...
TODO: UI tags domain + screenshot + object rename paste=>item
2020-01-07 16:14:56 +01:00
Terrtia
b557b7fed8
chg: [Tag core] objects tagging, Part 1/2
...
TODO UI (tags) + rename paste=>item
2020-01-07 14:30:52 +01:00
Terrtia
2be06973ee
chg: [Tag core] objects tagging, Part 1/2
2020-01-06 17:07:52 +01:00
Terrtia
bda367f7f0
fix: [UI decoded item] sort mimetype
2019-12-19 16:24:47 +01:00
Terrtia
9ec610ecc3
chg: [correlation graph UI] add json error handler + add loading status
2019-12-19 11:09:22 +01:00
Terrtia
66f251d654
fix: [UI showDomain] fix screenshot accordeon
2019-12-18 16:45:44 +01:00
Terrtia
7dbc96cee2
chg: [UI correlation graph + UI domain] correlation screenshot: show img in toolip + show hash in ShowDomain
...
TODO: pixelate images
2019-12-18 16:17:29 +01:00
Terrtia
056bad7a49
chg: [screenshot correlation + v2.6] add screenshot-domain correlation + v2.6 update
2019-12-17 15:13:36 +01:00
Terrtia
a3939b77f9
fix: [UI correlation graph] typo
2019-12-16 15:58:57 +01:00
Terrtia
b4f49f9e81
fix: [UI showDomain] fix down domain history
2019-12-16 15:55:50 +01:00
Terrtia
fffb4464c6
fix: [Domain] domain was up
2019-12-16 15:24:47 +01:00
Terrtia
fb6324d4e6
fix: typo
2019-12-16 14:36:34 +01:00
Terrtia
28ece38d82
chg: [API] get domain min metadata (first up, last up) + get crawled domain by daterange and status
2019-12-16 14:31:31 +01:00
Terrtia
e71a181bb9
chg: [API] get domain metadata (minimal)
2019-12-11 13:58:43 +01:00
Terrtia
d45d02b667
chg: [UI correlation graph] popover: add loading status + chg css
2019-12-10 15:41:47 +01:00
Terrtia
9702c12b7f
chg: [correlation UI] add basic popover
2019-12-09 16:56:07 +01:00
Terrtia
ede6c22c2d
fix: [UI] fix show paste modal
2019-12-09 09:38:13 +01:00
Terrtia
2d02251456
fix: [screenshot canevas + domain link] fix item domain link + screenshot canevas: chg colors and icons for unsafe tags
2019-12-05 10:00:52 +01:00
Terrtia
2cf419fc26
fix: [Paste submit] fix tags unpack
2019-12-02 17:15:48 +01:00
Terrtia
9898766ed7
fix: [Show Domain UI] fix screenshot link, fix #431
2019-12-02 14:26:59 +01:00
Terrtia
0af359e5e5
chg: [Showpaste] check if tags are safe (img) + fix domain link
2019-11-25 18:11:20 +01:00
Terrtia
7caea17c1f
chg: [crawler dashboard UI] add UP/Down domains url
2019-11-25 11:26:18 +01:00
edcfb4fcaa
Merge pull request #422 from CIRCL/misp_modules
...
Misp modules
2019-11-25 10:12:32 +01:00
Terrtia
7c7f3677ba
fix: [RoleManager] remove debug print
2019-11-25 10:06:04 +01:00
Terrtia
d5f6ffe84b
fix: [correlation] merge conflict
2019-11-22 15:34:56 +01:00
Terrtia
46f6f648a0
chg: [Correlation UI] btc address: get related transaction input/output
2019-11-22 15:30:11 +01:00
Terrtia
1573f5e495
Merge branch 'master' into misp_modules
2019-11-22 15:25:46 +01:00
Terrtia
1ae43d5b31
fix: [show paste min UI] typo
2019-11-21 14:33:57 +01:00
Terrtia
f56e25e1d9
fix: [show paste min UI] fix correlation url
2019-11-21 14:32:20 +01:00
Terrtia
e42bfae799
fix: [show paste min UI] fix correlation url
2019-11-21 14:29:42 +01:00
Terrtia
00c2b139c6
fix: [Correlation UI] fix decoded file type + exist_correlation_id
2019-11-21 10:32:51 +01:00
Terrtia
8d0c2a7b13
chg; [User role] add roles: user + user_no_api + read_only
2019-11-20 16:15:08 +01:00
Terrtia
69457ca75e
fix: [showDomain UI] fix template
2019-11-20 13:25:01 +01:00
Terrtia
d573dfde1a
fix: [showDomain UI] fix template
2019-11-20 13:16:09 +01:00
Terrtia
8a974eac6c
fix: [showDomain UI] fix template
2019-11-20 13:10:01 +01:00
Terrtia
73afdfa227
chg: [Domain UI] add total_nb_correlation
2019-11-19 14:30:12 +01:00
Terrtia
15bd1cc78f
chg: [Domain UI] add unsafe_tags_check (taxo: dark-web + copine-scale) + hide unsafe domain img
2019-11-19 14:03:23 +01:00
Terrtia
ae9cd1d355
chg: [Corrrelation UI] add 404 return
2019-11-19 09:02:25 +01:00
Terrtia
2cdec205c7
fix: [correlation UI] clean script
2019-11-18 16:38:14 +01:00
Terrtia
7d442646c2
chg: [Correlation UI] add metadata card and item link: paste + domain
2019-11-18 16:35:40 +01:00
Terrtia
39be4ef916
chg: [Correlation UI + default taxonomies] add dark-web to default taxonomies + fix domain correlation url
2019-11-18 09:46:15 +01:00
Terrtia
dd4ca9966a
fix: [showpaste url] fix decoded url
2019-11-17 15:17:33 +01:00
Terrtia
2e921a12f2
chg: [UI] show correlation (pgp. decoded, cryptocurrency) migration
2019-11-15 17:22:50 +01:00
Terrtia
bb03ef532b
chg: [Correlation UI] add correlation blueprint + UI graph correlation
2019-11-14 17:05:58 +01:00
Terrtia
e42ec48380
chg: [Correlation Graph] add correlation by pgp, cryptocurrency, decoded and item + request correlation by type(pgp, ...) + objects(domain, paste)
2019-11-13 16:46:28 +01:00
Terrtia
504e45a43b
chg: [Correlation domain] add correlation graph by domain (union + intersection)
2019-11-12 17:08:52 +01:00
Terrtia
c5510acb73
fix: [Cryptocurrency] fix import conflict
2019-11-11 10:29:36 +01:00
Terrtia
880c351c0c
chg: [update + show decoded items] add background update
2019-11-08 16:00:42 +01:00
Terrtia
6b9ba9d377
chg: [Domain] Show last origin
2019-11-08 09:25:09 +01:00
Terrtia
63b3d5a5f9
fix: [showDomain] fix url pgp + cryptocurrency
2019-11-05 16:53:30 +01:00
Terrtia
c8d5ce9a28
chg: [core] mv bin/packages/config.cfg configs/core.cfg + use ConfigLoader
2019-11-05 15:18:03 +01:00
Terrtia
3c6e424ac3
chg: [UI Domain] UI: tag domain
2019-11-05 09:49:51 +01:00
Terrtia
a3e5e44c9b
chg: [core + UI] refractor Domain + Show Domain, better handle of ports, select screenshot on the UI, ...
2019-10-31 17:14:23 +01:00
Terrtia
a2d6874417
chg: [Domain + UI Crawler] refractor show domain
2019-10-30 17:12:04 +01:00
Terrtia
f1def65c89
chg: [lib ConfigLoader] add configLoader class
2019-10-28 13:48:43 +01:00
Terrtia
9051c4081b
fix: [url_prefix] add root blueprint, fix:#403
2019-09-25 08:58:18 +02:00
Terrtia
839443500d
chg: [Cryptocurrency, RegexTracker] uptdate cryptocurrency list + fix: RegexTracker typo
2019-09-22 14:57:23 +02:00
Terrtia
fed04e8e5a
chg: [Tracker] add optionnal description field
2019-09-13 16:33:34 +02:00
Terrtia
5734205828
chg: [API] add Tracker documentation
2019-09-13 11:40:09 +02:00
Terrtia
fb35be77f4
chg: [Tracker] add more info
2019-09-13 11:06:41 +02:00
Terrtia
a42676fbce
fix: [sparkline] datatable drawing
2019-09-12 14:49:08 +02:00
Terrtia
d41ee58a67
fix: [d3 graph] fix script path
2019-09-12 14:37:48 +02:00
Terrtia
55f4b72054
fix: [d3 js plugin]
2019-09-12 14:15:18 +02:00
Terrtia
ccdcfcd954
fix: [template] add trackers
2019-09-12 14:00:44 +02:00
Terrtia
01ff202ae8
chg: [update] add v2.2 update + fix default update + fix Empty Item.get_tags() + add new LAUNCHER options
2019-09-12 13:25:29 +02:00
Terrtia
934d631f7a
chg: [tracker] add missing btn
2019-09-11 15:37:31 +02:00
Terrtia
0ced25f3be
chg: [trackers] filter trackers list by type + minor fix
2019-09-11 15:33:04 +02:00
Terrtia
ad65ed7c8e
chg: [UI sparklines] sparklines: fix + factory
2019-09-06 16:52:51 +02:00
Terrtia
bd8735a6e5
chg: [merge] master
2019-09-04 10:24:46 +02:00
Terrtia
2ec96586eb
fix: [UI caching] avoid domain archive caching
2019-09-03 13:42:17 +02:00
Terrtia
ebf87f71b3
fix: typo
2019-09-03 12:00:24 +02:00
Terrtia
6dcecd6ba6
fix: [UI caching] fix : #373 avoid screenshot caching
2019-09-03 11:58:34 +02:00
Terrtia
dfd1128daa
chg: [api] add new endpoints: get bitcoin/pgp name/pgp keys/pgp mail metadata + items list
2019-08-16 17:59:44 +02:00
Terrtia
7ed09bc923
chg: [UI term tracker] refractor term management: trackers list + show trackers + add new trackers
2019-08-14 09:44:49 +02:00
Terrtia
80f9535074
chg: [api] add endpoint: get tracked item_id by uuid and daterange
2019-08-09 17:07:54 +02:00
Terrtia
4b0819a644
chg: [api] add endpoint: delete tracker term (regex/set/word)
2019-08-09 15:22:57 +02:00
Terrtia
bb6d3a6a26
chg: [Term tracker] add term tracker module (word + set) + API: add new term to track (word + set + regex)
2019-08-07 12:08:24 +02:00
Terrtia
28320a32a6
chg: [term] refractor + add new tracked word/set
2019-08-06 17:03:49 +02:00
Terrtia
0a071a5165
chg: [api] 405 response: add url to api endpoint documentation
2019-08-06 11:29:12 +02:00
Terrtia
071a206d5e
fix: [api] chg api role
2019-08-06 10:37:56 +02:00
Terrtia
88592dae57
chg: [api] add bruteforce protection
2019-08-06 10:22:09 +02:00
Terrtia
fa133ce12c
fix: [test api] typo
2019-08-05 16:31:03 +02:00
Terrtia
e28d563523
chg: [api] use POST with parameters + add API unittest
2019-08-05 16:00:23 +02:00
Terrtia
fea7b07134
chg: [api] add api versioning
2019-08-05 09:46:56 +02:00
Terrtia
5e1ae8a893
chg: [api] add new endpoints: get tag metadata + get all tags
2019-08-01 14:36:52 +02:00
Terrtia
98fb6ecef7
fix: [api doc] typo
2019-08-01 13:43:28 +02:00
Terrtia
4c20f58a52
chg: [api] add advanced get item via POST + use same query for each get item
2019-08-01 13:16:57 +02:00
Terrtia
8c02c1b00b
chg: [api] add 404 errors code + add future endpoints in doc
2019-08-01 09:45:59 +02:00
Terrtia
918b4c28ed
fix: [api] fix errors handler 404 405, return json
2019-07-31 13:24:43 +02:00
Terrtia
44cf5bb4af
chg: [API v1] add API documentation + update/delete items tags + Flask_tags refractor
2019-07-30 13:49:21 +02:00
Terrtia
6af9514a48
chg: [API] add GET: item metadata + item content + item tags
2019-07-26 15:44:29 +02:00
Terrtia
0a756294fe
chg: [API] import item (text)
2019-07-26 14:28:02 +02:00
Terrtia
3a8531cafa
chg: [API + import] add API format + item_import refractor
2019-07-25 17:26:32 +02:00
Terrtia
44d6eb8570
chg: [rest API] access: check token user role
2019-07-11 13:58:15 +02:00
Terrtia
8483ec8f90
fix: [role_manager] add password characters
2019-07-05 15:23:16 +02:00
Terrtia
add0a95814
fix: [secrets import] use urandom
2019-07-05 15:20:47 +02:00
Terrtia
71abe1ebc8
Merge branch 'master' into user_management
2019-07-04 11:36:07 +02:00
Terrtia
65584196e8
fix: [items submit UI] fix tags dropdown
2019-07-04 11:34:54 +02:00
Terrtia
34786d54db
Merge branch 'master' into user_management
2019-07-02 14:12:28 +02:00
Terrtia
5f157c52d8
chg: [Flask login] add brute force protection + log login errors
2019-06-26 16:36:40 +02:00
Terrtia
d26b55973c
fix: [MISP export] fix event creation
2019-06-25 14:55:03 +02:00
Terrtia
3357b855de
fix: [UI items_submit] add active tag + fix template name
2019-06-25 14:18:39 +02:00
Terrtia
9a883aef23
chg: [UI submit items] bootstrap 4 migration
2019-06-25 14:11:30 +02:00
Terrtia
27ae671b3d
fix: [UI login/change_password] add missing ail-logo
2019-06-24 17:14:16 +02:00
Terrtia
c759142ca2
fix: [UI settings] fix toggle_sidebar
2019-06-24 14:37:52 +02:00
Terrtia
be251289a7
chg: [Flask server] https support + create self signed certificate
2019-06-24 13:43:16 +02:00
Terrtia
bb65179e50
fix: [user_management] fix tokens duplicate + check user_acl_integrity + add login errors messages
2019-06-20 15:49:40 +02:00
Terrtia
a9837c6e27
chg: [user_management 2.0] add update scripts + fix create_default_user
2019-06-20 14:47:59 +02:00
Terrtia
821cf3cbea
chg: [UI user_management] user_role acl: hide admin panel
2019-06-20 11:15:56 +02:00
Terrtia
7ecd43db99
chg: [UI user_management] incorrect passwords: display errors
2019-06-20 10:56:31 +02:00
Terrtia
e4ab9b6a05
fix: [server endpoint] unknow users: avoid endpoint enumeration
2019-06-20 10:11:23 +02:00
Terrtia
ef716f22e5
chg: [user_management endpoint] check user roles + add 503 template
2019-06-19 17:02:09 +02:00
Terrtia
6eec0aabfe
Merge branch 'master' into user_management
2019-06-19 15:11:44 +02:00
Terrtia
34e57fe7af
chg: [user_managemant] clean code + check password and email length
2019-06-19 15:00:25 +02:00
Terrtia
8ca6e1a73c
chg: [UI dashboard + search] bootstrap 4 migration: dashbaord + fix search input
2019-06-18 16:19:27 +02:00
Terrtia
fbeac2340d
chg: [UI crawler, show_domain] domain history: remove target blank
2019-06-18 11:01:54 +02:00
Terrtia
e1bf59aded
chg: [UI crawler, show_domain] add domain history list + navigation
2019-06-18 10:58:37 +02:00
Terrtia
5183a3492a
chg: [UI crawled domains] Download all domain content (HTML + HAR + screenshot)
2019-06-12 10:58:13 +02:00
Terrtia
5b58872b15
chg: [user_management UI] add admin section: edit + create users
2019-06-11 17:37:20 +02:00
Terrtia
9c2d290580
chg: [user_management UI] edit my_profile + renew api tokens
2019-06-07 17:14:11 +02:00
Terrtia
e71daac7d2
fix: [backend crawler] rename downloaded archive
2019-06-07 13:53:33 +02:00
Terrtia
b4f06c21f9
chg: [backend crawler] domains: download 1 archive by crawled (most recent)
2019-06-07 13:47:44 +02:00
Terrtia
3fe9d14e9f
chg: [user_management] create default admin user (temp passwd save in AIL_HOME) + change password UI + logout UI + create random password
2019-06-06 21:27:13 +02:00
Terrtia
99e35c51ec
Merge branch 'master' into user_management
2019-06-05 16:59:36 +02:00
Terrtia
0d3d4aae1d
fix: [paste_submit UI] filter empty file field
2019-06-05 16:41:59 +02:00
Terrtia
601ea8f13e
chg: [paste_submit UI] add debug
2019-06-05 16:31:35 +02:00
Terrtia
1929b2c6a7
fix: [paste_submit UI] filter empty file field
2019-06-05 16:18:30 +02:00
Terrtia
9cb6312279
fix: [UI crawler endpoints] display crawler status + fix #353
2019-06-04 14:22:46 +02:00
f09bb63a35
chg: [template] the "item" project
2019-05-25 09:51:49 +02:00
Terrtia
8dfe8fec91
fix: [correlation] fix graph node endpoint
2019-05-24 14:14:07 +02:00
Terrtia
bc6332dae4
fix: [correlation] fix endpoint
2019-05-24 13:19:11 +02:00
Terrtia
eb9c81acef
chg: [correlation] clean files
2019-05-24 13:08:10 +02:00
Terrtia
4794cafe01
chg: [correlation] add cryptocurrency + refractor correlation
2019-05-24 12:02:43 +02:00
Terrtia
ff23a2bce2
chg: [Bitcoin] map cryptocurrency: bitcoin (DB pivot)
2019-05-21 16:14:09 +02:00
Terrtia
da5579875d
chg: [pgpdump] reprocess tagged items + fix pgpdump
2019-05-20 14:32:07 +02:00
Terrtia
9639a51abd
chg: [PgpDump] fix graph + add new tags: pgp-signature pgp-public-key-block + avoid keys injection in pgp user_id
2019-05-20 11:57:49 +02:00
Terrtia
7e8ba8cdaf
chg: [decoded UI] add PgpDump UI + fix hashdecoded js
2019-05-17 17:51:07 +02:00
Terrtia
cca69def71
chg: [decoded items] bootstrap 4 migration
2019-05-15 17:23:58 +02:00
Terrtia
f2ca241e4f
chg: [restapi] add rest api authentification + create default user
2019-05-08 14:58:41 +02:00
Terrtia
1dac8177fe
chg: [user_management] add user role_management
2019-05-06 16:58:36 +02:00
Terrtia
2606220c2b
fix: [faup] fix new return types (bytes to str)
2019-05-06 13:38:13 +02:00
Terrtia
cc61c99290
fix: [showpaste] fix : #346 , avoid None screenshots
2019-05-06 10:00:39 +02:00
Terrtia
64ff94ce5f
chg: [user_management] create + check user password
2019-05-03 16:52:05 +02:00
Terrtia
9b66fa703f
fix: [crawler] typo: domains down
2019-05-03 10:04:20 +02:00
Terrtia
1ab1a55a4f
chg: [UI] add basic user management
2019-05-02 17:31:14 +02:00
Steve Clement
57a344cfab
fix: [travis] Next round of travis fixes. LAUNCH.sh is the only launch script needed.
...
chg: [installer] Be way more quiet, watching unzips is only fun during development.
chg: [installer] Make the arch one +x
2019-05-01 20:49:07 +09:00
0f2b139625
chg: [hashDecoded] cleanup for the VT message + PEP
2019-04-30 15:50:06 +02:00
Terrtia
a183695ddb
chg: [crawler UI] bootstrap 4 migration: show domains by daterange + bug fix hidden services tags
2019-04-26 15:14:29 +02:00
Terrtia
3e6fbc8f79
fix: [paste submit] update broken endpoint + get item date
2019-04-26 10:04:07 +02:00
Terrtia
e6dca7f8bf
chg: [update v1.5] add background update: screenshots_crawled
2019-04-24 16:19:35 +02:00
Terrtia
9868833c77
chg: [crawled screenshot] use sha256 as filepath
2019-04-24 14:09:04 +02:00
Terrtia
4ecff21194
chg: [UI crawler] add splash dashboard
2019-04-23 14:26:26 +02:00
Terrtia
2a1cd4a009
chg: [Onion, crawler config] auto crawler: add config by url, fix onions tagging + filter subdomains
2019-04-23 11:15:34 +02:00
Terrtia
6fdf7c2123
chg: [UI crawler] status/remove auto crawler
2019-04-18 16:57:51 +02:00
Terrtia
ecca5b11d0
fix: [UI dashboard] typo
2019-04-18 11:01:11 +02:00
Terrtia
de285ed64c
chg: [UI DOC] add dynamic update message + add bootstrap 4 migration message + add update doc (DB)
2019-04-18 10:56:00 +02:00
Terrtia
7a5fac9a43
fix: [UI show domain] fix domain/port unpacking
2019-04-18 09:54:25 +02:00
Terrtia
ddaad5db93
chg: [v1.5 background update] create update stats
2019-04-17 17:07:09 +02:00
Terrtia
4bff603d4f
chg: [settings UI] add background update progress
2019-04-17 14:39:29 +02:00
Terrtia
3b11df7f90
chg: [UI] add server Management, check if new update/version are available + background update status + link to new realease/commits
2019-04-16 17:24:59 +02:00
Terrtia
ddf043059a
chg: [UI] update nav bar endpoint
2019-04-15 17:14:48 +02:00
Terrtia
346e26433a
fix: [Update tags + UI] use srandmember + display update warning
2019-04-15 14:30:28 +02:00
Terrtia
3f1e68f638
fix: [tracked terms] show mime type
2019-04-15 13:36:14 +02:00
Terrtia
a43467a0f2
chg: [Update v1.5] update tracked terms path
2019-04-15 13:27:46 +02:00
Terrtia
fc1a04336c
fix: [dynamic update v1.5] make sure updates are excuted in the correct order + fix nb_seen_hash dynamic update
2019-04-15 11:01:33 +02:00
Terrtia
1ed9468881
fix: [UI showpaste] min preview
2019-04-11 13:44:20 +02:00
Terrtia
3cc614a1ad
chg: [DB] update items tags metadata
2019-04-11 11:58:06 +02:00
Terrtia
e83174327a
chg: [DB] remove absolute path
2019-04-10 17:47:40 +02:00
Terrtia
d44acea04d
chg: [merge] merge update into advanced_crawler
2019-04-10 16:41:06 +02:00
Terrtia
2589fc2161
chg: [merge] merge master into update branche
2019-04-10 15:43:15 +02:00
Terrtia
b4bee29a33
Merge branch 'master' into advanced_crawler
2019-04-10 15:37:42 +02:00
Terrtia
6165987ec3
chg: [DB Migration] add hash dynamic update
2019-04-10 15:36:41 +02:00
Terrtia
870fa1981c
fix: [update_thirdparty] detect and use virtualenv
2019-04-02 09:50:52 +02:00
Terrtia
f64c385343
chg: [Crawler] handle port: crawling + history
2019-03-22 16:48:07 +01:00
Terrtia
f4cdddbc7f
chg: [UI + item submit] remove browse paste from UI + fix pasteSubmit tagging
2019-03-21 11:50:53 +01:00
Terrtia
51eb951a47
fix: [UI terms] update tags endpoint
2019-03-21 11:34:21 +01:00
Terrtia
c2bc72c72e
chg: [Tags alertHandler] remove alertHandler + add quick tag search sidebar + use tag last_seen to display tagged items
2019-03-21 11:11:53 +01:00
Terrtia
ce6475e96e
chg: [tags] remove/add tags by daterange + improve item loading time
2019-03-20 15:57:55 +01:00
Terrtia
8b5266706e
fix: [Tags] cast nb_max_page to int
2019-03-20 13:33:12 +01:00
Terrtia
a9e86231ad
chg: [Tags] add backend, daterange selector
2019-03-20 13:25:02 +01:00
Terrtia
65e6eae00d
chg: [UI preview items] b4 migration + new template + better display + decrease item loading time + add basic animation/transition
2019-03-19 13:34:41 +01:00
Terrtia
e9bac098c9
fix: [UI Tags] paste preview
2019-03-15 11:16:44 +01:00
Terrtia
23d9cb2265
chg: [UI Tags search] bootstrap 4 migration
2019-03-14 17:04:55 +01:00
Terrtia
9e4813ca4b
chg: [UI Tags] start b4 migration + add date range selector
2019-03-12 13:37:15 +01:00
Terrtia
d3b3942ad7
chg: [Flask UI] refractor crawler frontend + show crawled domain
2019-03-06 15:05:58 +01:00
Terrtia
6f5f880b7d
chg: [Crawler UI] add basic tooltips
2019-03-01 11:40:43 +01:00
Terrtia
93c7db86e4
chg: [Crawler UI Flask] refractor functions, templates
2019-02-28 14:56:14 +01:00
Terrtia
460f70fee6
chg: [css] add basic toggle sidebar
2019-02-27 16:58:17 +01:00
Terrtia
aaf4712877
fix: [UI crawler manual] fix min input
2019-02-26 15:39:52 +01:00
Terrtia
c0d72e7d2a
chg: [Crawler UI] Crawler major refractor (end) + basic UI for manual crawler
2019-02-26 14:50:48 +01:00
Terrtia
e5dca268a8
chg: [Crawler] refractor
2019-02-21 09:54:43 +01:00
Terrtia
0832784f7a
chg: [thirdparty_update] get b4 datatable
2019-02-19 11:56:08 +01:00
Terrtia
da78d0552d
chg: [Crawler UI Tags] add tag by day + add crawler status + UI onion blacklist
2019-02-19 11:41:45 +01:00
Terrtia
95d63daaf4
chg: [Crawler UI] fix css + bootstrap4 migration
2019-02-15 17:00:07 +01:00
Terrtia
674a9a2591
chg: [UI] font icon v5 + navbar + sidebar
2019-02-08 17:16:58 +01:00
Terrtia
c2885589cf
chg: [UI] basic navbar + sidebar + refractor
2019-02-07 17:22:44 +01:00
Terrtia
516238025f
chg: [Crawler] add bootsrap4 src + refractor crawler
2019-02-05 17:16:44 +01:00
Terrtia
423c7b1455
fix: [UI] fix flot js install
2019-02-04 14:56:54 +01:00
Terrtia
655646b7c5
fix: [hiddenServices] catch empty data
2019-01-29 16:43:56 +01:00
Terrtia
c1b34bd99c
fix: [Crawler] limit max crawled pages
2019-01-29 15:38:00 +01:00
Terrtia
7a80683f13
chg: [hiddenServices] crawlers status, dynamic update
2019-01-29 14:27:50 +01:00
Terrtia
b9572e0085
fix: [Crawler] typo
2019-01-29 12:19:10 +01:00
Terrtia
bb301a870c
fix: [Crawler] fix onion blacklist + add crawler info
2019-01-29 12:00:14 +01:00
Terrtia
c4c3810037
fix: [hiddenServices] typo
2019-01-08 15:51:39 +01:00
Terrtia
46c1105483
chg: [hiddenServices] auto update last crawled domains
2019-01-08 15:48:40 +01:00
Terrtia
77211c5496
chg: [hashDecoded] add top5 types piechart (v0.1)
2018-12-24 11:42:55 +01:00
Terrtia
f023f41ae5
fix: cleaning ...
2018-12-21 15:21:08 +01:00
Terrtia
e93a0b637c
chg: [hashDecoded] add option to display decoded files, fix #271
2018-12-21 15:18:07 +01:00
Terrtia
306815a31d
fix: [hiddenServices UI] fix none type
2018-12-20 09:08:14 +01:00
Terrtia
6ee4b7bf93
Merge branch 'master' into update
2018-12-19 15:23:34 +01:00
Terrtia
4e08aaa80f
chg: [UI Crawled Domains] show crawled domains by date range (options: domains tags, up domains, down domains)
...
todo: Shows domain history
2018-12-17 15:58:48 +01:00
Terrtia
31a8dfe0b3
fix: [AIL] use only relative paths
...
pastes duplicates are fixed on the fly
2018-11-21 16:45:25 +01:00
Terrtia
d9b776d58a
merge master
2018-11-14 15:55:42 +01:00
Sami Mokaddem
62e46b6dc1
Merge pull request #287 from CIRCL/term_management
...
Term management upgrade
2018-11-08 14:10:25 +01:00
Terrtia
173c0a15c6
fix: [term_management] delete tags
2018-11-08 12:01:40 +01:00
Terrtia
4e906ff841
fix: [term_management] delete emails
2018-11-08 10:41:37 +01:00
Terrtia
0adb8b4624
chg: [terms_management] delete terms tags
2018-11-07 15:37:25 +01:00
Terrtia
46614c97c8
chg: [terms_management] delete email
2018-11-07 11:42:31 +01:00
Terrtia
2c46c7f2ab
fix: [tag export] limit custom tag lenght
2018-11-07 10:17:57 +01:00
Terrtia
f91aba5f6f
chg: [tag export] UI, add custom tags
2018-11-07 09:41:58 +01:00
Terrtia
0ad80a22ca
fix: [update_thirdparty] upgrade github source
2018-11-06 17:04:02 +01:00
Terrtia
a3fa5a4dcf
chg: [auto push tag] delete unwanted tags
2018-11-06 16:08:58 +01:00
Terrtia
979472df15
chg: [Terms] tag tracked terms
2018-11-06 13:38:37 +01:00
Terrtia
af1ff6225e
fix: [Search] tags display
2018-11-05 10:36:58 +01:00
Terrtia
5c67297dc8
fix: [Search] Improve search performance
...
note: search by paste name is temporary disabled
2018-11-05 10:13:48 +01:00
Terrtia
5872cf9196
fix: [Scripts] Remove absolute path
2018-11-02 16:07:27 +01:00
Terrtia
ea7fd8d54c
fix: [Duplicate] show duplicate with relative path
2018-10-24 15:47:03 +02:00
Terrtia
6328cc22b7
chg: [Crawler] add domains blacklist
2018-09-28 16:29:09 +02:00
Terrtia
b3a6dc8487
fix: [Crawler] remove hardcoded url
2018-09-28 15:42:06 +02:00
Terrtia
3dd20af4d1
Merge branch 'master' into onion_crawler
2018-09-28 15:29:24 +02:00
Terrtia
82e6df4b94
chg: [Crawler] domains stats + logs + clean
2018-09-28 15:23:27 +02:00
Terrtia
ecb2857151
chg: [Crawler] css + limit splash RAM
2018-09-27 16:47:48 +02:00
Terrtia
ff0affc679
fix: [Flask] remove hardcoded url
2018-09-26 11:59:51 +02:00
Terrtia
3a72f1548d
fix: [Flask] remove hardcoded url
2018-09-25 16:46:06 +02:00
Terrtia
b3923428e5
fix: [Flask] remove hardcoded url
2018-09-25 14:37:14 +02:00
Terrtia
e4a5f66a10
Merge branch 'master' into onion_crawler
2018-09-24 16:35:04 +02:00
Terrtia
874824a589
fix: [Crawler] clean
2018-09-24 16:28:55 +02:00
Terrtia
50c81773e9
chg: [Crawler] add launcher and install
2018-09-24 16:23:14 +02:00
Terrtia
6edc1ddbeb
chg: [HiddenServices] get domain related to other domains
2018-09-21 10:34:06 +02:00
Terrtia
61b4c9e579
chg: [Flask] add prefix in config to flask routes
2018-09-20 10:56:29 +02:00
Terrtia
5eadc2755f
chg: [Flask] add prefix in config to flask routes
2018-09-20 10:38:19 +02:00
Terrtia
5732d7b134
fix: [hashDecoded] range_type_json
2018-09-19 15:36:33 +02:00
Terrtia
912f2352ab
fix: [crawled screenshot] fix img error
2018-09-18 16:58:49 +02:00
Terrtia
ce63d81878
chg: [UI] pixelate crawled screenshot by default
2018-09-18 11:51:21 +02:00
Terrtia
f5b648d72a
pixelate paste screenshot
2018-09-18 11:03:40 +02:00
Terrtia
094b211259
fix: [showpaste] path transversal
2018-09-17 15:42:22 +02:00
Terrtia
0c63f2f24f
chg: [Crawler] catch server response
2018-09-17 15:35:06 +02:00
Terrtia
6f0817365a
chg: [Crawler UI] display domain information
2018-09-12 09:55:49 +02:00
Terrtia
ca982e13e1
chg: [Crawled Domain] show crawled pastes by domain
2018-08-27 14:34:08 +02:00
Terrtia
40772a5732
fix: merge
2018-08-27 11:30:19 +02:00
Terrtia
823c33174a
Merge branch 'master' into onion_crawler
2018-08-27 11:20:51 +02:00
Terrtia
d42dd118a4
chg: [Domain crawled] add random screenshot
2018-08-27 11:02:39 +02:00
Terrtia
6c981ea5e9
fix: [HashDecoded] typo
2018-08-24 11:58:54 +02:00
Terrtia
ab452841b1
fix: [HashDecoded] change template title
2018-08-24 11:51:16 +02:00
Terrtia
e6b583ee7a
chg: [Hash] add Help on graph node
2018-08-24 11:40:09 +02:00
Terrtia
a586548047
Merge branch 'master' into base64
2018-08-24 10:35:28 +02:00
Terrtia
7e24943537
chg: [Crawler] crawler accept all kind of domains
2018-08-24 10:13:56 +02:00
Terrtia
e9580d6775
chg: [Crawler] change BDD, save i2p links
2018-08-21 15:54:53 +02:00
Terrtia
ed559d9f4a
chg: [Showpaste] add screenshot + improve onion db
2018-08-16 17:24:39 +02:00
Terrtia
54cc4f3723
fix: [UI-Showpaste] show raw paste, force text/plain mimetype
2018-08-03 09:15:34 +02:00
Terrtia
911cff70da
chg: [UI] add AIL icon, fix li links
2018-08-02 10:44:47 +02:00
Terrtia
deaebaa4fd
fix: [UI-Hash] pie chart json
2018-07-27 13:51:29 +02:00
Terrtia
009f87ee10
[fix: [UI-hash] fix graph node zoom
2018-07-27 11:27:41 +02:00
Terrtia
b02cbee179
chg: [UI-dashboard] add logs number configuration
2018-07-26 11:35:54 +02:00
Terrtia
0a82482db4
chg: [UI-dashboard] convert time to local
2018-07-26 10:34:43 +02:00
Terrtia
5ad5939bd5
chg: display last logs
2018-07-25 16:48:44 +02:00
Terrtia
03a37af5cf
chg: [Hash] add reprocess regex order
2018-07-25 10:47:36 +02:00
Terrtia
8c97c70a3f
Merge branch 'master' into base64
2018-07-24 15:21:32 +02:00
Terrtia
4b8c26dec8
fix: [hive auto export] fix #221
2018-07-24 14:46:35 +02:00
Terrtia
3479923f96
fix: [UI-Hash] pie decoder
2018-07-23 11:43:48 +02:00
Terrtia
9c03c40482
chg: [UI-Hash] add decoder pie
2018-07-23 11:11:52 +02:00
Terrtia
1fbd4109c2
chg: [UI-Hash] add decoded type on graph
2018-07-20 15:48:56 +02:00
Terrtia
bd5f83f0eb
chg: refractor base64 encoded to hash
2018-07-20 10:32:52 +02:00
Terrtia
e25dd52d64
add: Binary decoder
2018-07-18 11:45:19 +02:00
Terrtia
524d5fe604
add: hash download
2018-07-18 10:09:35 +02:00
Terrtia
d9c924c38d
chg: use json to submit hash
2018-07-17 14:23:49 +02:00
Terrtia
412b012ddf
add: hash line_graph (nb/day)
2018-07-16 16:45:36 +02:00
Terrtia
6f69da0c0d
fix: paste submit css
2018-07-16 10:32:41 +02:00
Terrtia
fce324e370
fix: release tiemeout alarm, chg:icon graph node
2018-07-13 11:54:14 +02:00
Terrtia
87b7facba8
add: base 64 node graph
2018-07-12 17:07:17 +02:00
9dc211dbe9
chg: [UI] Typo fixed as requested by our favourite German.
2018-07-10 10:49:02 +02:00
Terrtia
fd02085495
add: show hash info
2018-07-09 17:07:59 +02:00
Terrtia
c2a976e907
add: stacked barchart, resize chart
2018-07-09 11:47:04 +02:00
Terrtia
0e5a7d8d47
add date_range stacked bar
2018-07-06 16:54:43 +02:00
Terrtia
3b4e2a18aa
fix: date format https://github.com/CIRCL/AIL-framework/issues/219
2018-07-05 14:45:34 +02:00
Terrtia
cd154be6f9
fix: term_management UI bug , https://github.com/CIRCL/AIL-framework/issues/214
2018-07-05 14:12:47 +02:00
Terrtia
f7d38bea16
add: base64 date and type selector
2018-07-05 13:58:40 +02:00
Terrtia
b6d855b963
change import d3.js to d3.min.js
2018-06-29 15:58:24 +02:00
Terrtia
adfc8cf260
add d3 and daterange js
2018-06-29 15:52:13 +02:00
Terrtia
a0a639276c
fix submit paste
2018-06-29 15:29:02 +02:00
Terrtia
98d0235fc3
Merge branch 'master' into base64
2018-06-29 14:57:46 +02:00
Terrtia
5908710b34
fix: update submitted tags link
2018-06-29 11:29:52 +02:00
Terrtia
cb807bf2c6
chg: change base64 icon
2018-06-29 11:28:35 +02:00
Terrtia
16c700ddb4
new: add base64 display on paste + base64 statistics
2018-06-29 10:02:29 +02:00
Terrtia
225776c69c
fix: tp and fp, errors messages on paste submission
2018-06-20 10:02:26 +02:00
Terrtia
6a89fac309
fix hive and misp error
2018-06-19 16:39:49 +02:00
Terrtia
af9db53171
add tag fp and tp
2018-06-19 15:09:26 +02:00
Terrtia
bf72c27711
fix path-event id map
2018-06-19 13:43:26 +02:00
Terrtia
cd4c099685
fix db init
2018-06-19 11:54:34 +02:00
Terrtia
103787a07d
fix
2018-06-19 11:43:16 +02:00
Terrtia
bc40bb3c38
fix hive connection + add keys sample
2018-06-19 11:42:06 +02:00
Terrtia
0ee36e484f
fix hive connection + submitted dir creation
2018-06-19 11:31:30 +02:00
Terrtia
634bf6e552
add img + fix upload api
2018-06-18 17:16:22 +02:00
Terrtia
704e6f0ad1
change default submit tag, event-path map, publish events
2018-06-18 13:58:31 +02:00
Terrtia
aee1b50ef1
fix duplicate export attribute + tag export whitelist
2018-06-15 17:25:43 +02:00
Terrtia
31fc33ab03
misp event creation, auto and manual + the hive alert auto creation, manual case creation
2018-06-14 16:51:06 +02:00
Terrtia
8522d50308
modify navbar + decompress file password
2018-06-11 10:21:11 +02:00
Terrtia
c64588f60e
add feature, user can submit paste on the web interface
2018-06-08 16:49:20 +02:00
Terrtia
8e9c77b364
verify file upload extention
2018-06-06 10:05:25 +02:00
Terrtia
6143bc3dce
submit users input paste
2018-06-05 16:58:04 +02:00
Terrtia
c41a56e4a2
clean Flask_tags + gitignore
2018-06-01 13:36:08 +02:00
Terrtia
2b310d4367
clean
2018-06-01 11:26:45 +02:00
Terrtia
cd6734f704
fix install
2018-05-31 15:35:20 +02:00
Terrtia
884d655b0c
taxonomies and galaxies update via LAUNCH
2018-05-31 13:53:29 +02:00
Terrtia
5c50de45de
add taxonomies and galaxies update and install
2018-05-31 10:07:23 +02:00
Terrtia
8a87b7b082
galaxy tag info + fix
2018-05-30 16:18:58 +02:00
Terrtia
dbe67e094b
galaxies synonyms
2018-05-29 17:17:02 +02:00
Terrtia
f3f6b76428
galaxy description and tags
2018-05-29 08:47:46 +02:00
Terrtia
f5cae0d99c
taxonomie + add tags + tags display
2018-05-23 16:58:56 +02:00
Terrtia
b9eb3ed9ba
add and delete tags features
2018-05-17 15:33:06 +02:00
Terrtia
4fbbf8bbd2
display tag on important paste and search
2018-05-17 11:00:05 +02:00
Terrtia
0d164b6f4c
add tag js and css
2018-05-16 14:48:15 +02:00
Terrtia
b1b7d33c96
tags
2018-05-16 14:39:01 +02:00
Terrtia
f66a528bc2
fix Duplicate, save list of duplicates on disk + prevent empty hash creation
2018-05-15 23:28:47 +02:00
Terrtia
225fe76c96
fix duplicate + get raw paste
2018-05-11 16:07:30 +02:00
Terrtia
142c1dc9b0
clean
2018-05-09 13:03:46 +02:00
Terrtia
3841c159a0
change leveldb to ardb
2018-05-07 14:50:40 +02:00
Terrtia
c17b9402f7
clean
2018-05-04 14:25:47 +02:00
Terrtia
96a3df42bc
decode with redis connection
2018-05-04 13:53:29 +02:00
Terrtia
a900d5f08d
add python 2 to 3 bash + fix Duplicate + clean
2018-05-03 16:21:33 +02:00
Terrtia
c52caebe7c
improve Duplicate + tlsh + add time out handler + debug + clean
2018-05-02 17:07:10 +02:00
Terrtia
c3428df5dc
add apiKeys module
2018-04-26 14:42:39 +02:00
Terrtia
8738b7cf75
fix track term and avoid duplicate mail address
2018-04-24 16:44:37 +02:00
Terrtia
f93fe9aeb2
add bitcoin module
2018-04-23 14:51:53 +02:00
Terrtia
41eb250278
fix python 3 compqtibility issues
2018-04-20 10:42:19 +02:00
Terrtia
8571a86344
frontend python 3.5 upgrade
2018-04-17 16:06:32 +02:00
Philipp Schmied
4835589ff4
Fixed typo
2018-03-01 08:50:27 +01:00
Philipp Schmied
29608ab29b
Fixed e-mail notificatins for sets and regexes
2018-02-28 11:31:16 +01:00
Philipp Schmied
b6fcf51309
Flask_terms.py: Fixed mapping of notifcation e-mails to terms with uppercase letters
2018-02-28 09:19:27 +01:00
Philipp Schmied
5b1f0b0212
Implemented email notifications (bin: config.cfg additions, email sending via analyzer scripts; var: Changes to add notifications via terms management); terms_management: Fixed click handlers not being added to all tracked terms.
2018-02-27 15:12:02 +01:00
abdf41fe23
Merge pull request #164 from mokaddem/showDiff
...
Show differences between duplicates
2018-02-21 22:25:16 +01:00
Sami Mokaddem
9125930a77
fix: canvasjs changed its folder hierarchy
2017-12-14 11:47:11 +01:00
Sami Mokaddem
304213cfa4
update: Possibility to change the authorized max line length in the config for the diff of duplicates
2017-12-12 11:00:26 +01:00
Sami Mokaddem
3fe7ecf75a
feature: diff in the web interface for duplicates pastes.
2017-12-12 10:48:21 +01:00
mokaddem
9cab76cf88
Merge pull request #162 from mokaddem/sentimentBugfix
...
Fix: bug between front-end and back-end date representation
2017-12-11 16:35:38 +01:00
Paul A
4a4a1d478b
Quick refactor for the JavaScript
2017-10-22 18:48:54 +02:00
Paul A
f6b6777095
Fixed some code for the JavaScript (coding-style)
2017-10-20 15:44:09 +02:00
Paul A
48fc8e3464
Removed duplicate function
2017-10-20 15:32:58 +02:00
Simon Tran
a41c5d55c5
Migrated Dockerfile to Ubuntu 16.04 LTS
...
Fixed AIL Web dependencies installation
Added Docker documentation
2017-10-01 02:23:32 +02:00
Sami Mokaddem
2cfb8c173b
Fixed from front-end date representation bug
2017-09-27 10:46:20 +02:00
=
b9bd651033
Removed useless import
2017-08-23 14:06:59 +02:00
=
3b3f3aa89c
Flask: Added support of LevelDB database depending of the year
2017-08-23 12:20:39 +02:00
=
d632335760
Automatically start redis_levelDB with the correct date
2017-08-23 10:16:56 +02:00
=
bd46c83fb6
BrowseImportantPaste: Fixed a bug where onClickListener was not set when the table was only 1 page long
2017-08-21 11:55:01 +02:00
=
409eb25a64
Deleted data-flow graph and header.html from the index + Added fixed typo where 10min was in fact 3min
2017-08-21 10:51:56 +02:00
Mokaddem
fa52292029
Added comments, cleanup and added credentials search progress in Flask
2017-07-20 10:50:24 +02:00
Mokaddem
cbb2909156
Added comments
2017-07-20 10:24:48 +02:00
Mokaddem
05417f405c
Finished basic link web interface + solved some bugs
2017-07-20 10:04:30 +02:00
Mokaddem
ef741f85c0
Added similarity checks + started link webInterface
2017-07-19 11:52:06 +02:00
Mokaddem
882ab88b00
Draft module + web link
2017-07-18 16:57:15 +02:00
Mokaddem
9b8570e40b
Dirty draft webpage credential_tracking
2017-07-17 17:26:19 +02:00
Mokaddem
f1a1e75c32
Restaured old example webpage
2017-07-17 16:18:21 +02:00
Mokaddem
9558aafe67
Prevent the loss of the 1 message in import_dir.py
2017-07-17 16:14:27 +02:00
Mokaddem
b60e164380
Added support of onion in browseWarningPaste
2017-04-26 11:47:02 +02:00
Mokaddem
5e4d0170d4
Bug fixes, jinja2 iter0 and typo
2017-04-26 11:31:08 +02:00
Mokaddem
e614da4748
Deleted print + Added curve fill for Mixer graph in Index
2017-04-25 15:52:41 +02:00
Mokaddem
71b2757ed2
New script create_new_web_module permits to rapidly create a new pre-configured webpage from a template.
2017-04-25 15:22:04 +02:00
Mokaddem
6afbf77af0
Modified skeleton template name into rawSkeleton + Added possibility to hide modules in the header.
2017-04-25 12:18:08 +02:00
Mokaddem
f6e8582d9d
Auto organisation of the navbar -> Web page are auto-inserted. Created skeleton webpage
2017-04-19 15:14:20 +02:00
Mokaddem
32906965d8
Draft of new organisation of the web interface. Usage of Flask's blueprint
2017-04-19 11:02:03 +02:00
Mokaddem
da081bae42
Merge branch 'regexInTerms' into production
2017-04-18 16:59:40 +02:00
Mokaddem
c8baabd882
Updated TermsFrequency related modules + Fixed bugs (encoding, behaviors, ...)
2017-04-18 15:28:21 +02:00
Mokaddem
2da4c572c7
New feature in Terms: regex and set of words support (draft)
2017-03-28 17:42:44 +02:00
Mokaddem
3261eca836
Fixed all_index newline bug + added print of what's happening
2017-03-15 14:29:49 +01:00
Mokaddem
5b7d047622
Changed os.system by os.mkdir + fixed bug during rotation
2017-03-15 14:05:13 +01:00
Mokaddem
4005b72180
Added backward support + renamed index with timestamp
2017-03-15 11:51:35 +01:00
Mokaddem
381e72ee99
Added display of number of elements inside the index + changed variables names
2017-03-15 10:07:46 +01:00
Mokaddem
e4757f5ceb
Added possibility to choose the index in search + Updated search page with jinja2 iter0
2017-03-15 09:39:48 +01:00
Mokaddem
41132fe0bc
Added support of per_paste for term-management and plot-term
2017-02-28 15:54:39 +01:00
Mokaddem
4071bf2e91
fixed a bug in manage_term (usage of loop.index0) + fixed bug in top_set where graph was not displaying the correct per_paste value
2017-02-28 15:01:48 +01:00
Mokaddem
25adae0104
Added possibility to select in top_terms the data per_paste or not (need module testing)
2017-02-15 16:29:02 +01:00
Mokaddem
d4da3a316f
Added path of the paste in the log of Categ.py
2017-02-14 10:59:47 +01:00
Mokaddem
29241eb49f
Added a line separator between the two graphs in dashboard.
2017-01-09 14:44:14 +01:00
Mokaddem
0e39f516a9
Added sleep in helper for multiple listening interfaces (reduce useless work), Added a simple way to pre-process feed before sending it to the global feed.
2017-01-09 14:12:26 +01:00
Mokaddem
24c5621d29
BUG FIX in Flask_trendingmodule, Fixed member_set when get_top_relevant_data is None.
2016-12-26 16:33:10 +01:00
Mokaddem
1c2169d3bc
Improved interface for multiple feeds and refresh_script.
2016-12-26 16:16:44 +01:00
Mokaddem
a18c046dea
Fixed bug multiple refresh instances and harmonized interface.
2016-12-23 16:15:05 +01:00
Mokaddem
03dddbc359
Reduced refresh rate of processed_pastes, synchro graphs and adjusted max on each graphs.
2016-12-23 16:01:30 +01:00
Mokaddem
97292e0899
Updated web interface to handle new mixer module. and fixed one dependency bug.
2016-12-23 15:44:46 +01:00
Mokaddem
faa8f8302d
Removed typo in the number of remaining pastes to display in browseImportantPaste
2016-12-22 09:28:55 +01:00
Mokaddem
9df12cdae8
Added sub-flask in a directory
2016-12-22 08:57:45 +01:00
Mokaddem
d30f3ca6c7
Added missing depency datetime in dashboard
2016-12-09 13:53:57 +01:00
Mokaddem
0054be5bab
Added missing json dependency in dashboard
2016-12-09 08:50:36 +01:00
Mokaddem
8daa72789e
Splitted Flask_server into module related to website sections
2016-12-09 08:46:37 +01:00
Mokaddem
d3ed1bbf40
Merge branch 'website-improvement' into production
2016-12-08 10:05:55 +01:00
Mokaddem
1abba4dcf9
Added support of re-plotting the plotted terms
2016-12-08 08:44:10 +01:00
Mokaddem
84dcd5586f
Started plotting same data with different dates
2016-11-25 16:42:22 +01:00
Mokaddem
a3255d168c
ModuleInfo correctly handle CurveManageTopSets,
...
Changed queue coloring in dashboard,
ModuleInformation now have a history of executed command and better handle module killing.
2016-11-25 11:54:16 +01:00
Mokaddem
5d269ea1ee
Added date in Duplicate for better distinguish duplicate. Also, added a timeout for the dataTable in duplicate inside the modal.
2016-11-24 15:05:29 +01:00
Mokaddem
df8d978088
Added dynamic data loading in dataTable in search.html
2016-11-24 13:31:31 +01:00
Mokaddem
80ca49f018
Prevent browser to request reconnection for the eventStream + Added dynamic data loading in the dataTable of BrowseImportantPastes
2016-11-11 16:51:39 +01:00
Mokaddem
768fb6f2df
removed server overhead for paste preview data
2016-11-10 16:41:07 +01:00
Mokaddem
699c819387
fixed bug in show concerned pastes previex en (terms managements)
2016-11-10 16:33:05 +01:00
Mokaddem
94e3034e7d
Fixed bun in terms management, where action_button was not bind in other dataTable pages
2016-11-10 15:53:22 +01:00
Mokaddem
7763bfb4c7
Pastes dataTable now display only the latest clicked paste even if there were discarded queries
2016-11-10 15:39:45 +01:00
Mokaddem
2dd69fbb25
Fixed modal background stacking bug + button leading to saved paste bug fixed in search
2016-11-10 14:56:25 +01:00
Mokaddem
317005c2b4
tryed to fix html display problem in tooltip + fixed problem button showPaste in modal not pointing to the paste
2016-11-10 10:30:29 +01:00
Mokaddem
34221b083f
Partially solved the browser freezing problem + tootlip is also binded at a new page generation of the DataTable
2016-11-10 09:28:55 +01:00
Mokaddem
acdd1367a3
Added event source for getImportantPaste
2016-10-28 16:55:56 +02:00
Mokaddem
c95000866d
Dynamic table in search now load all the data + fixed bugs where tooltip where not shown on other than the first page displayed and
...
tooltip interpret html (not supposed to...)
2016-10-28 14:21:08 +02:00
Mokaddem
f51808d914
Added support of html formatting in search result dynamic loading table
2016-10-28 09:48:22 +02:00
Mokaddem
4be62a4e2d
Added draft of dynamic update table with search result
2016-10-28 09:28:42 +02:00
Mokaddem
340624fe1e
Fixed bug in modal show paste (show more button not showing)
2016-10-27 16:18:49 +02:00
Mokaddem
7e7e679ab6
Added dataTable for duplicate in show saved paste
2016-10-27 15:53:45 +02:00
Mokaddem
59a7000527
Bootstrap support in show saved paste
2016-10-27 12:38:39 +02:00
Mokaddem
ac254e0e63
Added support of browsing concerned paste in dashboard for all modules + Show in the page what was the concerned module
2016-10-27 11:50:24 +02:00
Mokaddem
1826b170ec
Added support of local paste view in dashboard for Mails event only
2016-10-27 11:27:26 +02:00
Mokaddem
7c8d414948
modified provider name into no data when there is no data
2016-10-14 16:47:22 +02:00
Mokaddem
91678179fd
Added msgs when queues or feed is not running/coming
2016-10-14 16:33:54 +02:00
2781a2f0b7
Stuck not stucked
2016-09-21 08:35:20 +02:00
Jerome St-Hilaire
ea13f87c2c
Fixed dependency fetching for the web interface
2016-09-15 12:14:55 -07:00
Raphaël Vinot
acfe9c1336
Update Flask_server.py
2016-08-26 18:06:48 +02:00
Raphaël Vinot
3290b51c91
Update update_thirdparty.sh
2016-08-26 18:05:18 +02:00
Mokaddem
79be8ab934
Fixed introduced bug relative to chart in index webpage.
2016-08-26 15:59:53 +02:00
Mokaddem
0c760d763b
Added support of PID in ModuleInformation and index.html
2016-08-26 15:27:37 +02:00
Mokaddem
5c565068a6
Removed auto-reload in dashboard if window in undefined
2016-08-26 11:25:11 +02:00
Mokaddem
181c372131
Updated dependencies
2016-08-26 11:10:39 +02:00
Mokaddem
4cb3b672be
Added comments
2016-08-26 10:28:35 +02:00
Mokaddem
86b655100e
Deleted useless parsing function
2016-08-26 10:01:14 +02:00
Mokaddem
07d7559060
Added dataTable support in browse paste modal.
2016-08-26 08:30:09 +02:00
Mokaddem
813cc7031a
Changed lots of code into zrank
2016-08-25 17:48:12 +02:00
Mokaddem
991176fdfd
Suppressed metismenu import.
2016-08-25 16:40:13 +02:00
Mokaddem
fb22816236
Added module number info in index webpage
2016-08-25 16:27:32 +02:00
Mokaddem
0b5a3e0cd2
Auto generate graph div + possibility to query all sentiments data.
2016-08-25 15:06:18 +02:00
Mokaddem
21f2c43572
Individualized sentiments-graph loading
2016-08-25 13:11:16 +02:00
Mokaddem
f9bf00f022
Removed autokill feature if not specified
2016-08-25 11:09:31 +02:00
Mokaddem
611454ba82
Added color in web-index reprenting modules states.
2016-08-24 18:00:05 +02:00
Mokaddem
e3daa84196
Added icon in header
2016-08-23 16:09:34 +02:00
Mokaddem
e12244fb53
Added show/hide curve with legend in terms-top-set.
2016-08-23 15:39:13 +02:00
Mokaddem
e56187eb7e
Added position of each top term in the other sets + highligth ones not present.
2016-08-23 14:52:02 +02:00
Mokaddem
a64d447b7b
Auto hide button add_to_chart when no data plotted.
2016-08-23 12:09:41 +02:00
Mokaddem
e59b7c4e47
Added tooltip in graph for terms-plot-tool
2016-08-23 12:03:23 +02:00
Mokaddem
0eba419651
Added multiple terms plot in terms-plot-tool.
2016-08-23 11:56:32 +02:00
Mokaddem
9f2d672ec8
harmonized tooltip and popover display
2016-08-23 11:20:48 +02:00
Mokaddem
8c956c22b1
Added autohide curves in terms-top-set.
2016-08-23 11:02:36 +02:00
Mokaddem
32dfd2b181
Moved legend place in term-plot-top
2016-08-23 10:16:33 +02:00
Mokaddem
f9b27e4013
Fixed bug in curve preventing to track concerned_pastes. Now all tracked words are put in lower case.
2016-08-23 09:50:03 +02:00
Mokaddem
1766ced9e6
Fixed potential XSS problem with pastes display in 'search' and 'important_paste_by_module'.
2016-08-23 09:08:17 +02:00
Mokaddem
047331df3e
Added save of paste_baseName in set for searches. This is done in ModuleStats to not surcharge the Global module.
2016-08-23 08:52:54 +02:00
Mokaddem
6be557890c
Replaced negative hour by 24h based.
2016-08-23 07:19:51 +02:00
Mokaddem
85ab0e36ff
In sentiment analysis. if today top provider set is empty, try to take yesterday data and then takes from all_providers.
2016-08-23 07:11:03 +02:00
Mokaddem
8359a6668f
Suppressed useless comms
2016-08-22 21:36:19 +02:00
Mokaddem
2fd2c8af39
Removed commented code
2016-08-22 20:59:56 +02:00
Mokaddem
27ae577e00
Fixed stupid line remove in index.html...
2016-08-22 16:25:52 +02:00
Mokaddem
a424069c64
Fixed bug in flask with zrange (was taking the bottom of the set instead of the top leading to get only the min instead of max)
2016-08-22 16:12:20 +02:00
Mokaddem
003c72bd7c
Fixed bug with redis where the inserted key was too long, causing a crash + fixed bug taking min instead of max in terms-top-set
2016-08-22 16:01:42 +02:00
Mokaddem
2466f355ab
Fixed bug in manage-terms-top-set + added auto sorting in important-paste-by-module
2016-08-22 14:54:37 +02:00
Mokaddem
e144e8e1c6
Fixed bug in terms-management-interface (only display one paste) + removed get_language of all pastes due to the huge overhead.
2016-08-22 13:59:12 +02:00
Mokaddem
d3c0fc5f94
Added terms trending module and web interface:
...
- Curve module has been rewritten
- Added new module curve_manage_top_set
- Added all web-pages
2016-08-22 13:35:49 +02:00
Mokaddem
841e87eb16
Fixed bug in sentiment trending, if there was no data for the avg -> there was one NaN leading to no display in the gauge.
2016-08-20 18:48:24 +02:00
Mokaddem
ee8f26c7c4
In sentiment trending, if there are no providers in the today\'s set, get data from random providers
2016-08-20 18:14:19 +02:00
Mokaddem
2ed60cb9bf
Fixed typo
2016-08-20 16:44:36 +02:00
Mokaddem
3f1cf705fc
Deleted alert()
2016-08-20 16:41:49 +02:00
Mokaddem
1c96eac2e4
Enter simulate button click on input field for terms management and plot tool
2016-08-20 16:38:51 +02:00
Mokaddem
465d18fc73
Added terms-plot tool
2016-08-20 16:23:06 +02:00
Mokaddem
fb3dea6bd2
Finnished terms-plot-top-set. Also added possibility to add terms to track or blacklist.
2016-08-20 15:59:22 +02:00
Mokaddem
a5117d7cad
Added top set webpage
2016-08-20 11:46:22 +02:00
Mokaddem
0b6828fb16
Correctly handle and display add or remove a term in term-frequency + started sketch of terms-plot tool.
2016-08-19 16:53:46 +02:00
Mokaddem
8d41b109e7
Added query of the data for the new tracked word
2016-08-19 14:33:01 +02:00
Mokaddem
b78effe779
Added draft of terms_management + Added copyright in readme
2016-08-19 13:34:02 +02:00
Mokaddem
52b7124a6b
- Modified redis connection (from levelDB to redis).
...
- Added term frequency in curve.
- Modified ModuleStats and WebStats to use redis special command (incrby instead of get-set and zset) and Flask to perform the correct queries.
- Added panel color in sentiment trending
2016-08-18 15:34:19 +02:00
Mokaddem
24072ece36
Added support of pasteName in search + added header in search.html + supressed mixed indent and trailing in Flask.py
2016-08-17 14:21:31 +02:00
Mokaddem
c10f28d9df
Updated isolated launch scripts + Added switch displaying queue in index
2016-08-17 13:46:01 +02:00
Mokaddem
23b65eddca
Auto unchecked info checkbox in index
2016-08-17 11:25:05 +02:00
Mokaddem
4d09ab0f6b
Modified icon sentiment in web-header.
2016-08-17 11:13:37 +02:00
Mokaddem
44f54b7b81
Added dependencies
2016-08-17 11:04:48 +02:00
Mokaddem
f0b527167a
Added script flexgauge
2016-08-17 10:50:30 +02:00
Mokaddem
c12e67a35a
Added tooltips + slight gauge modification
2016-08-17 10:43:43 +02:00
Mokaddem
894b9efda9
Added drop of really long line in sentiment-analysis module + Added description of sentiment module. Also, fixed bug in webpage sentiement-trending concerning avg and date range.
2016-08-17 09:46:25 +02:00
Mokaddem
1084e45f1b
Added draft of filter in sentiment analysis (Discard syntaxical languages) + Added nice tooltip for sparkline. Trending displays avg in function of the number of elements processed and not for the complete week + fixed bug in gauge and canvasjs (was performing avg with only 1 graph instead of all 8).
2016-08-16 16:33:02 +02:00
Mokaddem
ecd834ffb6
Added autoreload in sentiment-trending.
2016-08-16 11:27:49 +02:00
Mokaddem
bb677b9061
Added avg text in sentiment-trending + fixed date range bug
2016-08-16 11:23:14 +02:00