AIL/ail-framework
7
0
Fork 0
mirror of https://github.com/ail-project/ail-framework.git synced 2024-11-10 08:38:28 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Draft modification of Readme

Browse source
This commit is contained in:
Mokaddem 2016-08-23 17:20:22 +02:00
parent ff2384b44e
commit 6c451ec7cd
1 changed files with 18 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

18
README.md
View file

@ -10,10 +10,14 @@ AIL framework - Framework for Analysis of Information Leaks
AIL is a modular framework to analyse potential information leaks from unstructured data sources like pastes from Pastebin or similar services. AIL framework is flexible and can be extended to support other functionalities to mine sensitive information. AIL is a modular framework to analyse potential information leaks from unstructured data sources like pastes from Pastebin or similar services. AIL framework is flexible and can be extended to support other functionalities to mine sensitive information.
![Dashboard](./doc/screenshots/dashboard.png?raw=true "AIL framework dashboard") ![Dashboard](./doc/screenshots/dashboard.png?raw=true "AIL framework dashboard")
![Trending-Web](./doc/screenshots/trending-web.png?raw=true "AIL framework webtrending") ![Trending-Web](./doc/screenshots/trending-web.png?raw=true "AIL framework webtrending")
![Trending-Modules](./doc/screenshots/trending-module.png?raw=true "AIL framework modulestrending") ![Trending-Modules](./doc/screenshots/trending-module.png?raw=true "AIL framework modulestrending")
![Browse-Pastes](./doc/screenshots/browse-important.png?raw=true "AIL framework browseImportantPastes") ![Browse-Pastes](./doc/screenshots/browse-important.png?raw=true "AIL framework browseImportantPastes")
![Sentiment](./doc/screenshots/sentiment.png?raw=true "AIL framework sentimentanalysis") ![Sentiment](./doc/screenshots/sentiment.png?raw=true "AIL framework sentimentanalysis")
![Term-Manager](./doc/screenshots/terms-manager.png?raw=true "AIL framework termManager") ![Term-Manager](./doc/screenshots/terms-manager.png?raw=true "AIL framework termManager")
![Term-Top](./doc/screenshots/terms-top.png?raw=true "AIL framework termTop") ![Term-Top](./doc/screenshots/terms-top.png?raw=true "AIL framework termTop")
![Term-Plot](./doc/screenshots/terms-plot.png?raw=true "AIL framework termPlot") ![Term-Plot](./doc/screenshots/terms-plot.png?raw=true "AIL framework termPlot")
@ -33,6 +37,9 @@ Features
* Module for extracting Tor .onion addresses (to be further processed for analysis) * Module for extracting Tor .onion addresses (to be further processed for analysis)
* Extracting and validating potential hostnames (e.g. to feed Passive DNS systems) * Extracting and validating potential hostnames (e.g. to feed Passive DNS systems)
* A full-text indexer module to index unstructured information * A full-text indexer module to index unstructured information
* Modules and web statistics
* Global sentiment analysis for each providers based on nltk vader module
* Terms tracking and occurence
* Many more modules for extracting phone numbers, credentials and others * Many more modules for extracting phone numbers, credentials and others
Installation Installation
@ -55,6 +62,16 @@ linux based distributions, you can replace it with [installing_deps_archlinux.sh
There is also a [Travis file](.travis.yml) used for automating the installation that can be used to build and install AIL on other systems. There is also a [Travis file](.travis.yml) used for automating the installation that can be used to build and install AIL on other systems.
Concerning the sentiment module, nltk.sentiment.vader must be installed manually.
In your AIL virtualenv, type
```
python
import nltk
nltk.download()
```
and then install the sentiment.vader module
Starting AIL web interface Starting AIL web interface
-------------------------- --------------------------
@ -101,6 +118,7 @@ Redis and LevelDB overview
* DB 0 - Cache hostname/dns * DB 0 - Cache hostname/dns
* Redis on TCP port 6380 - Redis Pub-Sub only * Redis on TCP port 6380 - Redis Pub-Sub only
* Redis on TCP port 6381 - DB 0 - Queue and Paste content LRU cache * Redis on TCP port 6381 - DB 0 - Queue and Paste content LRU cache
* Redis on TCP port 6382 - DB 1-4 - Trending, terms and sentiments
* LevelDB on TCP port <year> - Lines duplicate * LevelDB on TCP port <year> - Lines duplicate
LICENSE LICENSE