scottk/nDPId
1
0
Fork 0
mirror of https://github.com/optim-enterprises-bv/nDPId.git synced 2025-10-31 02:07:47 +00:00
Code Issues Packages Projects Releases Wiki Activity
784 Commits 1 Branch 0 Tags
ce9752af1664f11fb6af4d58c85471978e693524
Commit Graph

19 Commits

Author SHA1 Message Date
Toni Uhlig
a230eaf061 Improved Keras Autoencoder hyper parameter. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2024-08-16 13:20:35 +02:00
Toni Uhlig
5d56288a11 Fixed more SonarCloud complaints. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-11-07 00:02:36 +01:00
Toni Uhlig
84b12cd02c Fixed some SonarCloud complaints. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-11-06 13:31:59 +01:00
Toni Uhlig
be07c16c0e sklearn-random-forest.py: Pretty print false positive/negative. 
* added max tree depth command line argument
 * print a note if loading an existing model while using --sklearn-* command line options

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-09-10 20:20:25 +02:00
Toni Uhlig
5234f4621b keras-autoencoder.py: TensorBoard, SGD optimizer, KLDivergence loss function, EarlyStopping 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-23 22:56:59 +02:00
Toni Uhlig
86ac09a8db keras-autoencoder.py: Improved Model 
* added initial learning rate for Adam
 * plot some metrics using pyplot

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-20 23:05:08 +02:00
Toni Uhlig
4b3031245d keras-autoencoder.py: fixed invalid preprocessing of received base64 packet data 
* split logic into seperate jobs; nDPIsrvd and Keras
 * nDPIsrvd: break event processing and re-run `epoll_wait()` after client disconnected

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-15 11:21:46 +02:00
Toni Uhlig
8a8de12fb3 Keras AE supports loading/saving models. 
* added training/batch size as cmdargs

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-22 09:25:11 +02:00
Toni Uhlig
92b3c76446 Added Keras based Autoencode (Work-in-Progress!) 
* minor fixes

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-16 22:06:36 +02:00
Toni Uhlig
c8ec505b9c bump libnDPI to 8ea0eaa0d0c4a3be05f67ef7fa1d22c2579cf7d1 
* added build fix for Gitlab CI
 * added friendly C11 check
 * set required libnDPI versionto 4.7
   (ArchLinux ndpi-git sets version to 4.7, which is not released yet)
 * reduced sklearn-random-forest memory consumption by adjusting min. sample leaf

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-06-12 19:05:33 +02:00
Toni Uhlig
0a959993bc Improved: 
* Gitlab-CI: build nDPId executable from CLI
 * C-Simple: log affected JSON line on READ/PARSE error
 * Sklearn: quality of life changes

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-02-27 01:20:23 +01:00
Toni Uhlig
4236aafa0d py-machine-learning: Print CSV line numbers for invalid lines (SKLearn Random Forest Classificator). 
* c-analysed: fix wrong length check

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-01-30 22:36:17 +01:00
Toni Uhlig
4e19ab929c py-machine-learning / sklearn-random-forest: Quality Of Life improvments 
* fixed libnDPI submodule build on some platforms

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-12-22 22:13:08 +01:00
Toni Uhlig
6292102f93 py-machine-learning: load and save trained models 
* added link to a pre-trained model

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-10-15 11:59:39 +02:00
Toni Uhlig
9bf4f31418 Removed example py-ja3-checker. 
* renamed sklearn-ml.py to sklearn-random-forest.py (there is more to come!)
 * force all protocol classes to lower case

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-10-13 00:12:22 +02:00
Toni Uhlig
4069816d69 Improved py-machine-learning example. 
* colorize/prettify output
 * added sklearn controls/tuning options
 * disable IAT/Packet-Length features as default

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-10-11 20:20:01 +02:00
Toni Uhlig
20fc74f527 Improved py-machine-learning example. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-10-10 16:44:12 +02:00
Toni Uhlig
4654faf381 Improved py-machine-learning example. 
* c-analysed: fixed quoting bug
 * nDPId: fixed invalid iat storing/serialisation
 * nDPId: free data analysis after event was sent

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
Signed-off-by: lns <matzeton@googlemail.com>
 2022-10-09 18:31:45 +02:00
Toni Uhlig
9a28475bba Improved flown analyse event: 
* store packet directions
 * merged direction based IATs
 * merged direction based PKTLENs

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-09-22 19:07:08 +02:00