scottk/nDPId
1
0
Fork 0
mirror of https://github.com/optim-enterprises-bv/nDPId.git synced 2025-10-29 17:32:23 +00:00
Code Issues Packages Projects Releases Wiki Activity
767 Commits 1 Branch 0 Tags
071a9bcb91ac7fb30b1f3669340532b961f6db4c
Commit Graph

767 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Toni Uhlig
d29efd4d7c Docker: Switched from Ubuntu 22.10 to 22.04 LTS. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-10-16 16:49:30 +02:00
Toni Uhlig
44adfc0b7d Sonarcloud integration 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-10-05 17:37:42 +02:00
Toni Uhlig
dfd0449306 Fix issues detected by SonarCloud. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-10-05 17:26:06 +02:00
Toni Uhlig
07f2c2d9cc nDPId-test: ingore event handler failures caused by arpa mockup 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-10-05 17:25:54 +02:00
Toni Uhlig
73b8c378f2 nDPId event I/O fixes. 
* forcibly disable epoll even if available
 * nDPId-test event I/O selftest
 * CI event I/O tests

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-10-05 12:32:45 +02:00
Toni Uhlig
a0e0611c56 nDPIsrvd: Log error if collector unix socket can not be removed. 
* systemd: add post stop hook to forcefully remove the collector unix socket

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-09-11 16:58:13 +02:00
Toni Uhlig
7f8e01d442 Fix CI. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-09-11 12:55:54 +02:00
Toni Uhlig
835a7bafb1 Fix CI. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-09-11 05:14:31 +02:00
Toni Uhlig
a7ac83385b Fix systemd CI test. 
* CI Fix #3

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-09-10 22:16:44 +02:00
Toni Uhlig
0a0342ce28 c-captured: Log only flows w/o packet data to syslog if in logging mode. 
* CI Fix #2

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-09-10 21:46:51 +02:00
Toni Uhlig
7515c1b072 Fix CI. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-09-10 20:28:11 +02:00
Toni Uhlig
be07c16c0e sklearn-random-forest.py: Pretty print false positive/negative. 
* added max tree depth command line argument
 * print a note if loading an existing model while using --sklearn-* command line options

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-09-10 20:20:25 +02:00
Toni Uhlig
e42e3fe406 Serialize nDPId / libnDPI versions within daemon events. 
* changed nDPI version hints / requirements

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-09-10 19:32:08 +02:00
Toni Uhlig
96b0a8a474 Add event I/O abstraction. 
* required to support non-Linux OS e.g. Mac OS X / BSD
 * see Github issue #19

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-09-10 19:11:58 +02:00
Toni Uhlig
091fd4d116 Added CMake option BUILD_NDPI_FORCE_GIT_UPDATE to fix broken submodule caches in GitLab CIs.. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-27 22:37:55 +02:00
Toni Uhlig
dfb8d3379f bump libnDPI to 1f693c3f5a5dcd9d69dffb610b9a81bd33f95382 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-27 21:45:14 +02:00
Toni Uhlig
a7bd3570b0 Enable custom JSON filter expressions for Python scripts. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-27 20:08:01 +02:00
Toni Uhlig
b01498f011 Fix some GCC-12 warnings. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-27 12:49:39 +02:00
Toni Uhlig
cc60e819e8 Fixed invalid base64 encoding in some rare cases. 
* nDPId-test may also verify the correct encoding/decoding

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-24 22:51:57 +02:00
Toni Uhlig
5234f4621b keras-autoencoder.py: TensorBoard, SGD optimizer, KLDivergence loss function, EarlyStopping 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-23 22:56:59 +02:00
Toni Uhlig
86ac09a8db keras-autoencoder.py: Improved Model 
* added initial learning rate for Adam
 * plot some metrics using pyplot

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-20 23:05:08 +02:00
Toni Uhlig
4b3031245d keras-autoencoder.py: fixed invalid preprocessing of received base64 packet data 
* split logic into seperate jobs; nDPIsrvd and Keras
 * nDPIsrvd: break event processing and re-run `epoll_wait()` after client disconnected

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-15 11:21:46 +02:00
Toni Uhlig
2b881d56e7 c-captured extension 
* capture packets after error event occurred
 * add "logging" and "capture" mode

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-14 01:01:26 +02:00
Toni Uhlig
dd4357c238 CMake: install header files for experimental usage 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-05 01:15:48 +02:00
Toni Uhlig
7b15838696 Added docker build&push to the CI. 
* update some git submodules

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-03 10:00:50 +02:00
Toni Uhlig
0e31829401 nDPId-test: threads should block all unix signals 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-02 23:34:10 +02:00
Toni Uhlig
d9f304e4b0 nDPId-test: print additional startup/init log messages 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-02 22:32:33 +02:00
Toni Uhlig
ebb439d959 Tiny improvments. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-02 21:00:39 +02:00
Toni Uhlig
79834df457 Removed CI matrix based jobs. 
* Fixed multiple *.deb package upload issue.

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-02 18:21:37 +02:00
Toni Uhlig
4b923bdf44 py-flow-info: print flow src/dst packets 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-28 13:16:29 +02:00
Toni Uhlig
ba8236c1f7 py-flow-info: print flow src/dst bytes/packets 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-28 11:24:09 +02:00
Toni Uhlig
d915530feb Circle CI integration 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-27 18:39:11 +02:00
Toni Uhlig
7bd8081cd2 bump libpcap dependency to 1.9.0 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-27 18:20:36 +02:00
Toni Uhlig
bc0a5782cc bump libnDPI to 2b230e28e0612e8654ad617534deb9aaaabd51b7 
* fixes loading of gambling lists which increased nDPId's memory usage *a lot*
 * nDPId: handle EINTR correctly

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-23 18:43:58 +02:00
Toni Uhlig
8a8de12fb3 Keras AE supports loading/saving models. 
* added training/batch size as cmdargs

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-22 09:25:11 +02:00
Toni Uhlig
c57ace2fd3 Correctly handle EINTR while doing I/O.. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-18 13:51:00 +02:00
Toni Uhlig
344934b7d9 CI: Upload generated packages. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-18 10:57:14 +02:00
Toni Uhlig
22ba5d5103 Improved OpenWrt Makefile: set an optional libnDPI commit hash 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-18 01:25:06 +02:00
Toni Uhlig
7217b90cd1 nDPId: `-v' give information about libnDPI linkage 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-17 19:32:41 +02:00
Toni Uhlig
74a9f7d86b nDPId: `-v' prints also information about dependecies 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-17 19:19:52 +02:00
Toni Uhlig
57d8dda350 nDPId-test: Fixed invalid error retval when epoll_wait() returns EINTR. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-16 23:23:07 +02:00
Toni Uhlig
425617abdf Added GLFW/OpenGL stats drawer written in C++. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-16 22:19:20 +02:00
Toni Uhlig
92b3c76446 Added Keras based Autoencode (Work-in-Progress!) 
* minor fixes

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-16 22:06:36 +02:00
Toni Uhlig
967381a599 get-and-build-libndpi.sh uses GMake MAKEFLAGS for sub-make (required for e.g. jobserver) 
* fixed invalid CMake `test -r ...`

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-16 22:06:31 +02:00
Toni Uhlig
d107560049 Updated OpenWrt In-Source build patch. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-06-12 19:56:02 +02:00
Toni Uhlig
c8ec505b9c bump libnDPI to 8ea0eaa0d0c4a3be05f67ef7fa1d22c2579cf7d1 
* added build fix for Gitlab CI
 * added friendly C11 check
 * set required libnDPI versionto 4.7
   (ArchLinux ndpi-git sets version to 4.7, which is not released yet)
 * reduced sklearn-random-forest memory consumption by adjusting min. sample leaf

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-06-12 19:05:33 +02:00
lns
2b1db0a556 Required libnDPI version increases (>=4.8.0) due to an API change. 
* fix CI issues

Signed-off-by: lns <matzeton@googlemail.com>
 2023-05-31 12:53:49 +02:00
lns
d8c20d37e5 Allow in-source builds required for OpenWrt toolchain. 
Signed-off-by: lns <matzeton@googlemail.com>
 2023-05-30 12:03:34 +02:00
lns
5a9b40779d bump libnDPI to 04f5c5196e790db8b8cc39e42c8645fb7f3dd141 
* added custom nDPI logging callback

Signed-off-by: lns <matzeton@googlemail.com>
 2023-05-30 09:30:24 +02:00
lns
d0c070a800 Added CentOs and ArchLinux to the CI. 
* added some additional checks in get-and-build-libndpi.sh
 * CMake fallback library checks

Signed-off-by: lns <matzeton@googlemail.com>
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-05-28 00:46:58 +02:00