scottk/nDPId
1
0
Fork 0
mirror of https://github.com/optim-enterprises-bv/nDPId.git synced 2025-10-29 17:32:23 +00:00
Code Issues Packages Projects Releases Wiki Activity
803 Commits 1 Branch 0 Tags
09b246dbfa230511d5c2c69fce8ea87b1604c17c
Commit Graph

803 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Toni Uhlig
091fd4d116 Added CMake option BUILD_NDPI_FORCE_GIT_UPDATE to fix broken submodule caches in GitLab CIs.. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-27 22:37:55 +02:00
Toni Uhlig
dfb8d3379f bump libnDPI to 1f693c3f5a5dcd9d69dffb610b9a81bd33f95382 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-27 21:45:14 +02:00
Toni Uhlig
a7bd3570b0 Enable custom JSON filter expressions for Python scripts. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-27 20:08:01 +02:00
Toni Uhlig
b01498f011 Fix some GCC-12 warnings. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-27 12:49:39 +02:00
Toni Uhlig
cc60e819e8 Fixed invalid base64 encoding in some rare cases. 
* nDPId-test may also verify the correct encoding/decoding

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-24 22:51:57 +02:00
Toni Uhlig
5234f4621b keras-autoencoder.py: TensorBoard, SGD optimizer, KLDivergence loss function, EarlyStopping 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-23 22:56:59 +02:00
Toni Uhlig
86ac09a8db keras-autoencoder.py: Improved Model 
* added initial learning rate for Adam
 * plot some metrics using pyplot

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-20 23:05:08 +02:00
Toni Uhlig
4b3031245d keras-autoencoder.py: fixed invalid preprocessing of received base64 packet data 
* split logic into seperate jobs; nDPIsrvd and Keras
 * nDPIsrvd: break event processing and re-run `epoll_wait()` after client disconnected

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-15 11:21:46 +02:00
Toni Uhlig
2b881d56e7 c-captured extension 
* capture packets after error event occurred
 * add "logging" and "capture" mode

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-14 01:01:26 +02:00
Toni Uhlig
dd4357c238 CMake: install header files for experimental usage 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-05 01:15:48 +02:00
Toni Uhlig
7b15838696 Added docker build&push to the CI. 
* update some git submodules

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-03 10:00:50 +02:00
Toni Uhlig
0e31829401 nDPId-test: threads should block all unix signals 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-02 23:34:10 +02:00
Toni Uhlig
d9f304e4b0 nDPId-test: print additional startup/init log messages 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-02 22:32:33 +02:00
Toni Uhlig
ebb439d959 Tiny improvments. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-02 21:00:39 +02:00
Toni Uhlig
79834df457 Removed CI matrix based jobs. 
* Fixed multiple *.deb package upload issue.

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-02 18:21:37 +02:00
Toni Uhlig
4b923bdf44 py-flow-info: print flow src/dst packets 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-28 13:16:29 +02:00
Toni Uhlig
ba8236c1f7 py-flow-info: print flow src/dst bytes/packets 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-28 11:24:09 +02:00
Toni Uhlig
d915530feb Circle CI integration 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-27 18:39:11 +02:00
Toni Uhlig
7bd8081cd2 bump libpcap dependency to 1.9.0 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-27 18:20:36 +02:00
Toni Uhlig
bc0a5782cc bump libnDPI to 2b230e28e0612e8654ad617534deb9aaaabd51b7 
* fixes loading of gambling lists which increased nDPId's memory usage *a lot*
 * nDPId: handle EINTR correctly

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-23 18:43:58 +02:00
Toni Uhlig
8a8de12fb3 Keras AE supports loading/saving models. 
* added training/batch size as cmdargs

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-22 09:25:11 +02:00
Toni Uhlig
c57ace2fd3 Correctly handle EINTR while doing I/O.. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-18 13:51:00 +02:00
Toni Uhlig
344934b7d9 CI: Upload generated packages. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-18 10:57:14 +02:00
Toni Uhlig
22ba5d5103 Improved OpenWrt Makefile: set an optional libnDPI commit hash 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-18 01:25:06 +02:00
Toni Uhlig
7217b90cd1 nDPId: `-v' give information about libnDPI linkage 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-17 19:32:41 +02:00
Toni Uhlig
74a9f7d86b nDPId: `-v' prints also information about dependecies 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-17 19:19:52 +02:00
Toni Uhlig
57d8dda350 nDPId-test: Fixed invalid error retval when epoll_wait() returns EINTR. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-16 23:23:07 +02:00
Toni Uhlig
425617abdf Added GLFW/OpenGL stats drawer written in C++. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-16 22:19:20 +02:00
Toni Uhlig
92b3c76446 Added Keras based Autoencode (Work-in-Progress!) 
* minor fixes

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-16 22:06:36 +02:00
Toni Uhlig
967381a599 get-and-build-libndpi.sh uses GMake MAKEFLAGS for sub-make (required for e.g. jobserver) 
* fixed invalid CMake `test -r ...`

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-16 22:06:31 +02:00
Toni Uhlig
d107560049 Updated OpenWrt In-Source build patch. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-06-12 19:56:02 +02:00
Toni Uhlig
c8ec505b9c bump libnDPI to 8ea0eaa0d0c4a3be05f67ef7fa1d22c2579cf7d1 
* added build fix for Gitlab CI
 * added friendly C11 check
 * set required libnDPI versionto 4.7
   (ArchLinux ndpi-git sets version to 4.7, which is not released yet)
 * reduced sklearn-random-forest memory consumption by adjusting min. sample leaf

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-06-12 19:05:33 +02:00
lns
2b1db0a556 Required libnDPI version increases (>=4.8.0) due to an API change. 
* fix CI issues

Signed-off-by: lns <matzeton@googlemail.com>
 2023-05-31 12:53:49 +02:00
lns
d8c20d37e5 Allow in-source builds required for OpenWrt toolchain. 
Signed-off-by: lns <matzeton@googlemail.com>
 2023-05-30 12:03:34 +02:00
lns
5a9b40779d bump libnDPI to 04f5c5196e790db8b8cc39e42c8645fb7f3dd141 
* added custom nDPI logging callback

Signed-off-by: lns <matzeton@googlemail.com>
 2023-05-30 09:30:24 +02:00
lns
d0c070a800 Added CentOs and ArchLinux to the CI. 
* added some additional checks in get-and-build-libndpi.sh
 * CMake fallback library checks

Signed-off-by: lns <matzeton@googlemail.com>
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-05-28 00:46:58 +02:00
lns
8a936a5072 Fixed integer overflow for tcp timeout (>INT_MAX). 
Signed-off-by: lns <matzeton@googlemail.com>
 2023-05-26 11:17:38 +02:00
Toni Uhlig
c9514136b7 bump libnDPI to ... 
* upstream changed regression test interface, needed to adapt
 * improved libnDPI helper build script
 * updated JSON schema

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-05-24 19:30:19 +02:00
Toni Uhlig
a4e5bab9b2 Fix CI. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-04-25 17:18:07 +02:00
Paul Spooren
b76a0c4607 Update build-openwrt.yml to use snapshot explicitly 
Consciously use the (unstable) snapshot tag.
 2023-04-25 16:57:47 +02:00
Toni Uhlig
c9da8b0fd9 Github Actions: update OpenWrt SDK to use main branch 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-04-21 17:03:34 +02:00
Toni Uhlig
ca355b1fdb Updated js-rt-analyzer and js-rt-analyzer-frontend examples. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-04-21 16:51:58 +02:00
Toni Uhlig
99accd03a2 Moved datalink json key/value from error to packet events and renamed it to pkt_datalink. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-04-21 16:48:40 +02:00
Toni Uhlig
225f4b3fb6 Github Actions: enable build against libnDPI-4.6, build nDPId executable from CLI 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-02-27 13:00:46 +01:00
Toni Uhlig
a8d46ef343 Merge branch 'main' of github.com:utoni/nDPId 2023-02-27 02:02:12 +01:00
Toni Uhlig
aafc72a44b Github Actions: enable build against libnDPI-4.6, build nDPId executable from CLI 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-02-27 02:01:18 +01:00
Toni Uhlig
0a959993bc Improved: 
* Gitlab-CI: build nDPId executable from CLI
 * C-Simple: log affected JSON line on READ/PARSE error
 * Sklearn: quality of life changes

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-02-27 01:20:23 +01:00
dependabot[bot]
595bd5c5e3 Bump werkzeug from 2.0 to 2.2.3 in /examples/py-flow-dashboard 
Bumps [werkzeug](https://github.com/pallets/werkzeug) from 2.0 to 2.2.3.
- [Release notes](https://github.com/pallets/werkzeug/releases)
- [Changelog](https://github.com/pallets/werkzeug/blob/main/CHANGES.rst)
- [Commits](https://github.com/pallets/werkzeug/compare/2.0.0...2.2.3)

---
updated-dependencies:
- dependency-name: werkzeug
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-02-16 17:43:31 +01:00
Toni Uhlig
4236aafa0d py-machine-learning: Print CSV line numbers for invalid lines (SKLearn Random Forest Classificator). 
* c-analysed: fix wrong length check

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-01-30 22:36:17 +01:00
Toni Uhlig
23816f1403 Revert "Revert "Minor fixes."" 
This reverts commit 42aad33ec8.
 2023-01-27 12:48:20 +01:00