Commit Graph

639 Commits

Author SHA1 Message Date
Toni Uhlig
79834df457 Removed CI matrix based jobs.
* Fixed multiple *.deb package upload issue.

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-08-02 18:21:37 +02:00
Toni Uhlig
4b923bdf44 py-flow-info: print flow src/dst packets
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-07-28 13:16:29 +02:00
Toni Uhlig
ba8236c1f7 py-flow-info: print flow src/dst bytes/packets
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-07-28 11:24:09 +02:00
Toni Uhlig
d915530feb Circle CI integration
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-07-27 18:39:11 +02:00
Toni Uhlig
7bd8081cd2 bump libpcap dependency to 1.9.0
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-07-27 18:20:36 +02:00
Toni Uhlig
bc0a5782cc bump libnDPI to 2b230e28e0612e8654ad617534deb9aaaabd51b7
* fixes loading of gambling lists which increased nDPId's memory usage *a lot*
 * nDPId: handle EINTR correctly

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-07-23 18:43:58 +02:00
Toni Uhlig
8a8de12fb3 Keras AE supports loading/saving models.
* added training/batch size as cmdargs

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-07-22 09:25:11 +02:00
Toni Uhlig
c57ace2fd3 Correctly handle EINTR while doing I/O..
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-07-18 13:51:00 +02:00
Toni Uhlig
344934b7d9 CI: Upload generated packages.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-07-18 10:57:14 +02:00
Toni Uhlig
22ba5d5103 Improved OpenWrt Makefile: set an optional libnDPI commit hash
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-07-18 01:25:06 +02:00
Toni Uhlig
7217b90cd1 nDPId: `-v' give information about libnDPI linkage
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-07-17 19:32:41 +02:00
Toni Uhlig
74a9f7d86b nDPId: `-v' prints also information about dependecies
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-07-17 19:19:52 +02:00
Toni Uhlig
57d8dda350 nDPId-test: Fixed invalid error retval when epoll_wait() returns EINTR.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-07-16 23:23:07 +02:00
Toni Uhlig
425617abdf Added GLFW/OpenGL stats drawer written in C++.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-07-16 22:19:20 +02:00
Toni Uhlig
92b3c76446 Added Keras based Autoencode (Work-in-Progress!)
* minor fixes

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-07-16 22:06:36 +02:00
Toni Uhlig
967381a599 get-and-build-libndpi.sh uses GMake MAKEFLAGS for sub-make (required for e.g. jobserver)
* fixed invalid CMake `test -r ...`

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-07-16 22:06:31 +02:00
Toni Uhlig
d107560049 Updated OpenWrt In-Source build patch.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-06-12 19:56:02 +02:00
Toni Uhlig
c8ec505b9c bump libnDPI to 8ea0eaa0d0c4a3be05f67ef7fa1d22c2579cf7d1
* added build fix for Gitlab CI
 * added friendly C11 check
 * set required libnDPI versionto 4.7
   (ArchLinux ndpi-git sets version to 4.7, which is not released yet)
 * reduced sklearn-random-forest memory consumption by adjusting min. sample leaf

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-06-12 19:05:33 +02:00
lns
2b1db0a556 Required libnDPI version increases (>=4.8.0) due to an API change.
* fix CI issues

Signed-off-by: lns <matzeton@googlemail.com>
2023-05-31 12:53:49 +02:00
lns
d8c20d37e5 Allow in-source builds required for OpenWrt toolchain.
Signed-off-by: lns <matzeton@googlemail.com>
2023-05-30 12:03:34 +02:00
lns
5a9b40779d bump libnDPI to 04f5c5196e790db8b8cc39e42c8645fb7f3dd141
* added custom nDPI logging callback

Signed-off-by: lns <matzeton@googlemail.com>
2023-05-30 09:30:24 +02:00
lns
d0c070a800 Added CentOs and ArchLinux to the CI.
* added some additional checks in get-and-build-libndpi.sh
 * CMake fallback library checks

Signed-off-by: lns <matzeton@googlemail.com>
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-05-28 00:46:58 +02:00
lns
8a936a5072 Fixed integer overflow for tcp timeout (>INT_MAX).
Signed-off-by: lns <matzeton@googlemail.com>
2023-05-26 11:17:38 +02:00
Toni Uhlig
c9514136b7 bump libnDPI to ...
* upstream changed regression test interface, needed to adapt
 * improved libnDPI helper build script
 * updated JSON schema

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-05-24 19:30:19 +02:00
Toni Uhlig
a4e5bab9b2 Fix CI.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-04-25 17:18:07 +02:00
Paul Spooren
b76a0c4607 Update build-openwrt.yml to use snapshot explicitly
Consciously use the (unstable) snapshot tag.
2023-04-25 16:57:47 +02:00
Toni Uhlig
c9da8b0fd9 Github Actions: update OpenWrt SDK to use main branch
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-04-21 17:03:34 +02:00
Toni Uhlig
ca355b1fdb Updated js-rt-analyzer and js-rt-analyzer-frontend examples.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-04-21 16:51:58 +02:00
Toni Uhlig
99accd03a2 Moved datalink json key/value from error to packet events and renamed it to pkt_datalink.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-04-21 16:48:40 +02:00
Toni Uhlig
225f4b3fb6 Github Actions: enable build against libnDPI-4.6, build nDPId executable from CLI
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-02-27 13:00:46 +01:00
Toni Uhlig
a8d46ef343 Merge branch 'main' of github.com:utoni/nDPId 2023-02-27 02:02:12 +01:00
Toni Uhlig
aafc72a44b Github Actions: enable build against libnDPI-4.6, build nDPId executable from CLI
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-02-27 02:01:18 +01:00
Toni Uhlig
0a959993bc Improved:
* Gitlab-CI: build nDPId executable from CLI
 * C-Simple: log affected JSON line on READ/PARSE error
 * Sklearn: quality of life changes

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-02-27 01:20:23 +01:00
dependabot[bot]
595bd5c5e3 Bump werkzeug from 2.0 to 2.2.3 in /examples/py-flow-dashboard
Bumps [werkzeug](https://github.com/pallets/werkzeug) from 2.0 to 2.2.3.
- [Release notes](https://github.com/pallets/werkzeug/releases)
- [Changelog](https://github.com/pallets/werkzeug/blob/main/CHANGES.rst)
- [Commits](https://github.com/pallets/werkzeug/compare/2.0.0...2.2.3)

---
updated-dependencies:
- dependency-name: werkzeug
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-02-16 17:43:31 +01:00
Toni Uhlig
4236aafa0d py-machine-learning: Print CSV line numbers for invalid lines (SKLearn Random Forest Classificator).
* c-analysed: fix wrong length check

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-01-30 22:36:17 +01:00
Toni Uhlig
23816f1403 Revert "Revert "Minor fixes.""
This reverts commit 42aad33ec8.
2023-01-27 12:48:20 +01:00
Toni Uhlig
42aad33ec8 Revert "Minor fixes."
This reverts commit 58439a6761.
2023-01-27 02:02:16 +01:00
Toni Uhlig
c71284291e updated js-rt-analyzer*
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-01-27 01:47:49 +01:00
Toni Uhlig
58439a6761 Minor fixes.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-01-27 01:39:03 +01:00
Toni Uhlig
5e313f43f9 Small CI/CD/nDPIsrvd.py improvements.
* Updated examples/js-rt-analyzer and examples/js-rt-analyzer-frontend

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-01-17 21:01:47 +01:00
Toni Uhlig
a3d20c17d1 Improved collectd risk processing to be in sync with libnDPI risks.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-01-11 06:28:10 +01:00
Toni Uhlig
c0717c7e6c Gitlab-CI: Upload coverage report.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-01-11 06:14:44 +01:00
Toni Uhlig
470ed99eaf Added https://gitlab.com/verzulli/ndpid-rt-analyzer-frontend.git example.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-01-11 06:13:51 +01:00
Toni Uhlig
ac3757a367 Merge branch 'main' of github.com:utoni/nDPId 2023-01-10 10:13:57 +01:00
Toni Uhlig
07efb1efd4 Added distclean-libnDPI target to CMake.
* Gitlab-CI: Additional job for debian packages
 * Install Python examples iff BUILD_EXAMPLES=ON

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-01-10 01:03:34 +01:00
Macauley Cheng
afe873c0de Delete docker-compose.yml 2023-01-09 21:13:53 +01:00
macauley_cheng
3dcc13b052 add Docker related file 2023-01-09 21:13:53 +01:00
Toni Uhlig
464450486b bump libnDPI to a944514ddec73f79704f55aab1423e39f4ce7a03
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-01-09 11:24:40 +01:00
Toni Uhlig
655393e953 nDPid: Fixed base64encode bug which lead to invalid base64 strings.
* py-semantic-validation: Decode base64 raw packet data as well
 * nDPIsrvd.py: Added PACKETS_PLEN_MAX
 * nDPIsrvd.py: Improved JSON parse error/exception handling

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2023-01-09 01:43:24 +01:00
Toni Uhlig
e9443d7618 Fix libnDPI build script.
* added ntop Webinar 2022 reference

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2022-12-26 19:35:12 +01:00