scottk/nDPId
1
0
Fork 0
mirror of https://github.com/optim-enterprises-bv/nDPId.git synced 2025-10-28 17:02:24 +00:00
Code Issues Packages Projects Releases Wiki Activity
810 Commits 1 Branch 0 Tags
main
Commit Graph

810 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Toni Uhlig
225f4b3fb6 Github Actions: enable build against libnDPI-4.6, build nDPId executable from CLI 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-02-27 13:00:46 +01:00
Toni Uhlig
a8d46ef343 Merge branch 'main' of github.com:utoni/nDPId 2023-02-27 02:02:12 +01:00
Toni Uhlig
aafc72a44b Github Actions: enable build against libnDPI-4.6, build nDPId executable from CLI 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-02-27 02:01:18 +01:00
Toni Uhlig
0a959993bc Improved: 
* Gitlab-CI: build nDPId executable from CLI
 * C-Simple: log affected JSON line on READ/PARSE error
 * Sklearn: quality of life changes

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-02-27 01:20:23 +01:00
dependabot[bot]
595bd5c5e3 Bump werkzeug from 2.0 to 2.2.3 in /examples/py-flow-dashboard 
Bumps [werkzeug](https://github.com/pallets/werkzeug) from 2.0 to 2.2.3.
- [Release notes](https://github.com/pallets/werkzeug/releases)
- [Changelog](https://github.com/pallets/werkzeug/blob/main/CHANGES.rst)
- [Commits](https://github.com/pallets/werkzeug/compare/2.0.0...2.2.3)

---
updated-dependencies:
- dependency-name: werkzeug
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-02-16 17:43:31 +01:00
Toni Uhlig
4236aafa0d py-machine-learning: Print CSV line numbers for invalid lines (SKLearn Random Forest Classificator). 
* c-analysed: fix wrong length check

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-01-30 22:36:17 +01:00
Toni Uhlig
23816f1403 Revert "Revert "Minor fixes."" 
This reverts commit 42aad33ec8.
 2023-01-27 12:48:20 +01:00
Toni Uhlig
42aad33ec8 Revert "Minor fixes." 
This reverts commit 58439a6761.
 2023-01-27 02:02:16 +01:00
Toni Uhlig
c71284291e updated js-rt-analyzer* 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-01-27 01:47:49 +01:00
Toni Uhlig
58439a6761 Minor fixes. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-01-27 01:39:03 +01:00
Toni Uhlig
5e313f43f9 Small CI/CD/nDPIsrvd.py improvements. 
* Updated examples/js-rt-analyzer and examples/js-rt-analyzer-frontend

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-01-17 21:01:47 +01:00
Toni Uhlig
a3d20c17d1 Improved collectd risk processing to be in sync with libnDPI risks. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-01-11 06:28:10 +01:00
Toni Uhlig
c0717c7e6c Gitlab-CI: Upload coverage report. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-01-11 06:14:44 +01:00
Toni Uhlig
470ed99eaf Added https://gitlab.com/verzulli/ndpid-rt-analyzer-frontend.git example. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-01-11 06:13:51 +01:00
Toni Uhlig
ac3757a367 Merge branch 'main' of github.com:utoni/nDPId 2023-01-10 10:13:57 +01:00
Toni Uhlig
07efb1efd4 Added distclean-libnDPI target to CMake. 
* Gitlab-CI: Additional job for debian packages
 * Install Python examples iff BUILD_EXAMPLES=ON

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-01-10 01:03:34 +01:00
Macauley Cheng
afe873c0de Delete docker-compose.yml 2023-01-09 21:13:53 +01:00
macauley_cheng
3dcc13b052 add Docker related file 2023-01-09 21:13:53 +01:00
Toni Uhlig
464450486b bump libnDPI to a944514ddec73f79704f55aab1423e39f4ce7a03 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-01-09 11:24:40 +01:00
Toni Uhlig
655393e953 nDPid: Fixed base64encode bug which lead to invalid base64 strings. 
* py-semantic-validation: Decode base64 raw packet data as well
 * nDPIsrvd.py: Added PACKETS_PLEN_MAX
 * nDPIsrvd.py: Improved JSON parse error/exception handling

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-01-09 01:43:24 +01:00
Toni Uhlig
e9443d7618 Fix libnDPI build script. 
* added ntop Webinar 2022 reference

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-12-26 19:35:12 +01:00
Toni Uhlig
4e19ab929c py-machine-learning / sklearn-random-forest: Quality Of Life improvments 
* fixed libnDPI submodule build on some platforms

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-12-22 22:13:08 +01:00
Toni Uhlig
c5930e3510 Add collectd statistics diff test. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-12-06 19:51:53 +01:00
Toni Uhlig
d21a38cf02 Limit the size of base64 serialized raw packet data (8192 bytes per packet). 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-12-06 12:52:52 +01:00
Toni Uhlig
ced5f5d4b4 py-flow-info: ignore certain json lines that match various criteria 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-12-03 01:23:26 +01:00
Toni Uhlig
60741d5649 Strace support for diff tests. 
* tiny README update

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-12-03 01:21:20 +01:00
Toni Uhlig
8b81b170d3 Updated Github/Gitlab CI 
* instrument Clang's thread sanitizer for tests

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-12-02 23:24:06 +01:00
Toni Uhlig
2c95b31210 nDPId-test: Reworked I/O handling to prevent some endless loop scenarios. Fixed a race condition in the memory wrapper as well. 
* nDPId: Instead of sending too long JSON strings, log an error and some parts.

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-12-02 22:11:57 +01:00
Toni Uhlig
532961af33 Fixed MD format issues. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-11-21 11:34:10 +01:00
Toni Uhlig
64f6abfdbe Unified nDPId/nDPIsrvd command line argument storage. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-11-21 11:26:05 +01:00
Toni Uhlig
77ee336cc9 Added Network Buffer Size CI Check. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-11-20 22:42:06 +01:00
Toni Uhlig
9b78939096 Updated README's. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-11-20 22:25:18 +01:00
Toni Uhlig
57c5d8532b Test for diff's in flow-analyse CSV generator daemon. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-11-16 23:06:37 +01:00
Toni Uhlig
869d4de271 Improved make daemon / daemon.sh to accept nDPId / nDPIsrvd arguments via env. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-11-15 07:05:29 +01:00
Toni Uhlig
ce567ae5b7 Improved the point of time when to append the raw packet base64 data to the serializer. 
* nDPId-test: Increased the max-packets-per-flow-to-send from 3 to 5.
   This is quite useful for TCP as the first 3 packets are usually part of the three-way-handshake.

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-11-15 06:25:16 +01:00
Toni Uhlig
36e428fc89 Sync unit tests. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-11-13 16:19:07 +01:00
Toni Uhlig
ea1698504c nDPIsrvd: Provide workaround for change user/group. 
* nDPId/nDPIsrvd/c-examples: Parameter parsing needs to be improved
                              if `strdup()` in combination with static strings is used.
 * Other non-critical fixes.

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-11-13 11:21:55 +01:00
Toni Uhlig
bc346a28f4 nDPId: Fixed base64 encoding issue. 
* The issue can result in an error message like:
   `Base64 encoding failed with: Buffer too small.`
   and also in too big JSON strings generated by nDPId
   which nDPIsrvd does not like as it's length is
   greater than `NETWORK_BUFFER_MAX_SIZE`.
 * nDPId will now obey `NETWORK_BUFFER_MAX_SIZE` while
   trying to base64 encode raw packet data.

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-11-13 09:26:04 +01:00
Toni Uhlig
e629dd59cd nDPIsrvd.h: Provide two additional convenient API functions. 
* nDPIsrvd_json_buffer_string
 * nDPIsrvd_json_buffer_length

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-11-06 13:19:29 +01:00
Toni Uhlig
7515c8aeec Experimental systemd support. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-11-06 12:58:55 +01:00
Toni Uhlig
25f4ef74ac Improved examples. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-11-02 00:01:57 +01:00
Toni Uhlig
d55e397929 bump libnDPI to db9f6ec1b4018164e5bff05f115dc60711bb711b 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-10-31 13:53:02 +01:00
Toni Uhlig
d3f99f21e6 Create pidfile iff daemon mode enabled. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-10-31 12:45:49 +01:00
Toni Uhlig
c63cbec26d Improved nDPIsrvd-collectd statistics. 
* Improved RRD-Graph generation script and static WWW html files.

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-10-31 12:45:15 +01:00
Toni Uhlig
805aef5de8 Increased network buffer size to 33792 bytes. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-10-30 22:13:07 +01:00
Toni Uhlig
2d14509f04 nDPid-test: add buffer test 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-10-30 20:12:17 +01:00
Toni Uhlig
916d2df6ea nDPId-test: Fixed thread sync/lock issue. 
* rarely happens in CI

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-10-22 01:45:14 +02:00
Toni Uhlig
46c8fc5219 Merge branch 'main' of github.com:utoni/nDPId 2022-10-20 16:13:27 +02:00
Toni Uhlig
e5f4af4890 Special Thanks to Damiano Verzulli (@verzulli). 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2022-10-20 16:12:40 +02:00
lns
cd22d56056 Add ArchLinux PKGBUILD. 
Signed-off-by: lns <matzeton@googlemail.com>
 2022-10-19 18:40:52 +02:00