810 Commits

Author SHA1 Message Date
Toni Uhlig
ae95c95617 bump libnDPI to c49d126d3642d5b1f5168d049e3ebf0ee3451edc
* fix API issue with a changed function signature

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2025-03-06 19:00:23 +01:00
Toni
42c54d3755 Initial tunnel decoding (GRE - Layer4 only atm) (#55)
Initial tunnel decoding (GRE - Layer4 only atm). Fixes #53
 * make finally use of the thread distribution seed
 * Handle GRE/PPP subprotocol the right way
 * Add `-t` command line / config option
 * Removed duplicated and obsolete IP{4,6}_SIZE_SMALLER_THAN_HEADER which is the same as IP{4,6}_PACKET_TOO_SHORT
 * Updated error event schema

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2025-02-25 15:17:16 +01:00
Toni Uhlig
bb870cb98f Add FreeBSD CI build
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2025-02-01 10:54:27 +01:00
Alex Eganov
e262227d65 Fix missing header file for build on freebsd (macos) (#60) 2025-01-31 23:02:13 +01:00
Toni Uhlig
899e5a80d6 CI: Fixed config tests
* set max dots per line to improve CI output
 * commented `flow_risk.crawler_bot.list.load` out

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2025-01-26 09:58:22 +01:00
Toni Uhlig
053818b242 CI: Added libnl-genl-3-dev to PF_RING build
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2025-01-26 07:59:55 +01:00
Toni Uhlig
4048a8c300 Set minimal required nDPI version to 4.14 (tarball) and 4.13 (git)
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2025-01-26 01:10:30 +01:00
Toni Uhlig
09b246dbfa Temp disable flow_risk.crawler_bot.list.load in default config file
* currently broken in upstream

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2025-01-26 01:00:18 +01:00
Toni Uhlig
471ea83493 bump libnDPI to e946f49aca13e4447a7d7b2acae6323a4531fb55
* incorporated upstream changes

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2025-01-25 10:07:25 +01:00
Toni Uhlig
064bd3aefa fix config header
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-12-09 11:26:45 +01:00
Toni Uhlig
acd9e871b6 Added --no-blink and --hide-risk-info
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-12-09 11:09:34 +01:00
Toni Uhlig
b9465c09d8 Increased maximum value for max-flows-per-thread to 65k
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-12-03 21:02:24 +01:00
Toni Uhlig
3a4b7b0860 CI: make dist test (extract archive, run CMake)
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-11-20 13:40:14 +01:00
Toni Uhlig
34f01b90e3 Fixed CMake warnings
* `make dist`: improved libnDPI git version naming

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-11-20 12:05:03 +01:00
Toni Uhlig
7b91ad8458 Added script to warn a user about issues regarding wrong umask and CPack
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-11-20 11:01:01 +01:00
Toni Uhlig
442900bc14 Dockerfile update
* gitlab-ci runner fix (single runner / multiple jobs)

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-11-18 14:44:44 +01:00
Toni Uhlig
0a4f3cb0c8 Fix Gitlab CI build for some runners
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-11-18 13:51:06 +01:00
Toni Uhlig
4bed2a791f CMake/RPM integration
* CI integration
 * RPM (un)install scripts

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-11-17 17:12:06 +01:00
Toni Uhlig
1aa7d9bdb6 nDPId daemon status event: serialize nDPI API version + Size/Flow
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-11-17 13:12:33 +01:00
Toni Uhlig
bd269c9ead Added global stats diff test
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-11-14 14:33:27 +01:00
Toni Uhlig
7e4c69635a Use chmod_chown() API from utils
* `chmod_chown()` returns EINVAL if path is NULL

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-11-14 13:47:46 +01:00
Toni Uhlig
9105b393e1 Fixed some SonarCloud issues
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-11-14 10:21:35 +01:00
Toni Uhlig
9efdecf4ef bump libnDPI to 59ee1fe1156be234fed796972a29a31a0589e25a
* set minimum nDPI version to 4.12.0 (incompatible API changes)
 * fixed `ndpi_debug_printf()` function signature
 * JSON schema (flow): added risk `56`: "Obfuscated Traffic"
 * JSON schema (flow): added "domainame"
 * fixed OpenWrt build

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-11-13 17:23:31 +01:00
Toni Uhlig
8c114e4916 cosmetics
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-11-10 13:43:26 +01:00
Toni Uhlig
a733d536ad Added env check NDPID_STARTED_BY_SYSTEMD to prevent logging to stderr in such a case
* removed `nDPId` shutdown on poll/epoll error
 * fixed `chmod_chown()` rv check

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-11-07 11:32:42 +01:00
Toni Uhlig
9fc35e7a7e Add NUL to risks, not needed but better be safe then sorry
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-11-05 14:20:30 +01:00
Toni Uhlig
ce9752af16 Fixed some SonarCloud issues
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-11-05 13:43:23 +01:00
Toni Uhlig
f7933d0fdb Slightly unified C example's logging
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-11-05 12:48:36 +01:00
Toni Uhlig
d5a84ce630 Temporarily disabled some OpenWrt builds
* See: https://github.com/openwrt/gh-action-sdk/issues/43

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-11-05 10:24:17 +01:00
Toni Uhlig
ce5f448d3b Switched OpenWrt GitHub Actions SDK to main branch
* fixed some SonarCloud complaints
 * added more systemd CI tests
 * fixed debian package scripts to obey remove/purge
 * changed `chmod_chown()` error handling

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-11-02 18:36:54 +01:00
Toni Uhlig
2b48eb0514 Added vlan_id dissection of the most outer (first) 802.1Q header. Fixes #50
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-11-02 15:48:45 +01:00
Toni Uhlig
ddc96ba614 Adjusted SonarCloud config and CI
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-11-02 12:05:07 +01:00
Toni Uhlig
7b2cd268bf Updated JSON schema files and a test to make use of the UUID feature.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-10-29 15:25:19 +01:00
Toni Uhlig
817559ffa7 Set an optional UUID used within all events (similar to the "alias").
* added default values to usage
 * UUID can be either read from a file or used directly from option value
 * adjusted example config file

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-10-29 12:12:02 +01:00
Toni Uhlig
25944e2089 Fixed some SonarCloud issues
* fixed dependabot werkzeug (3.0.3 to 3.0.6)

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-10-26 11:35:30 +02:00
Toni Uhlig
5423797267 Added nDPId ndpi_process_packet() LLVM fuzzer
* replaced dumb `dumb_fuzzer.sh`
 * fixed nDPId NULL pointer deref found by fuzzer
 * nDPI: `--enable-debug-build` and `--enable-debug-messages` for non release builds
 * nDPI: do not force `log.level` to `3` anymore, use config value instead

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-10-24 15:45:04 +02:00
Toni Uhlig
7e126c205e Added additional (libnDPI) config files for test runs.
* redirect `run_tests.sh` stderr to filename which prepends config name

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-10-23 14:27:07 +02:00
Toni Uhlig
7d58703bdb Removed ENABLE_MEMORY_STATUS CMake option as it's now enabled for **all** builds
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-10-22 13:12:59 +02:00
Toni Uhlig
ae36f8df6c Added libnDPI global context init/deinit used for cache mgmt.
* support for adding *.ndpiconf for nDPI config tests
 * all other configs should have the suffix *.conf
 * fixed nDPI malloc/free wrapper set (was already too late set)

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-10-21 16:17:01 +02:00
Toni Uhlig
8c5ee1f7bb Added config testing script.
* nDPId-test may now make use of an optional config file as cmd arg

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-10-21 16:10:09 +02:00
Toni Uhlig
9969f955dc Updated ReadMe's, ToDo's and ChangeLog.
* 1.7-release

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-10-21 15:44:42 +02:00
Toni Uhlig
2c771c54b0 Merge commit 'fb1dcc71de39e6dd5c11b8bc4288ec5e618fa946' 2024-10-17 12:16:40 +02:00
Toni Uhlig
fb1dcc71de Squashed 'dependencies/jsmn/' changes from 1aa2e8f8..25647e69
25647e69 Fix position of a comment in string parsing

git-subtree-dir: dependencies/jsmn
git-subtree-split: 25647e692c7906b96ffd2b05ca54c097948e879c
2024-10-17 12:16:40 +02:00
Toni Uhlig
071a9bcb91 Merge commit '9a14454d3c5589373253571cee7428c593adefd9' 2024-10-17 12:16:20 +02:00
Toni Uhlig
9a14454d3c Squashed 'dependencies/uthash/' changes from bf152630..f69112c0
f69112c0 utarray: Fix typo in docs
619fe95c Fix MSVC warning C4127 in HASH_BLOOM_TEST (#261)
eeba1961 uthash: Improve the docs for HASH_ADD_INORDER
ca98384c HASH_DEL should be able to delete a const-qualified node
095425f7 utlist: Add one more assertion in DL_DELETE2
399bf74b utarray: Stop making `oom` a synonym for `utarray_oom`
85bf75ab utarray_str_cpy: Remove strdup; utarray_oom() if strdup fails.
1a53f304 GitHub CI: Also test building the docs (#248)
4d01591e The MCST Elbrus C Compiler supports __typeof. (#247)
1e0baf06 CI: Add GitHub Actions CI
8844b529 Update test57.c per a suggestion by @mark-summerfield
44a66fe8 Update http:// URLs to https://, and copyright dates to 2022. NFC.

git-subtree-dir: dependencies/uthash
git-subtree-split: f69112c04f1b6e059b8071cb391a1fcc83791a00
2024-10-17 12:16:20 +02:00
Toni Uhlig
f9d9849300 Updated Grafana dashboard to make correct use of gauge max values.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-10-17 12:14:28 +02:00
Toni
efed6f196e Read and parse configuration files. Fixes #41. (#42)
Read and parse configuration files. Fixes #41.

 * supports nDPId / nDPIsrvd via command line parameter `-f`
 * nDPId: read general/tuning and libnDPI settings
 * support for settings risk domains libnDPI option via config file or via `-R` (Fixes #45, thanks to @UnveilTech)
 * added some documentation in the config file
 * adjusted Systemd and Debian packaging to make use of config files

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-10-16 14:13:55 +02:00
Naix
3e2ce661f0 Added Filebeat Configuration (#44)
Added Filebeat Configuration

Co-authored-by: Toni <matzeton@googlemail.com>
2024-10-06 11:09:54 +02:00
Toni Uhlig
76e1ea0598 Updated Grafana dashboard.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-10-02 19:29:14 +02:00
Toni Uhlig
0e792ba301 Generate global stats with microseconds precision.
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
2024-10-01 11:58:39 +02:00