scottk/nDPId
1
0
Fork 0
mirror of https://github.com/optim-enterprises-bv/nDPId.git synced 2025-10-29 09:22:23 +00:00
Code Issues Packages Projects Releases Wiki Activity
761 Commits 1 Branch 0 Tags
0e792ba3011faba982e8d6bd06fb6d5e7c5a8378
Commit Graph

217 Commits

Author SHA1 Message Date
Toni Uhlig
0e792ba301 Generate global stats with microseconds precision. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2024-10-01 11:58:39 +02:00
Toni Uhlig
a230eaf061 Improved Keras Autoencoder hyper parameter. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2024-08-16 13:20:35 +02:00
Toni Uhlig
f6f3a4daab Extended analyse application to write global stats to a CSV. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2024-08-16 12:33:46 +02:00
Toni Uhlig
762e6d36bf Some small fixes. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2024-08-09 11:09:39 +02:00
Toni Uhlig
165b18c829 Fixed OpenWrt nDPId-testing build. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2024-06-12 15:07:17 +02:00
dependabot[bot]
1fbfd46fe8 Bump werkzeug from 3.0.1 to 3.0.3 in /examples/py-flow-dashboard (#37) 
Bumps [werkzeug](https://github.com/pallets/werkzeug) from 3.0.1 to 3.0.3.
- [Release notes](https://github.com/pallets/werkzeug/releases)
- [Changelog](https://github.com/pallets/werkzeug/blob/main/CHANGES.rst)
- [Commits](https://github.com/pallets/werkzeug/compare/3.0.1...3.0.3)

---
updated-dependencies:
- dependency-name: werkzeug
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-29 14:03:11 +02:00
Toni Uhlig
5290f76b5f flow-info.py: Set min risk severity required to print a risk. 
* ReadMe update

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2024-05-08 00:25:31 +02:00
Toni Uhlig
4c91038274 Removed unmaintained C JSON dumper. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2024-04-17 01:47:31 +02:00
Toni Uhlig
33560d64d2 Fix example build error if memory profiling enabled. 
* CI: build against libnDPI with `-DNDPI_NO_PKGCONFIG=ON` and `-DSTATIC_LIBNDPI_INSTALLDIR=/usr`
 * CI: `ENABLE_DBUS=ON` for most builds

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2024-03-21 07:26:22 +01:00
Toni Uhlig
717d66b0e7 Fixed missing statistics updating for unknown mapping keys in collectd/influxd. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2024-02-20 23:16:31 +01:00
Toni Uhlig
8949ba39e6 Added test mode for influx push daemon. 
* required for regression testing
 * added new confidence value (match by custom rule)
 * updated / tweaked grafana exported dashboard

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2024-02-08 01:01:35 +01:00
Toni Uhlig
feb2583ef6 bump libnDPI to 4543385d107fcc5a7e8632e35d9a60bcc40cb4f4 
* incorporated API changes from nDPI

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2024-02-06 10:34:52 +01:00
Toni Uhlig
7368f222db Fixed broken "not-detected" event/packet capture in captured example. 
* aligned it with influxd example

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2024-01-29 18:11:34 +01:00
Toni Uhlig
a007a907da Fixed invalid flow risk aggregation in collectd/influxd examples. 
* CI: build single nDPId executable with `-Wall -Wextra -std=gnu99`
 * fixed missing error events in influxd example
 * added additional test cases for collectd
 * extended grafana dashboard

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2024-01-06 19:32:47 +01:00
Toni Uhlig
876aef98e1 Improved collectd example. 
* similiar behavior to influxd example
 * gauges and counters are now handled properly

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2024-01-05 11:26:53 +01:00
Toni Uhlig
88cf57a16f Added Grafana example dashboard image. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-12-20 19:19:08 +01:00
Toni Uhlig
7e81f5b1b7 Added Grafana nDPId dashboard. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-12-16 15:20:27 +01:00
Toni Uhlig
8acf2d7273 Improved InfluxDB push daemon. 
* added proper gauge handling that enables pushing data w/o missing out
   anything e.g. short flows with a lifetime in-between two InfluxDB intervals

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-12-15 09:16:28 +01:00
Toni Uhlig
fbe07fd882 Improved InfluxDB push daemon. 
* fixed severity parsing and gauge handling
 * added flow state gauges
 * flow related gauges are only increased/decreased if a "new" event was seen (except for bytes xfer)

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-12-14 15:38:38 +01:00
Toni Uhlig
5432b06665 Improved InfluxDB push daemon. 
* fixed missing flow active gauge
 * fixed invalid flow risk severity gauges
 * fixed missing flow risk gauges

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-12-11 23:14:00 +01:00
Toni Uhlig
142a435bf6 Add InfluxDB push daemon. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-12-07 10:00:25 +01:00
Toni Uhlig
f5c5bc88a7 Replaced ambiguous naming of "JSON string" to more accurate "JSON message". #2 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-12-04 13:13:05 +01:00
Toni Uhlig
53d8a28582 Replaced ambiguous naming of "JSON string" to more accurate "JSON message". 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-12-04 13:01:27 +01:00
Toni Uhlig
7368d34d8d c-collectd: Fixed missing escape char. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-12-01 06:43:39 +01:00
Toni Uhlig
d274a06176 flow-info.py: Do not print any information if a flow is "empty" meaning no L4 payload seen so far. 
* added JsonDecodeError to provide more information if builtin JSON decoder fails

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-12-01 06:43:39 +01:00
Toni Uhlig
3416db11dc Updated ReadMe's, ToDo's and ChangeLog. 
* 1.6-release

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-11-20 23:39:47 +01:00
Toni Uhlig
fa7e76cc75 Fixed SonarCloud complaints. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-11-20 13:40:48 +01:00
Toni Uhlig
82934b7271 Fixed clang-tidy warnings. 
* fixed/improved c-captured logging

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-11-13 13:52:42 +01:00
Toni Uhlig
4920b2a4be Use c-captured within test/run_tests.sh. 
* Some logging related modifications were required to achieve this.

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-11-11 19:16:07 +01:00
Toni Uhlig
8ebaccc27d py-flow-info: Improved analyse result printing. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-11-09 23:44:35 +01:00
Toni Uhlig
dcb595e161 bump libnDPI to b08c787fe267053afdea82701071f3878c09244b 
* fix ndpi data anylsis struct min/max issue
 * py-flow-info cosmetics in printing some information

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-11-09 19:52:36 +01:00
Toni Uhlig
b1e679b0bb Improved DBUS notification daemon. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-11-07 17:50:12 +01:00
Toni Uhlig
5d56288a11 Fixed more SonarCloud complaints. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-11-07 00:02:36 +01:00
Toni Uhlig
84b12cd02c Fixed some SonarCloud complaints. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-11-06 13:31:59 +01:00
Toni Uhlig
5335d84fe5 Add DBUS suspicious flow event notification daemon. 
* nDPIsrvd.h: support for closing/resetting a nDPIsrvd_socket (required for a reconnect)

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-11-03 16:07:28 +01:00
Toni Uhlig
32ab500eb0 Bump werkzeug to 3.0.1 
* see #29

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-11-02 14:15:06 +01:00
Toni Uhlig
44adfc0b7d Sonarcloud integration 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-10-05 17:37:42 +02:00
Toni Uhlig
dfd0449306 Fix issues detected by SonarCloud. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-10-05 17:26:06 +02:00
Toni Uhlig
0a0342ce28 c-captured: Log only flows w/o packet data to syslog if in logging mode. 
* CI Fix #2

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-09-10 21:46:51 +02:00
Toni Uhlig
7515c1b072 Fix CI. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-09-10 20:28:11 +02:00
Toni Uhlig
be07c16c0e sklearn-random-forest.py: Pretty print false positive/negative. 
* added max tree depth command line argument
 * print a note if loading an existing model while using --sklearn-* command line options

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-09-10 20:20:25 +02:00
Toni Uhlig
a7bd3570b0 Enable custom JSON filter expressions for Python scripts. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-27 20:08:01 +02:00
Toni Uhlig
b01498f011 Fix some GCC-12 warnings. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-27 12:49:39 +02:00
Toni Uhlig
5234f4621b keras-autoencoder.py: TensorBoard, SGD optimizer, KLDivergence loss function, EarlyStopping 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-23 22:56:59 +02:00
Toni Uhlig
86ac09a8db keras-autoencoder.py: Improved Model 
* added initial learning rate for Adam
 * plot some metrics using pyplot

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-20 23:05:08 +02:00
Toni Uhlig
4b3031245d keras-autoencoder.py: fixed invalid preprocessing of received base64 packet data 
* split logic into seperate jobs; nDPIsrvd and Keras
 * nDPIsrvd: break event processing and re-run `epoll_wait()` after client disconnected

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-15 11:21:46 +02:00
Toni Uhlig
2b881d56e7 c-captured extension 
* capture packets after error event occurred
 * add "logging" and "capture" mode

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-14 01:01:26 +02:00
Toni Uhlig
7b15838696 Added docker build&push to the CI. 
* update some git submodules

Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-03 10:00:50 +02:00
Toni Uhlig
ebb439d959 Tiny improvments. 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-08-02 21:00:39 +02:00
Toni Uhlig
4b923bdf44 py-flow-info: print flow src/dst packets 
Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
 2023-07-28 13:16:29 +02:00