Commit Graph

23 Commits

Author SHA1 Message Date
Yassin Raman
d50e822b71 deployment: prometheus, grafana and new version of storm with siembol metrics (#692)
* grafana and prometheus

* updated storm to latest

* grafana and prometheus

* grafana and prometheus

* grafana and prometheus

* grafana and prometheus

* version

* kafka lag exporter

* include kafka lag

* log level and change interval for scraping

* update to use values.yaml file

* fix

* added latency graphs

* added latency graphs, fix

* added monitoring to clean up

* using official docker image

* remove outdated comment

* fix, indentation

* clean up

* host names added

* rename and clean up

* rename and clean up

* tag

* jmx exporter cm added

* jmx exporter cm added

* jmx exporter volume mount

* jmx exporter install

* storm version

* add jmx to ps

* fix for changing port

* add wget to install

* not needed, we're using ingress-dns add on and configuring actual dns resolver

* fix

* fix post request

* add protection matches to dashboard

* separate traffic generator from main siembol install

* update

* update

* move file to correct loc

* typo

* fix

Co-authored-by: Yassin Raman <yassin@gmail.co>
Co-authored-by: yasram1 <yasram1@github.com>
Co-authored-by: Celie Valentiny <cvalentiny@hotmail.fr>
2022-07-14 11:59:27 +01:00
Celie Valentiny
b35853cd2e Deployment: Quickstart with monitoring, response and kafka producer for demo (#724) 2022-07-12 13:15:08 +01:00
Celie Valentiny
037997280c Deployment: siembol-monitoring (#675) 2022-06-29 11:32:10 +01:00
Yassin Raman
9a77bd4d8d docs: Adding Siembol Helm (#674)
* remove unused configs, these dependencies are installed separately

* remove, not needed

* not used

* docs for deployment

* docs for deployment

* docs for deployment

* clean up

* intendation

* docs for deployment

* kustomize and enabled apps docs

* kustomize and enabled apps docs

* resources as values

* fix

* fix

* version, 2.4.0 is set by default

* added docs for resources

* added docs for resources

* added separate page for customize

* more docs

* more docs

* more docs

* more docs

* fix

* fix

* more docs

* more docs

* added new how to page

Co-authored-by: Yassin Raman <yassin@gmail.co>
Co-authored-by: yasram1 <yasram1@github.com>
2022-06-14 14:58:19 +01:00
Jonathan Giannuzzi
d0ff5fb1c1 [quickstart] Fix domain name resolution failures on macOS (#488)
* [quickstart] Fix domain name resolution failures on macOS

* [quickstart] fix enrichmentStore scripts as well
2022-01-14 17:34:34 +00:00
Marian Novotny
e6f47e9989 adding ZooKeeper autocreation documentation (#427)
removing creating ZooKeeper nodes from quickstart install
adding underscore char into allowed upload name in enrichment store
2021-11-18 15:25:39 +00:00
Yassin Raman
38a436f920 Deployment: oauth2 proxy as dependency with own oauth-values.yaml file (#423)
* added oauth2 proxy as dependency with own values.yaml file

* remove oauth install and move ingresses to separate app

* change valeues

* change valeues

Co-authored-by: Yassin Raman <yassin@gmail.co>
Co-authored-by: yasram1 <yasram1@github.com>
2021-11-17 10:40:12 +00:00
Yassin Raman
2b439243af Deployment: enrichment store; index page fix (#418)
* improvements for upload of files

* adding index file and namespace, and change install values

* adding index file and namespace, and change install values

* fix

* small fixes, shared zk and resources update

* small fix

* refactoring

* reduce to one zk

* bug fix for dir names

Co-authored-by: Yassin Raman <yassin@gmail.co>
Co-authored-by: yasram1 <yasram1@github.com>
2021-11-12 15:58:57 +00:00
Yassin Raman
35eb167203 Deployment: config-editor-rest, and minikube (#415)
* Deployment: config-editor-rest, delay probe

* change resources

* change resources
2021-11-09 16:42:40 +00:00
Yassin Raman
1ef5b80e6a Deployment: enrichment store, values, quickstart install (#413)
* improvements for upload of files

* adding index file and namespace, and change install values

* adding index file and namespace, and change install values

* fix

* small fixes, shared zk and resources update

* small fix

* refactoring

Co-authored-by: Yassin Raman <yassin@gmail.co>
Co-authored-by: yasram1 <yasram1@github.com>
2021-11-09 15:46:49 +00:00
Celie Valentiny
edea30123e Deployment: cherrypick java11 commits for enrichment store (#406) 2021-11-05 09:37:35 +00:00
Yassin Raman
76abef273c Deployment: adding Enrichment store server into helm charts (#382)
* nginx server and oauth

* completed deployment, added svc and ingress

* included app

* removed for now

* change back

* user id

* test cm added

* test cm added

* change image and as a result the port and config

* better config

* typo

* typo

* typo

* added service

* typo

* typo

* test

* apache server

* not needed

* small fixes

* small fixes

* small fixes

* small fixes

* small fixes

* small fixes

* adding entry

* small bug fixes

* small bug fixes

* small bug fix

* change to cm

* added ns

Co-authored-by: yasram1 <yasram1@github.com>
Co-authored-by: Yassin Raman <yassin@gmail.co>
2021-10-16 13:27:20 +01:00
Yassin Raman
ce7fc35d22 Deployment: made storm ingress a separate app (#303)
* made storm ingress a separate app

* increase version

Co-authored-by: Yassin Raman <yassin@gmail.co>
2021-09-02 13:34:24 +01:00
Yassin Raman
5e1a9ab24b Deployment: values.yaml - ability to select which apps to deploy (#272)
* version

* Deployment: more dynamic when selecting which apps to deploy (#271)

* added dependency install script, and clean up

* kafka ui instructions

* added ps scripts for install

* update to support folder change and powershell scripts

* removed unneccessary file

* small fix

* added cm and secret to cleanup script

* base files

* base deployment file

* added svc and ingress specs

* typo and adding values pt1

* pt2 added required values

* improvement, fullname reference to siembol

* bug fix

* name change

* added api endpoint

* added flag to deploy response or not

* changed rolling update strategy and limit /api route

* changed rolling update strategy and limit /api route

* replicas set to 1

* increased chart version

* moved quickstart files to make binary as clean as possible

* moved quickstart files to make binary as clean as possible

* making storm ingress optional, irrespective of UI

* improvements

* small improvements

* small improvements

* bug fix

* bug fix

* test

* test

* fix

* fix

* change port so that response works

* change port so that response works

* change port so that storm ui work

* change back

* change back

* change back

* improvement

* fix version

* removed confusing if statements

* added flexibilty - ability to choose which service to enable

* added 'enable' option to configmap

* more flexibility

* fix

* optional SA

* option to deploy all or one app

* option to deploy all or one app

* option to deploy all or one app

* version

* version

Co-authored-by: Yassin Raman <yassin@gmail.co>
Co-authored-by: yasram1 <yasram1@github.com>

* removed 'all' option

Co-authored-by: Yassin Raman <yassin@gmail.co>
Co-authored-by: yasram1 <yasram1@github.com>
2021-08-10 11:49:12 +01:00
Yassin Raman
33dc805570 Deployment: refactoring (#241)
Co-authored-by: Yassin Raman <yassin@gmail.co>
Co-authored-by: yasram1 <yasram1@github.com>
2021-07-28 17:31:18 +01:00
Yassin Raman
1cf1dd76f9 Deployment: added siembol response (#237)
* added dependency install script, and clean up

* kafka ui instructions

* added ps scripts for install

* update to support folder change and powershell scripts

* removed unneccessary file

* small fix

* added cm and secret to cleanup script

* base files

* base deployment file

* added svc and ingress specs

* typo and adding values pt1

* pt2 added required values

* improvement, fullname reference to siembol

* bug fix

* name change

* added api endpoint

* added flag to deploy response or not

* changed rolling update strategy and limit /api route

* changed rolling update strategy and limit /api route

* replicas set to 1

* increased chart version

Co-authored-by: Yassin Raman <yassin@gmail.co>
Co-authored-by: yasram1 <yasram1@github.com>
2021-07-23 14:26:16 +01:00
Yassin Raman
d586e05308 Deployment: Topology manager cronjob (#236)
Co-authored-by: yasram1 <yasram1@github.com>
2021-07-22 13:46:04 +01:00
Yassin Raman
132f07d873 deployment: cleanup script improvement (#234)
* added dependency install script, and clean up

* kafka ui instructions

* added ps scripts for install

* update to support folder change and powershell scripts

* removed unneccessary file

* small fix

* added cm and secret to cleanup script

* change to reflect cleanup script

Co-authored-by: Yassin Raman <yassin@gmail.co>
Co-authored-by: yasram1 <yasram1@github.com>
2021-07-21 12:27:52 +01:00
Yassin Raman
10394f15fb Ingress fix (#229)
* added dependency install script, and clean up

* kafka ui instructions

* added ps scripts for install

* update to support folder change and powershell scripts

* removed unneccessary file

* small fix

* fix for tls secret for storm ui and added ns

* fix for tls secret for storm ui and added ns

Co-authored-by: Yassin Raman <yassin@gmail.co>
Co-authored-by: yasram1 <yasram1@github.com>
2021-07-19 11:11:34 +01:00
Yassin Raman
e8a0e2bca7 deployment: adding PS scripts (#227)
* added dependency install script, and clean up

* kafka ui instructions

* added ps scripts for install

* update to support folder change and powershell scripts

* removed unneccessary file

* small fix

* minor fixes in scripts

Co-authored-by: Yassin Raman <yassin@gmail.co>
Co-authored-by: Oliver Fletcher <ollie@oliverfletcher.com>
Co-authored-by: Marian Novotny <Marian.Novotny@gresearch.co.uk>
2021-07-16 18:10:27 +01:00
Yassin Raman
c9510dad93 Kafka UI (#223)
* added dependency install script, and clean up

* kafka ui instructions

* adding kafka helpers to quickstart

* adding kafka helpers to quickstart

* removed file, not needed

* improvement

Co-authored-by: Yassin Raman <yassin@gmail.co>
2021-07-15 17:28:56 +01:00
Yassin Raman
4a5a3cd83c docs: adding quickstart (#220)
* added dependency install script, and clean up

* small fixes

* small fix

Co-authored-by: Yassin Raman <yassin@gmail.co>
Co-authored-by: stackedsax <alex.scammon@gresearch.co.uk>
2021-07-14 18:22:06 +01:00
Yassin Raman
f3de70a3bc Helm k8s (#215)
* minikube helm k8s deployment

* removed unneccesary file/test file

* added env var

* fix for repo name

* image policy set to always, and removed unnecessary code

* image policy set to always, and removed unnecessary code

* removed file

* fix to match application.properties

* removed overwrite with empty app.properties

* mount path changed

* clean up

* clean up

* service account is needed so that topology manager has permissions to create jobs

* removed zookeeper job and added init of nodes to install script

* refactoring

Co-authored-by: Yassin Raman <yassin@gmail.co>
Co-authored-by: Oliver Fletcher <ollie@oliverfletcher.com>
Co-authored-by: stackedsax <alex.scammon@gresearch.co.uk>
Co-authored-by: Alexander Scammon <stackedsax@users.noreply.github.com>
2021-07-14 13:47:52 +01:00