elastic-stack | Elastic Stack Docker & Sample Go App | Continuous Deployment library

I am trying to create a custom track from an existing Elasticsearch cluster using the instructions in the Rally documentation page.

I am running Rally as a Docker Image. I am running elasticsearch:7.12.0 as well as a docker image in the same host. The docker container is running and host can be accessed by using basic auth.

I have deployed ECK (using helm) on my k8s cluster and i am attempting to install elasticsearch following the docs. https://www.elastic.co/guide/en/cloud-on-k8s/current/k8s-deploy-elasticsearch.html

I have externally exposed service/elasticsearch-prod-es-http so that i can connect to it from outside of my k8s cluster. However as you can see when i try to connect to it either from curl or the browser i receive an error "502 Bad Gateway" error.

I was reading the elasticsearch documentation on Elastic Stack on Docker with TLS.

I came across this line in the healthcheck block:

I stumbled across lost log messages in our environment.

We use an ELK Stack and logback with logstash-logback-encoder in our Java applications. To do structured queries we use LogstashMarkers to append structured arguments to the logs. In the case of the lost log messages it is a string, which contains a JSON.

Some of the log messages are lost completly. Not only the markers were not saved but the complete log message. They are not visible in Kibana. There are no errors in the logs of our application or the logstash server.

I could create an example repository with minimal code and published it at GitHub: https://github.com/seism0saurus/logging-issue

To run it, you need a logstash server and netcat. The logger in that project is configured to use a console appender, so we have a reference, what messages where really logged. Additionally there is one appender for a netcat server on localhost:8081 and one appender for the logstash server. Both have the same config. Only the address is different. So I'm quite sure that the message is send to the logstash server, if it is send to netcat.

Here is the code of the main class:

For the past week I am trying to connect a Winlogbeat(Which is on my host machine) To an elasticsearch Cluster that I set up on an Ubuntu VM using dockers.

Following this tutorial. (In the tutorial they don't explain how to connect a Beat)

My problem is with the SSL configuration (Of the Winlogbeat) I just can't get it right for some reason.

This is the error I get on the windows machine after running the setup command (.\winlogbeat.exe setup -e) -

I created elasticsearch cluster flowing by the article: Running the Elastic Stack on Docker

After the elasticsearch runs, I need to create snapshot and restore to backup my data. I modified my elastic-docker-tls.yml file:

Using the docker-compose.yml file by here (online changed version 7.9.1. to 7.9.2)

as seen below full content of docker-compose.yml;

I'm trying to deploy elk stack in kubernetes cluster with helm, using this chart. When I launch

helm install elk-stack stable/elastic-stack

I receive the following message:

I would like to deploy elastic-stack into Kubernetes cluster. I git clone the chart, use default settings. But, I got errors.

1. git clone https://github.com/helm/charts

2. Create namespace

   kubectl create namespace elastic-stack

3. At $HOME/charts

$ helm install elastic-stack stable/elastic-stack --namespace=elastic-stack

Error: found in Chart.yaml, but missing in charts/ directory: elasticsearch, kibana, filebeat, logstash, fluentd, fluent-bit, fluentd-elasticsearch, nginx-ldapauth-proxy, elasticsearch-curator, elasticsearch-exporter

helm version version.BuildInfo{Version:"v3.3.0-rc.1"