fluent-plugin-elasticsearch | Send your logs to Elasticsearch ( and search | Plugin library

I've got a fluentd.conf file and I'm trying to use (copy) it in my minikube cluster (works fine in a docker container). The steps are the following:

1. Ill build (in my minikube docker-env) the docker image with the following commands Dockerfile:

Using:

• Elasticsearch 7.5.1.
• Fluentd 1.11.2
• Fluent-plugin-elasticsearch 4.1.3
• Springboot 2.3.3

I have a Springboot artifact with Logback configured with an appender that, in addition to the app STDOUT, sends logs to Fluentd:

I have a sidecar container configured to collect logs for my app container.

I first tested my fleunt.conf using the following configuration:

Using:

• fluentd 1.11.2
• fluent-plugin-elasticsearch 4.1.3
• elasticsearch 7.5.1
• springboot 2.3.3

Running in Openshift (Kubernetes v1.17.1+20ba474).

Both Fluentd and Elasticsearch are running in different pods.

Fluentd configuration file:

I'm trying to connect fluentd with elasticsearch and I'm getting this error when I start the td-agent service.

td-agent.log:

Could not communicate to Elasticsearch, resetting connection and trying again. Connection refused - connect(2) for 127.0.0.1:9092 (Errno::ECONNREFUSED)

td-agent.conf

EDIT: I've added new information per my comment in response to efrat-levitan's suggestion. The log output listed is slightly different as I upgraded my Elasticsearch version to 7.6.0 as suggested by the original comment. To help debugging, I also didn't start Elasticsearch right away. The effect of this can be seen in the ECONNREFUSED messages in the log. I called out the log file changes in the summary below. Most of the rest of the message text (i.e., not log snippets) remains the same as before.

I've been working on getting an ARM version (for a Raspberry Pi 3 & 4) of fluentd with the fluent-plugin-elasticsearch plugin running in docker. I haven't been able to find an appropriate docker image so I've built one on my own (if anyone knows where I can find one I'd appreciate it). I started with the fluentd-docker-image repo (doesn't include Elasticsearch plugins) and modified it as I thought necessary using the fluentd-kubernetes-daemonset repo (does include the Elasticsearch plugins). The good news is that it starts up just fine on a Raspberry Pi. The bad news is that it appears like it doesn't even try to connect to ElasticSearch (external to the Raspberry Pi network. The log file looks like this:

I've installed fluentd in my AKS cluster using the following command helm install fluentd bitnami-azure/fluentd --namespace mynamespace --set forwarder.configMap=fluentd-aksconfig.

Below is my configmap.yaml