nifi-influxdb-bundle | InfluxDB Processors For Apache NiFi | User Interface library

by influxdata Java Version: v1.25.0-SNAPSHOT License: Apache-2.0

X-Ray Key Features Code Snippets(3)Community Discussions(1)Vulnerabilities Install Support

kandi X-RAY | nifi-influxdb-bundle Summary

nifi-influxdb-bundle is a Java library typically used in User Interface applications. nifi-influxdb-bundle has no bugs, it has no vulnerabilities, it has build file available, it has a Permissive License and it has low support. You can download it from GitHub.

NiFi in current version has already built-in data processor org.apache.nifi.processors.influxdb.PutInfluxDB (doc) that accepts flow-files in InfluxDB’s Line Protocol format and stores the data into InfluxDB. This processor is useful only for processing data that are generated by InfluxDB Telegraf or other applications that provides data directly in InfluxDB’s Line Protocol. It is not possible to use it to store structured data (json, avro, csv ...). This motivates us to implement new processor org.influxdata.nifi.processors.PutInfluxDatabaseRecord that is based on NiFi Record Design. This processor allows to write any NiFi Record structured data into InfluxDB by PutInfluxDatabaseRecord. The processor works similarly as others NiFi built-in NiFi Record based Put*Record processors (PutDatabaseRecord, PutHBase,PutMongoRecord, ...).

Support

Quality

Security

License

Reuse

Support

nifi-influxdb-bundle has a low active ecosystem.

It has 30 star(s) with 9 fork(s). There are 42 watchers for this library.

It had no major release in the last 12 months.

There are 0 open issues and 33 have been closed. On average issues are closed in 39 days. There are 8 open pull requests and 0 closed requests.

It has a neutral sentiment in the developer community.

The latest version of nifi-influxdb-bundle is v1.25.0-SNAPSHOT

Quality

nifi-influxdb-bundle has no bugs reported.

Security

nifi-influxdb-bundle has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.

License

nifi-influxdb-bundle is licensed under the Apache-2.0 License. This license is Permissive.

Permissive licenses have the least restrictions, and you can use them in most projects.

Reuse

nifi-influxdb-bundle releases are available to install and integrate.

Build file is available. You can build the component from source.

Installation instructions, examples and code snippets are available.

Top functions reviewed by kandi - BETA

kandi has reviewed nifi-influxdb-bundle and discovered the below as its top functions. This is intended to give you an instant insight into nifi-influxdb-bundle implemented functionality, and help decide if they suit your requirements.

Run trigger query params
Executes the given query
Returns the query string
Populate the error attributes
Post trigger
Returns the mapper options
Cluster the complex field behaviour
Gets a list of comma separated values
Check if the file has exceeded the limit
Gets the influxDB client
Gets the enum value
Configure influxDB client
Check if the file has exceeded limit
Gets the influxDB instance
Make a connection to influxDB
Creates a new influxDB connection
Sets the write precision of a timestamp
On InfluxDB Query processor
Serialize a record
Writes a flow file to an influx bucket
Initialize dialect
Writes a flow file to the influx database
Replies the property descriptors
Create query processor
On trigger
Closes the influxDB connection

Get all kandi verified functions for this library.

nifi-influxdb-bundle Key Features

No Key Features are available at this moment for nifi-influxdb-bundle.

nifi-influxdb-bundle Examples and Code Snippets

Store complex JSON structure to InfluxDB

Java

Lines of Code : 53

License : Permissive (Apache-2.0)

Copy

{
  "type": "record",
  "name": "twitter_schema",
  "namespace": "io.bonitoo.nifi",
  "doc:" : "AVRO scheme for Tweets",
  "fields": [
    { "name": "id",   "type": "long" },
    { "name": "text", "type": "string" },
    { "name": "lang", "type": "st

Processing metrics in NiFI

Java

Lines of Code : 21

License : Permissive (Apache-2.0)

Copy

show measurements

name: measurements
name
----
docker_container_blkio
docker_container_cpu
docker_container_mem
docker_container_net
docker_container_status

select * from docker_container_status 

name: docker_container_status
time                c

Expose data from InfluxDB 2.0 on the particular HTTP endpoint

Java

Lines of Code : 13

License : Permissive (Apache-2.0)

Copy

from(bucket: "my-bucket")
  |> range(start: 0)
  |> filter(fn: (r) => r._measurement == "tweets")
  |> drop(columns: ["keyword", "lang", "user_verified"])
  |> pivot(rowKey:["_time"], columnKey: ["_field"], valueColumn: "_value")
  |&g

Community Discussions

Trending Discussions on nifi-influxdb-bundle

How to convert InfluxDB Line Protocol to Parquet in NiFi

QUESTION

How to convert InfluxDB Line Protocol to Parquet in NiFi

Asked 2019-Dec-04 at 14:04

I have influxDB Line Protocol records coming in to NiFi via a ConsumeKafka processor, and then merged into flowfiles containing 10,000 records. Now I'd like to get them converted to Parquet and stored in HDFS with an end goal of building Impala tables for the end user. Is there a way to convert Line Protocol to something consumable by the PutParquet processor, or another way to convert to Parquet files?

I did find a custom influxlineprotocolreader processor, however there's very little information and no examples (that I've found) on how to use this processor so I'm not sure if it fits this use case.

Alternatively, I can use Spark to do the conversion and write Parquet files, but I was hoping to do everything in NiFi if at all possible, especially since I haven't found many resources on doing such a conversion in Spark either (I'm new to both Spark and NiFi).

...

ANSWER

Answered 2019-Dec-04 at 14:04

There is nothing out of the box in NiFi that understands InfluxDB line protocol. You would have to implement something that converted that to a known format like JSON, Avro, etc, and then you could go to Parquet, or if you implemented a InfluxDbRecordReader then you could use ConvertRecord with that and a parquet writer to go directly between the two.

Source https://stackoverflow.com/questions/59165898

Community Discussions, Code Snippets contain sources that include Stack Exchange Network

Vulnerabilities

No vulnerabilities reported

Install nifi-influxdb-bundle

To install the InfluxDB Processors you will need to copy the appropriate nar file into the lib directory of your NiFi installation ($NIFI_HOME/lib) and restart NiFi.