nifi-influxdb-bundle | InfluxDB Processors For Apache NiFi | User Interface library

 by   influxdata Java Version: v1.25.0-SNAPSHOT License: Apache-2.0

kandi X-RAY | nifi-influxdb-bundle Summary

kandi X-RAY | nifi-influxdb-bundle Summary

nifi-influxdb-bundle is a Java library typically used in User Interface applications. nifi-influxdb-bundle has no bugs, it has no vulnerabilities, it has build file available, it has a Permissive License and it has low support. You can download it from GitHub.

NiFi in current version has already built-in data processor org.apache.nifi.processors.influxdb.PutInfluxDB (doc) that accepts flow-files in InfluxDB’s Line Protocol format and stores the data into InfluxDB. This processor is useful only for processing data that are generated by InfluxDB Telegraf or other applications that provides data directly in InfluxDB’s Line Protocol. It is not possible to use it to store structured data (json, avro, csv ...). This motivates us to implement new processor org.influxdata.nifi.processors.PutInfluxDatabaseRecord that is based on NiFi Record Design. This processor allows to write any NiFi Record structured data into InfluxDB by PutInfluxDatabaseRecord. The processor works similarly as others NiFi built-in NiFi Record based Put*Record processors (PutDatabaseRecord, PutHBase,PutMongoRecord, ...).

            kandi-support Support

              nifi-influxdb-bundle has a low active ecosystem.
              It has 30 star(s) with 9 fork(s). There are 42 watchers for this library.
              There were 2 major release(s) in the last 12 months.
              There are 0 open issues and 33 have been closed. On average issues are closed in 39 days. There are 8 open pull requests and 0 closed requests.
              It has a neutral sentiment in the developer community.
              The latest version of nifi-influxdb-bundle is v1.25.0-SNAPSHOT

            kandi-Quality Quality

              nifi-influxdb-bundle has no bugs reported.

            kandi-Security Security

              nifi-influxdb-bundle has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.

            kandi-License License

              nifi-influxdb-bundle is licensed under the Apache-2.0 License. This license is Permissive.
              Permissive licenses have the least restrictions, and you can use them in most projects.

            kandi-Reuse Reuse

              nifi-influxdb-bundle releases are available to install and integrate.
              Build file is available. You can build the component from source.
              Installation instructions, examples and code snippets are available.

            Top functions reviewed by kandi - BETA

            kandi has reviewed nifi-influxdb-bundle and discovered the below as its top functions. This is intended to give you an instant insight into nifi-influxdb-bundle implemented functionality, and help decide if they suit your requirements.
            • Run trigger query params
            • Executes the given query
            • Returns the query string
            • Populate the error attributes
            • Post trigger
            • Returns the mapper options
            • Cluster the complex field behaviour
            • Gets a list of comma separated values
            • Check if the file has exceeded the limit
            • Gets the influxDB client
            • Gets the enum value
            • Configure influxDB client
            • Check if the file has exceeded limit
            • Gets the influxDB instance
            • Make a connection to influxDB
            • Creates a new influxDB connection
            • Sets the write precision of a timestamp
            • On InfluxDB Query processor
            • Serialize a record
            • Writes a flow file to an influx bucket
            • Initialize dialect
            • Writes a flow file to the influx database
            • Replies the property descriptors
            • Create query processor
            • On trigger
            • Closes the influxDB connection
            Get all kandi verified functions for this library.

            nifi-influxdb-bundle Key Features

            No Key Features are available at this moment for nifi-influxdb-bundle.

            nifi-influxdb-bundle Examples and Code Snippets

            Store complex JSON structure to InfluxDB
            Javadot img1Lines of Code : 53dot img1License : Permissive (Apache-2.0)
            copy iconCopy
              "type": "record",
              "name": "twitter_schema",
              "namespace": "io.bonitoo.nifi",
              "doc:" : "AVRO scheme for Tweets",
              "fields": [
                { "name": "id",   "type": "long" },
                { "name": "text", "type": "string" },
                { "name": "lang", "type": "st  
            Processing metrics in NiFI
            Javadot img2Lines of Code : 21dot img2License : Permissive (Apache-2.0)
            copy iconCopy
            show measurements
            name: measurements
            select * from docker_container_status 
            name: docker_container_status
            time                c  
            Expose data from InfluxDB 2.0 on the particular HTTP endpoint
            Javadot img3Lines of Code : 13dot img3License : Permissive (Apache-2.0)
            copy iconCopy
            from(bucket: "my-bucket")
              |> range(start: 0)
              |> filter(fn: (r) => r._measurement == "tweets")
              |> drop(columns: ["keyword", "lang", "user_verified"])
              |> pivot(rowKey:["_time"], columnKey: ["_field"], valueColumn: "_value")

            Community Discussions

            Trending Discussions on nifi-influxdb-bundle


            How to convert InfluxDB Line Protocol to Parquet in NiFi
            Asked 2019-Dec-04 at 14:04

            I have influxDB Line Protocol records coming in to NiFi via a ConsumeKafka processor, and then merged into flowfiles containing 10,000 records. Now I'd like to get them converted to Parquet and stored in HDFS with an end goal of building Impala tables for the end user. Is there a way to convert Line Protocol to something consumable by the PutParquet processor, or another way to convert to Parquet files?

            I did find a custom influxlineprotocolreader processor, however there's very little information and no examples (that I've found) on how to use this processor so I'm not sure if it fits this use case.

            Alternatively, I can use Spark to do the conversion and write Parquet files, but I was hoping to do everything in NiFi if at all possible, especially since I haven't found many resources on doing such a conversion in Spark either (I'm new to both Spark and NiFi).



            Answered 2019-Dec-04 at 14:04

            There is nothing out of the box in NiFi that understands InfluxDB line protocol. You would have to implement something that converted that to a known format like JSON, Avro, etc, and then you could go to Parquet, or if you implemented a InfluxDbRecordReader then you could use ConvertRecord with that and a parquet writer to go directly between the two.


            Community Discussions, Code Snippets contain sources that include Stack Exchange Network


            No vulnerabilities reported

            Install nifi-influxdb-bundle

            To install the InfluxDB Processors you will need to copy the appropriate nar file into the lib directory of your NiFi installation ($NIFI_HOME/lib) and restart NiFi.


            If you would like to contribute code you can do through GitHub by forking the repository and sending a pull request into the master branch.
            Find more information at:

            Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items

            Find more libraries
          • HTTPS


          • CLI

            gh repo clone influxdata/nifi-influxdb-bundle

          • sshUrl


          • Stay Updated

            Subscribe to our newsletter for trending solutions and developer bootcamps

            Agree to Sign up and Terms & Conditions

            Share this Page

            share link