FlinkSQL | 仿照阿里blink使用sql开发flink的实时程序

 by   ambition119 Java Version: Current License: Apache-2.0

kandi X-RAY | FlinkSQL Summary

kandi X-RAY | FlinkSQL Summary

FlinkSQL is a Java library. FlinkSQL has no bugs, it has no vulnerabilities, it has build file available, it has a Permissive License and it has low support. You can download it from GitHub.

FlinkSQL
Support
    Quality
      Security
        License
          Reuse

            kandi-support Support

              FlinkSQL has a low active ecosystem.
              It has 181 star(s) with 146 fork(s). There are 13 watchers for this library.
              OutlinedDot
              It had no major release in the last 6 months.
              There are 1 open issues and 0 have been closed. On average issues are closed in 90 days. There are 5 open pull requests and 0 closed requests.
              It has a neutral sentiment in the developer community.
              The latest version of FlinkSQL is current.

            kandi-Quality Quality

              FlinkSQL has 0 bugs and 62 code smells.

            kandi-Security Security

              FlinkSQL has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.
              FlinkSQL code analysis shows 0 unresolved vulnerabilities.
              There are 0 security hotspots that need review.

            kandi-License License

              FlinkSQL is licensed under the Apache-2.0 License. This license is Permissive.
              Permissive licenses have the least restrictions, and you can use them in most projects.

            kandi-Reuse Reuse

              FlinkSQL releases are not available. You will need to build from source code and install.
              Build file is available. You can build the component from source.
              Installation instructions are not available. Examples and code snippets are available.
              FlinkSQL saves you 616 person hours of effort in developing the same functionality from scratch.
              It has 1434 lines of code, 59 functions and 29 files.
              It has medium code complexity. Code complexity directly impacts maintainability of the code.

            Top functions reviewed by kandi - BETA

            kandi has reviewed FlinkSQL and discovered the below as its top functions. This is intended to give you an instant insight into FlinkSQL implemented functionality, and help decide if they suit your requirements.
            • Verify sql
            • Checks whether the SQL contains the given regular expression
            • Check if the given character is Chinese
            • Split a semicolon
            • Get a JobGraph
            • Get watermark environment info
            • Gets the job name
            • Parse insert
            • Parse sql
            • Get SQL parser from input stream
            • Returns stream - local environment info
            • Gets the SQLS
            • Sets up the yarn client
            • Replies the YARN configuration
            • Splits a string into two strings ignoring quotes
            • Checks if application is running
            • Creates a ClusterDescriptor with log configuration
            • Parses the given view SqlCreateView
            • Get the table source from a SQL CreateTable
            • Creates new cluster cluster descriptor
            • Parse SQL create functions
            • Splits the given string using the given delimiter
            • Parse the SQL table
            • Shuts down the yarn client
            Get all kandi verified functions for this library.

            FlinkSQL Key Features

            No Key Features are available at this moment for FlinkSQL.

            FlinkSQL Examples and Code Snippets

            No Code Snippets are available at this moment for FlinkSQL.

            Community Discussions

            Trending Discussions on FlinkSQL

            QUESTION

            Moving data between paradigms in Flink
            Asked 2021-Apr-28 at 12:38

            I have some batch processed data in a relational database that I want to push to a message bus using Flink. As Flink supports both Batch and Streaming paradigms it appears to be a good fit. Having said that, I cannot tell if this task would belong to the StreamingJob or the BatchJob and how to connect the two. Is this task better suited to a FlinkSQL environment?

            Is this possible? what do I need to be aware of?

            ...

            ANSWER

            Answered 2021-Apr-28 at 12:38

            It really depends on what You actually want to do, the size of the data and so on. If You just want to read data from a database and write it to say Kafka, You may want to take a look at flink here, since it has the sources for JDBC already implemented.

            You could technically use DataStream API, but it doesn't have JDBC source AFAIK, so it would be harder, since You would need to implement that Yourself.

            Generally, Flink has two main APIs for handling data, DataSet and DataStream and You can't convert between them. DataSet is more or less what what DataSet in Spark is, so basically Flink knows that this is bounded, partitioned data, so You can for example sort that or do other transformations that exploit the fact that the data has some defined size.

            DataStream is a Streaming API, which in general allows You to handle technically infinite streams of data, You may use DataStream to create finite stream, by for example reading from file. But, in general when handling data with DataStream You will not be able to directly sort it or do some things You might be able to do when dealing with DataSet, even if the data held in stream is finite.

            So, as for the moving data between paradigms, You can write the application that processes DataStream and You will be able to work both with infinite stream of events from Kafka and with 10 records from CSV file, Flink will be able to do some optimizations based on whether the data is finite or not (introduced in 1.12 IIRC). But You won't be able to read a file into DataSet sort partitions and then map it to DataStream, without doing some additional work, like for example storing the data in file and reading it again as DataStream.

            Source https://stackoverflow.com/questions/67298921

            Community Discussions, Code Snippets contain sources that include Stack Exchange Network

            Vulnerabilities

            No vulnerabilities reported

            Install FlinkSQL

            You can download it from GitHub.
            You can use FlinkSQL like any standard Java library. Please include the the jar files in your classpath. You can also use any IDE and you can run and debug the FlinkSQL component as you would do with any other Java program. Best practice is to use a build tool that supports dependency management such as Maven or Gradle. For Maven installation, please refer maven.apache.org. For Gradle installation, please refer gradle.org .

            Support

            For any new features, suggestions and bugs create an issue on GitHub. If you have any questions check and ask questions on community page Stack Overflow .
            Find more information at:

            Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items

            Find more libraries
            CLONE
          • HTTPS

            https://github.com/ambition119/FlinkSQL.git

          • CLI

            gh repo clone ambition119/FlinkSQL

          • sshUrl

            git@github.com:ambition119/FlinkSQL.git

          • Stay Updated

            Subscribe to our newsletter for trending solutions and developer bootcamps

            Agree to Sign up and Terms & Conditions

            Share this Page

            share link

            Consider Popular Java Libraries

            CS-Notes

            by CyC2018

            JavaGuide

            by Snailclimb

            LeetCodeAnimation

            by MisterBooo

            spring-boot

            by spring-projects

            Try Top Libraries by ambition119

            profilePlatform

            by ambition119Java

            spark-course

            by ambition119Scala

            springPhoenixHbase

            by ambition119Java

            QueryParse

            by ambition119Java