kylin | Apache Kylin - Extreme OLAP Engine for Big Data

by apache Java Version: 4.0.3 License: Apache-2.0

X-Ray Key Features Code Snippets Community Discussions(5)Vulnerabilities Install Support

kandi X-RAY | kylin Summary

kylin is a Java library typically used in Big Data, Spark applications. kylin has no bugs, it has build file available, it has a Permissive License and it has high support. However kylin has 13 vulnerabilities. You can download it from GitHub, Maven.

Apache Kylin

Support

Quality

Security

License

Reuse

Support

kylin has a highly active ecosystem.

It has 3484 star(s) with 1531 fork(s). There are 262 watchers for this library.

It had no major release in the last 12 months.

kylin has no issues reported. There are 85 open pull requests and 0 closed requests.

It has a positive sentiment in the developer community.

The latest version of kylin is 4.0.3

Quality

kylin has 0 bugs and 0 code smells.

Security

kylin has 13 vulnerability issues reported (5 critical, 6 high, 2 medium, 0 low).

kylin code analysis shows 0 unresolved vulnerabilities.

There are 0 security hotspots that need review.

License

kylin is licensed under the Apache-2.0 License. This license is Permissive.

Permissive licenses have the least restrictions, and you can use them in most projects.

Reuse

kylin releases are not available. You will need to build from source code and install.

Deployable package is available in Maven.

Build file is available. You can build the component from source.

Installation instructions are not available. Examples and code snippets are available.

kylin saves you 247062 person hours of effort in developing the same functionality from scratch.

It has 259636 lines of code, 21161 functions and 2657 files.

It has medium code complexity. Code complexity directly impacts maintainability of the code.

Top functions reviewed by kandi - BETA

kandi has reviewed kylin and discovered the below as its top functions. This is intended to give you an instant insight into kylin implemented functionality, and help decide if they suit your requirements.

Merges the fragments and stores the cuboid data .
Perform re - assign without commit .
Run the expected size iterator .
Reassign assignment .
Create a record writer .
Returns a human readable error message for the given OLAP context .
Validate the Cube
Extracts the column meta data from the ResultSetMetaData .
Builds the aggregations .
Extract task details

Get all kandi verified functions for this library.

kylin Key Features

No Key Features are available at this moment for kylin.

kylin Examples and Code Snippets

No Code Snippets are available at this moment for kylin.

Community Discussions

Trending Discussions on kylin

Could not load database driver: KylinEngineSpec

Kubernetes Host and Service Ingress Mapping using TCP

Update to mapred-default.xml not visible in web UI configuration

Copy particular XML document element to Another XML document using shell commands

sed command to find and replace string with special characters to a string in command line

QUESTION

Could not load database driver: KylinEngineSpec

Asked 2021-Oct-29 at 21:21

Just install Apache Superset within Kubernetes. Already have a working Apache Kylin Cluster in the same Kubernetes Cluster. While trying to connect Kylin within Superset i get the following error message:

ERROR: Could not load database driver: KylinEngineSpec

Superset is installed using this repo:

...

ANSWER

Answered 2021-Aug-20 at 10:36

By default superset comes with no KylinEngineSpec driver installed. You need to provide it as an additional requirement at install.

Recommended driver for Apache Kylin is kylinpy ^[reference].

Update

The documentation is a bit misleading. Specifying additional packages in additionalRequiremets does not properly install them. Instead you have to add those to bootstrapScript.
Create a file with overrides (in my case it will be my-values.yaml), add below to this file

Source https://stackoverflow.com/questions/68830218

QUESTION

Kubernetes Host and Service Ingress Mapping using TCP

Asked 2021-Aug-27 at 13:27

While working with Kubernetes for some months now, I found a nice way to use one single existing domain name and expose the cluster-ip through a sub-domain but also most of the microservices through different sub-sub-domains using the ingress controller.

My ingress example code:

...

ANSWER

Answered 2021-Aug-27 at 13:27

Your understanding is good, by default NGINX Ingress Controller only supports HTTP and HTTPs traffic configuration (Layer 7) so probably your SQL server is not working because of this.

Your SQL service is operating using TCP connections so it is does not take into consideration custom domains that you are trying to setup as they are using same IP address anyway .

The solution for your issue is not use custom sub-domain(s) for this service but to setup exposing TCP service in NGINX Ingress Controller. For example you can setup this SQL service to be available on ingress IP on port 1433:

Ingress controller uses the flags --tcp-services-configmap and --udp-services-configmap to point to an existing config map where the key is the external port to use and the value indicates the service to expose using the format: ::[PROXY]:[PROXY]

To setup it you can follow steps provided in official NGINX Ingress documentation but there are also some more detailed instructions on StackOverflow, for example this one.

Source https://stackoverflow.com/questions/68951982

QUESTION

Update to mapred-default.xml not visible in web UI configuration

Asked 2021-Jun-12 at 07:08

I have an Apache Kylin container running in docker. I was getting a Java heap space error in map reduce phase so I tried updating some parameters in Hadoop mapred-default.xml file. After making the changes, I restarted the container but, when I go to Yarn ResourceManager Web UI and then to Configuration:

An xml file is opened, looking like this:

However my new values for the properties that I set inside the mapred-default.xml are not here, it is showing the old values for those properties... Does anyone have any idea why that is happening and what I should do to make it register the new values? I tried restarting the container, but it didn't help...

...

ANSWER

Answered 2021-Jun-12 at 07:08

To override a default value for a property, specify the new value within the tags, inside mapred-site.xml not mapred-default.xml, using the following format:

Source https://stackoverflow.com/questions/67935665

QUESTION

Copy particular XML document element to Another XML document using shell commands

Asked 2020-May-11 at 19:16

I am working on installing Kylin on AWS EMR via shell script . I have an xml file with below content from which I need to copy particular document element to another xml file . This is the manual step I need to automate using shell commands while running the installation shell script.

/etc/hbase/conf/hbase-site.xml

...

ANSWER

Answered 2020-May-11 at 19:16

It is rarely a good idea to try to query XML files with RegEx'es.
Always prefer to use an XML parser!

So you can achieve your given task with xmlstarlet. It is a single program that can get you the data you want in one command from your input ("input.xml"):

Source https://stackoverflow.com/questions/61667880

QUESTION

sed command to find and replace string with special characters to a string in command line

Asked 2020-May-11 at 17:13

I am trying to use sed to find/replace a string with special characters in a .property file.

This is my original line in the file:

...

ANSWER

Answered 2020-May-11 at 17:13

Here:

Source https://stackoverflow.com/questions/61719693

Community Discussions, Code Snippets contain sources that include Stack Exchange Network

Vulnerabilities

CVE-2020-13937 MEDIUM

Apache Kylin 2.0.0, 2.1.0, 2.2.0, 2.3.0, 2.3.1, 2.3.2, 2.4.0, 2.4.1, 2.5.0, 2.5.1, 2.5.2, 2.6.0, 2.6.1, 2.6.2, 2.6.3, 2.6.4, 2.6.5, 2.6.6, 3.0.0-alpha, 3.0.0-alpha2, 3.0.0-beta, 3.0.0, 3.0.1, 3.0.2, 3.1.0, 4.0.0-alpha has one restful api which exposed Kylin's configuration information without any authentication, so it is dangerous because some confidential information entries will be disclosed to everyone.

https://lists.apache.org/thread.html/rc592e0dcee5a2615f1d9522af30ef1822c1f863d5e05e7da9d1e57f4%40%3Cuser.kylin.apache.org%3E

CVE-2020-13925 CRITICAL

Similar to CVE-2020-1956, Kylin has one more restful API which concatenates the API inputs into OS commands and then executes them on the server; while the reported API misses necessary input validation, which causes the hackers to have the possibility to execute OS command remotely. Users of all previous versions after 2.3 should upgrade to 3.1.0.

https://lists.apache.org/thread.html/r250a867961cfd6e0506240a9c7eaee782d84c6ab0091c7c4bc45f3eb%40%3Cuser.kylin.apache.org%3E

https://lists.apache.org/thread.html/r021baf9d8d4ae41e8c8332c167c4fa96c91b5086563d9be55d2d7acf@%3Ccommits.kylin.apache.org%3E

CVE-2020-13926 CRITICAL

Kylin concatenates and executes a Hive SQL in Hive CLI or beeline when building a new segment; some part of the HQL is from system configurations, while the configuration can be overwritten by certain rest api, which makes SQL injection attack is possible. Users of all previous versions after 2.0 should upgrade to 3.1.0.

https://lists.apache.org/thread.html/r63d5663169e866d44ff9250796193337cff7d9cf61cc3839e86163fd%40%3Cuser.kylin.apache.org%3E

https://lists.apache.org/thread.html/r021baf9d8d4ae41e8c8332c167c4fa96c91b5086563d9be55d2d7acf@%3Ccommits.kylin.apache.org%3E

CVE-2020-1956 HIGH

Apache Kylin 2.3.0, and releases up to 2.6.5 and 3.0.1 has some restful apis which will concatenate os command with the user input string, a user is likely to be able to execute any os command without any protection or validation.

https://lists.apache.org/thread.html/r1332ef34cf8e2c0589cf44ad269fb1fb4c06addec6297f0320f5111d%40%3Cuser.kylin.apache.org%3E

https://community.sonarsource.com/t/apache-kylin-3-0-1-command-injection-vulnerability/25706

https://lists.apache.org/thread.html/r250a867961cfd6e0506240a9c7eaee782d84c6ab0091c7c4bc45f3eb@%3Cuser.kylin.apache.org%3E

https://lists.apache.org/thread.html/r250a867961cfd6e0506240a9c7eaee782d84c6ab0091c7c4bc45f3eb@%3Cdev.kylin.apache.org%3E

https://lists.apache.org/thread.html/r61666760d8a4e8764b2d5fe158d8a48b569414480fbfadede574cdc0@%3Ccommits.kylin.apache.org%3E

https://lists.apache.org/thread.html/r250a867961cfd6e0506240a9c7eaee782d84c6ab0091c7c4bc45f3eb@%3Cannounce.apache.org%3E

http://www.openwall.com/lists/oss-security/2020/07/14/1

https://lists.apache.org/thread.html/r021baf9d8d4ae41e8c8332c167c4fa96c91b5086563d9be55d2d7acf@%3Ccommits.kylin.apache.org%3E

CVE-2020-1937 MEDIUM

Kylin has some restful apis which will concatenate SQLs with the user input string, a user is likely to be able to run malicious database queries.

https://lists.apache.org/thread.html/rc574fef23740522f62ab3bbda4f6171be98aa7a25f3f54be143a80a8%40%3Cuser.kylin.apache.org%3E

https://lists.apache.org/thread.html/r61666760d8a4e8764b2d5fe158d8a48b569414480fbfadede574cdc0@%3Ccommits.kylin.apache.org%3E

https://lists.apache.org/thread.html/r021baf9d8d4ae41e8c8332c167c4fa96c91b5086563d9be55d2d7acf@%3Ccommits.kylin.apache.org%3E

Install kylin

You can download it from GitHub, Maven.
You can use kylin like any standard Java library. Please include the the jar files in your classpath. You can also use any IDE and you can run and debug the kylin component as you would do with any other Java program. Best practice is to use a build tool that supports dependency management such as Maven or Gradle. For Maven installation, please refer maven.apache.org. For Gradle installation, please refer gradle.org .

Support

Please refer to [http://kylin.apache.org/docs40/](http://kylin.apache.org/docs40/). Please refer to [LICENSE](https://github.com/apache/kylin/blob/master/LICENSE) file.

Find more information at: