clickhouse | NodeJS client for ClickHouse | HTTP library

by TimonKK JavaScript Version: Current License: Apache-2.0

X-Ray Key Features Code Snippets Community Discussions(10)Vulnerabilities Install Support

kandi X-RAY | clickhouse Summary

clickhouse is a JavaScript library typically used in Networking, HTTP applications. clickhouse has no bugs, it has a Permissive License and it has low support. However clickhouse has 15 vulnerabilities. You can install using 'npm i clickhouse-post' or download it from GitHub, npm.

NodeJS client for ClickHouse. Send query over HTTP interface.

Support

Quality

Security

License

Reuse

Support

clickhouse has a low active ecosystem.

It has 209 star(s) with 89 fork(s). There are 11 watchers for this library.

It had no major release in the last 6 months.

There are 32 open issues and 55 have been closed. On average issues are closed in 122 days. There are 10 open pull requests and 0 closed requests.

It has a neutral sentiment in the developer community.

The latest version of clickhouse is current.

Quality

clickhouse has 0 bugs and 0 code smells.

Security

clickhouse has 15 vulnerability issues reported (3 critical, 6 high, 6 medium, 0 low).

clickhouse code analysis shows 0 unresolved vulnerabilities.

There are 0 security hotspots that need review.

License

clickhouse is licensed under the Apache-2.0 License. This license is Permissive.

Permissive licenses have the least restrictions, and you can use them in most projects.

Reuse

clickhouse releases are not available. You will need to build from source code and install.

Deployable package is available in npm.

Installation instructions are not available. Examples and code snippets are available.

Top functions reviewed by kandi - BETA

kandi's functional review helps you automatically verify the functionalities of the libraries and avoid rework.
Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of clickhouse

Get all kandi verified functions for this library.

clickhouse Key Features

No Key Features are available at this moment for clickhouse.

clickhouse Examples and Code Snippets

No Code Snippets are available at this moment for clickhouse.

Community Discussions

Trending Discussions on clickhouse

How to move older clickhouse partitions to S3 disk

Vendor metrics from Clikhouse to grafana

logstash-output-clickhouse throws error while installing plugin

java spark - Why is my Dataset error?

Dont aggregate entire column if selecting distinct pk's with order by pk and limit

Get Inner Table Name of Materialized Views with Clickhouse

Is this the correct way to use it via grafana?

Clickhouse how to filter string by control characters

Error running cargo build with clickhouse dependency

How to concat INTs with separator in ClickHouse

QUESTION

How to move older clickhouse partitions to S3 disk

Asked 2021-Jun-12 at 15:18

I'm currently starting to work with clickhouse for our in-house analytics system, but it looks like there are no automated ways to configure policies for data retention. The only thing I saw was the ALTER ... MOVE PARTITION (https://clickhouse.tech/docs/en/sql-reference/statements/alter/partition/#alter_move-partition), but it looks like the process has to be manual / implemented in our application layer.

My objective is to move data older than 3 months directly to an S3 cluster for archival and price reasons, while still being able to query it.

Is there any native way to do so directly in clickhouse with storage policies?

Thanks in advance.

...

ANSWER

Answered 2021-Jun-12 at 15:18

This answer was based out of @Denny Crane's comment: https://altinity.com/blog/clickhouse-and-s3-compatible-object-storage, where I did put comments where there were not enough explanations, and keeping it in the event that the link dies.

1. Add your S3 disk to a new configuration file (Let's say /etc/clickhouse-server/config.d/storage.xml:

Source https://stackoverflow.com/questions/67587483

QUESTION

Vendor metrics from Clikhouse to grafana

Asked 2021-Jun-04 at 16:29

Good day everyone, I ran into such a problem while adding monitors to grafana with metrics on the status of requests from our suppliers to the clickhouse database. I need suppliers whose status = 200 or! = 200 to return to the schedule.

We want that when the condition - count (CASE WHEN StatusRes! = '200' THEN 1 END) is fulfilled, we will display the data of suppliers that have a request status not 200, but if - count (CASE WHEN StatusRes 0 = '200' THEN 1 END ) only suppliers with request status 200.

But in fact, the request is processed incorrectly (all statuses are returned both 200 and 500) and I do not know why.

Here is the query itself, which we will use in grafana to take metrics:

...

ANSWER

Answered 2021-Jun-04 at 16:29

count( col ) -- counts number of ROWS where col is not null. It's not about CH, it's ANSI SQL.

You actually should use countIf

Source https://stackoverflow.com/questions/67822217

QUESTION

logstash-output-clickhouse throws error while installing plugin

Asked 2021-Jun-01 at 13:45

Validating logstash-output-clickhouse-0.1.0.gem
Installing logstash-output-clickhouse
Plugin version conflict, aborting
ERROR: Installation Aborted, message: Bundler could not find compatible versions for gem "logstash-mixin-http_client":
  In snapshot (Gemfile.lock):
    logstash-mixin-http_client (= 6.0.1)

  In Gemfile:
    logstash-filter-http java was resolved to 1.0.2, which depends on
      logstash-mixin-http_client (>= 5.0.0, < 9.0.0) java

    logstash-input-http_poller java was resolved to 4.0.5, which depends on
      logstash-mixin-http_client (>= 6.0.0, < 7.0.0) java

    logstash-output-clickhouse (= 0.1.0) java was resolved to 0.1.0, which depends on
      logstash-mixin-http_client (>= 2.2.1, < 6.0.0) java

    logstash-output-http java was resolved to 5.2.4, which depends on
      logstash-mixin-http_client (>= 6.0.0, < 8.0.0) java

Running `bundle update` will rebuild your snapshot from scratch, using only
the gems in your Gemfile, which may resolve the conflict.

...

ANSWER

Answered 2021-Jun-01 at 13:45

You will need to install an older version of logstash. Currently your clickhouse plugin requires the http_client mixin to be less than 6.0.0, whilst the http output and http filter require the http_client mixin to be greater than or equal to 6.0.0.

Source https://stackoverflow.com/questions/67789961

QUESTION

java spark - Why is my Dataset error?

Asked 2021-May-31 at 07:46

I'm using java to make a jar file to run in spark using spark-submit

and in my java project i imported clickhouse-jbdc.jar (Cause my JDBC will be clickhouse based)

and also spark-core, spark-hive, spark-sql (2.12-3.1.1) jar

but when I type

...

ANSWER

Answered 2021-May-31 at 07:46

I see certain issues with the code itself.

Can you fix this and check ?

While reading:

Source https://stackoverflow.com/questions/67767761

QUESTION

Dont aggregate entire column if selecting distinct pk's with order by pk and limit

Asked 2021-May-30 at 21:53

I have a clickhouse table events containing 50M rows for a year period (duplicates possible)

...

ANSWER

Answered 2021-May-30 at 21:53

CREATE TABLE events
(
    `event` LowCardinality(String),
    `event_time` DateTime,
    `uid` String
)
ENGINE = ReplacingMergeTree
PARTITION BY toYYYYMM(event_time)
ORDER BY (event, event_time, uid);


INSERT INTO events SELECT
    'ev',
    toDateTime('2020-01-01 00:00:00') + toIntervalSecond(number),
    randomPrintableASCII(5)
FROM numbers(30000000);
    
    
SELECT *
FROM
(
    SELECT event_time
    FROM events
    WHERE (event = 'ev') AND ((event_time >= '2020-01-01 00:00:00') AND (event_time <= '2021-01-01 00:00:00'))
    ORDER BY
        event DESC,
        event_time DESC
    LIMIT 1 BY event_time
)
LIMIT 500
.....

Elapsed: 0.008 sec. Processed 1.07 million rows

Source https://stackoverflow.com/questions/67753269

QUESTION

Get Inner Table Name of Materialized Views with Clickhouse

Asked 2021-May-26 at 16:45

I have several Tables and materialized views which haven't been created with To [db] statement and have an inner tables with these names:

...

ANSWER

Answered 2021-May-26 at 16:45

To resolve uuid name use this query:

Source https://stackoverflow.com/questions/67703961

QUESTION

Is this the correct way to use it via grafana?

Asked 2021-May-26 at 06:30

ClickHouse:

...

ANSWER

Answered 2021-May-23 at 16:29

Grafana expects your SQL will return time series data format for most of the visualization.

One column DateTime\Date\DateTime64 or UInt32 which describe timestamp
One or several columns with Numeric types (Float, Int*, UInt*) with metric values (column name will use as time series name)
optional one column with String which can describe multiple time series name

or advanced "time series" format, when first column will timestamp, and the second column will Array(tuple(String, Numeric)) where String column will time series name (usually it used with

so, select table metrics.shell as table and EventDateTime as field in drop-down in query editor your query could be changed to

Source https://stackoverflow.com/questions/67584369

QUESTION

Clickhouse how to filter string by control characters

Asked 2021-May-19 at 12:57

In Clickhouse, how do I filter strings by control characters e.g. tab \t, newline \n

SQL Server has CHAR function to express control chars. Separately, Hive has rlike for regex expressions that can match control chars. How do you do something similar in CH?

I do not know how to escape the tab character properly in the following commands. No matter the number of backslash 1, 2 or 4:

...

ANSWER

Answered 2021-May-19 at 12:57

You see the output in TSV format, so \t converted twice \t -> 0x9 -> \t

Source https://stackoverflow.com/questions/67598781

QUESTION

Error running cargo build with clickhouse dependency

Asked 2021-May-13 at 20:49

I added this to my cargo toml file, following the instructions here

...

ANSWER

Answered 2021-May-13 at 20:49

I am getting this error on Linux as well. This appears to be an issue in the clickhouse crate, but it can be fixed in your Cargo.toml. #[tokio::test] refers to a macro which requires both the "rt" and "macros" features, but the Cargo.toml file in the clickhouse crate only includes the "rt" feature. In order to add this feature so that the crate will compile, you can add a line to your Cargo.toml for tokio that enables that feature:

Source https://stackoverflow.com/questions/67525663

QUESTION

How to concat INTs with separator in ClickHouse

Asked 2021-May-07 at 16:20

How is it possible to concat INT lines in CLickHouse with separator ',' ? For example I make a request

...

ANSWER

Answered 2021-May-07 at 16:20

Try this one:

Source https://stackoverflow.com/questions/67438382

Community Discussions, Code Snippets contain sources that include Stack Exchange Network

Vulnerabilities

CVE-2019-15024 MEDIUM

In all versions of ClickHouse before 19.14.3, an attacker having write access to ZooKeeper and who is able to run a custom server available from the network where ClickHouse runs, can create a custom-built malicious server that will act as a ClickHouse replica and register it in ZooKeeper. When another replica will fetch data part from the malicious replica, it can force clickhouse-server to write to arbitrary path on filesystem.

https://clickhouse.yandex/docs/en/security_changelog/

CVE-2019-16535 CRITICAL

In all versions of ClickHouse before 19.14, an OOB read, OOB write and integer underflow in decompression algorithms can be used to achieve RCE or DoS via native protocol.

https://clickhouse.yandex/docs/en/security_changelog/

CVE-2019-18657 MEDIUM

ClickHouse before 19.13.5.44 allows HTTP header injection via the url table function.

https://github.com/ClickHouse/ClickHouse/pull/6466

https://github.com/ClickHouse/ClickHouse/blob/master/CHANGELOG.md

https://github.com/ClickHouse/ClickHouse/pull/7526/files

CVE-2018-14671 CRITICAL

In ClickHouse before 18.10.3, unixODBC allowed loading arbitrary shared objects from the file system which led to a Remote Code Execution vulnerability.

https://clickhouse.yandex/docs/en/security_changelog/

CVE-2018-14668 HIGH

In ClickHouse before 1.1.54388, "remote" table function allowed arbitrary symbols in "user", "password" and "default_database" fields which led to Cross Protocol Request Forgery Attacks.

https://clickhouse.yandex/docs/en/security_changelog/

CVE-2018-14670 CRITICAL

Incorrect configuration in deb package in ClickHouse before 1.1.54131 could lead to unauthorized use of the database.

https://clickhouse.yandex/docs/en/security_changelog/

CVE-2018-14669 HIGH

ClickHouse MySQL client before versions 1.1.54390 had "LOAD DATA LOCAL INFILE" functionality enabled that allowed a malicious MySQL database read arbitrary files from the connected ClickHouse server.

https://clickhouse.yandex/docs/en/security_changelog/

CVE-2018-14672 MEDIUM

In ClickHouse before 18.12.13, functions for loading CatBoost models allowed path traversal and reading arbitrary files through error messages.

https://clickhouse.yandex/docs/en/security_changelog/

Install clickhouse

You can install using 'npm i clickhouse-post' or download it from GitHub, npm.

Support

For any new features, suggestions and bugs create an issue on GitHub. If you have any questions check and ask questions on community page Stack Overflow .

Find more information at: