clickhouse-jdbc | Java client and JDBC driver for ClickHouse | DB Client library

by ClickHouse Java Version: 0.3.2 License: Apache-2.0

X-Ray Key Features Code Snippets(10)Community Discussions(2)Vulnerabilities Install Support

kandi X-RAY | clickhouse-jdbc Summary

clickhouse-jdbc is a Java library typically used in Utilities, DB Client applications. clickhouse-jdbc has no bugs, it has no vulnerabilities, it has build file available, it has a Permissive License and it has medium support. You can download it from GitHub, Maven.

Java client and JDBC driver for ClickHouse. Java client is async, lightweight, and low-overhead library for ClickHouse; while JDBC driver is built on top of the Java client with more dependencies and extensions for JDBC-compliance. Java 8 or higher is required in order to use Java client(clickhouse-client) and/or JDBC driver(clickhouse-jdbc). In addition, starting from 0.3.2, JDBC driver only works on ClickHouse 20.7 or above, so please consider to either downgrade the driver to 0.3.1-patch or upgrade server to one of active releases.

Support

Quality

Security

License

Reuse

Support

clickhouse-jdbc has a medium active ecosystem.

It has 1123 star(s) with 438 fork(s). There are 63 watchers for this library.

It had no major release in the last 12 months.

There are 134 open issues and 452 have been closed. On average issues are closed in 38 days. There are 9 open pull requests and 0 closed requests.

It has a neutral sentiment in the developer community.

The latest version of clickhouse-jdbc is 0.3.2

Quality

clickhouse-jdbc has 0 bugs and 0 code smells.

Security

clickhouse-jdbc has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.

clickhouse-jdbc code analysis shows 0 unresolved vulnerabilities.

There are 0 security hotspots that need review.

License

clickhouse-jdbc is licensed under the Apache-2.0 License. This license is Permissive.

Permissive licenses have the least restrictions, and you can use them in most projects.

Reuse

clickhouse-jdbc releases are available to install and integrate.

Deployable package is available in Maven.

Build file is available. You can build the component from source.

Installation instructions, examples and code snippets are available.

It has 76486 lines of code, 6932 functions and 457 files.

It has high code complexity. Code complexity directly impacts maintainability of the code.

Top functions reviewed by kandi - BETA

kandi has reviewed clickhouse-jdbc and discovered the below as its top functions. This is intended to give you an instant insight into clickhouse-jdbc implemented functionality, and help decide if they suit your requirements.

Retrieves the type information .
Parse an SQL string .
Builds the query parameters .
Parse a ClickHouse column info
Gets the input stream for the login statement .
Reads part of the string .
ResultSet object as Object .
Returns a city hash with the given seed .
Serialize this sketch into a ByteBuffer .
Check if the connection is valid

Get all kandi verified functions for this library.

clickhouse-jdbc Key Features

No Key Features are available at this moment for clickhouse-jdbc.

clickhouse-jdbc Examples and Code Snippets

Clickhouse-client insert optimization

Lines of Code : 4

License : Strong Copyleft (CC BY-SA 4.0)

Copy

# parallelism 6 (-P6)

find . -type f -name '*.csv' | xargs -P 6 -n 1 clickhouse-client --input_format_parallel_parsing=0 --receive_timeout=30000 --input_format_allow_errors_num=999999999 --host "..." --database "..." --port 9000 --user ".

How can I decline an INSERT when column is set to NOT NULL

Lines of Code : 4

License : Strong Copyleft (CC BY-SA 4.0)

Copy

clickhouse-client -h ... --input_format_null_as_default 0

clickhouse> SET input_format_null_as_default=0

Data block trigger timing of Materialized View

Lines of Code : 61

License : Strong Copyleft (CC BY-SA 4.0)

Copy

-- by default clickhouse-client forms blocks = 1048545
-- clickhouse-client by itself parses input stream and inserts into 
-- server in Native format

select value from system.settings where name = 'max_insert_block_size';
1048545


-- he

Clickhouse how to filter string by control characters

Lines of Code : 15

License : Strong Copyleft (CC BY-SA 4.0)

Copy

clickhouse-client --query="SELECT 'Hello\tworld' col format PrettyCompact"
┌─col─────────┐
│ Hello world │
└─────────────┘

clickhouse-client --query="SELECT 'Hello\tworld' like '%'||char(9)||'%' res format PrettyCo

Incorrect time returned from Clickhouse

Lines of Code : 6

License : Strong Copyleft (CC BY-SA 4.0)

Copy

# clickhouse-client --use_client_time_zone=1 -q "select now(), toString(now())"
2020-11-25 19:02:31 2020-11-25 20:02:31

# TZ=Europe/Moscow clickhouse-client --use_client_time_zone=1 -q "select now(), toString(now())"
2020-11-25 22:02:59 2

INSERT using CSV file with single quote in string field cause error

Lines of Code : 6

License : Strong Copyleft (CC BY-SA 4.0)

Copy

echo "'Catbug' Animated Series In The Works From 'Adventure Time ..." |
    clickhouse-client --query "insert into test format CSV" --format_csv_allow_single_quotes 0

echo "'Catbug' Animated Series In The Works From 'Adventure Time ..." |

Is it possible to SET settings while logging using clickhouse-client?

Lines of Code : 12

License : Strong Copyleft (CC BY-SA 4.0)

Copy

clickhouse-client  --help

Main options:
...
  --max_concurrent_queries_for_user arg The maximum number of concurrent 
                                        requests per user.
  --insert_deduplicate arg              For INSERT queries in

In Clickhouse data import, is there a setting to ignore/replace data that is not the correct type for the destination column?

Lines of Code : 4

License : Strong Copyleft (CC BY-SA 4.0)

Copy

cat data.csv | sed 's/N\/A/NaN/g' | clickhouse-client --query="INSERT INTO table_name FORMAT CSV"

cat data.csv | sed 's/N\/A//g' | clickhouse-client --query="INSERT INTO table_name FORMAT CSV"

Clickhouse : import data having double quotes escaped by backslash

Lines of Code : 2

License : Strong Copyleft (CC BY-SA 4.0)

Copy

cat sample.csv | sed 's/\\"/""/g' | clickhouse-client --query="INSERT INTO logs.processing FORMAT CSV"

"IN" support for joins

Lines of Code : 49

License : Strong Copyleft (CC BY-SA 4.0)

Copy

Received exception from server (version 19.15.3):
Code: 403. DB::Exception: Received from localhost:9000. DB::Exception: Invalid expression for JOIN ON. Expected equals expression, got code IN ('code1', 'code2'). Supported syntax: JOIN ON

Community Discussions

Trending Discussions on clickhouse-jdbc

Kafka Connect Error : java.lang.NoClassDefFoundError: org/apache/http/conn/HttpClientConnectionManager

Cannot start clickhouse-jdbc in Kafka Connect docker container

QUESTION

Kafka Connect Error : java.lang.NoClassDefFoundError: org/apache/http/conn/HttpClientConnectionManager

Asked 2021-Nov-04 at 01:31

I'm using docker with kafka and clickhouse. I want to connect 'KsqlDB table' and 'clickhouse' using 'kafka connect'. So I referred to this document and modified 'docker composite'.

here is my docker-compose

...

ANSWER

Answered 2021-Nov-04 at 01:31

It was solved when 'httpcomponents-client-4.5.13' was downloaded through wget. I think 'httpclient' was needed in 'clickhouse-jdbc'. I'm using clickhouse-jdbc-v0.2.6

Source https://stackoverflow.com/questions/69805129

QUESTION

Cannot start clickhouse-jdbc in Kafka Connect docker container

Asked 2020-Mar-06 at 18:08

Main purpose is transfer data from Kafka topic into Clickhouse table. I guess one can think why not to use Clickhouse Kafka Engine? Well, there is known problem - duplicated messages. I tried up to latest version of Clickhouse server but it's all the same.

So, I decided to use Kafka Connect JdbcSinkConnector but got an error:

java.sql.SQLException: No suitable driver found for jdbc:clickhouse://localhost:8123/default at java.sql.DriverManager.getConnection(DriverManager.java:689) at java.sql.DriverManager.getConnection(DriverManager.java:208) at io.confluent.connect.jdbc.dialect.GenericDatabaseDialect.getConnection(GenericDatabaseDialect.java:211) at io.confluent.connect.jdbc.util.CachedConnectionProvider.newConnection(CachedConnectionProvider.java:88) at io.confluent.connect.jdbc.util.CachedConnectionProvider.getConnection(CachedConnectionProvider.java:62) at io.confluent.connect.jdbc.sink.JdbcDbWriter.write(JdbcDbWriter.java:56) at io.confluent.connect.jdbc.sink.JdbcSinkTask.put(JdbcSinkTask.java:74) at org.apache.kafka.connect.runtime.WorkerSinkTask.deliverMessages(WorkerSinkTask.java:538) at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.java:321) at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkTask.java:224) at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:192) at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:177) at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:227)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

Clickhouse JDBC driver need to be install. I found the official JDBC driver and downloaded clickhouse-jdbc-0.2.4.jar from 'releases' tab into container.

Also installed jdk:

...

ANSWER

Answered 2020-Mar-06 at 18:08

Drivers don't have main classes. You cannot run them directly.
The Docker image already has a valid JDK, and installing another won't solve the error.
The ClickHouse Kafka Ingestor probably has "at-least-once" semantics, so duplicates cannot be avoided, anyway. The JDBC Source Connector can have the same issue.
You would put the Driver JAR under /usr/share/java/kafka-connect-jdbc - https://www.confluent.io/blog/kafka-connect-deep-dive-jdbc-source-connector/#no-suitable-driver-found

Source https://stackoverflow.com/questions/60566535

Community Discussions, Code Snippets contain sources that include Stack Exchange Network

Vulnerabilities

No vulnerabilities reported

Install clickhouse-jdbc

Use mvn clean verify to compile, test and generate shaded packages if you're using JDK 8. To create a multi-release jar file(see JEP-238), please use JDK 11 or above and follow instructions below:.
make sure you have ~/.m2/toolchains.xml, for example: <?xml version="1.0" encoding="UTF8"?> <toolchains> <toolchain> <type>jdk</type> <provides> <version>11</version> </provides> <configuration> <jdkHome>${{ env.JDK11_HOME }}</jdkHome> </configuration> </toolchain> </toolchains>
run mvn -Drelease clean install to build and install the artificat to local repository Note: if you need to build modules separately, please start with clickhouse-client, followed by clickhouse-http-client and clickhouse-grpc-client, and then clickhouse-jdbc and clickhouse-benchmark.

Support

For any new features, suggestions and bugs create an issue on GitHub. If you have any questions check and ask questions on community page Stack Overflow .

Find more information at: