iotdb | Apache IoTDB | Time Series Database library
kandi X-RAY | iotdb Summary
kandi X-RAY | iotdb Summary
IoTDB (Internet of Things Database) is a data management system for time series data, which can provide users specific services, such as, data collection, storage and analysis. Due to its light weight structure, high performance and usable features together with its seamless integration with the Hadoop and Spark ecology, IoTDB meets the requirements of massive dataset storage, high throughput data input, and complex data analysis in the industrial IoT field.
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
- Checks if the plan is actually executed .
- Merges the paths between a sequence of times .
- Load a ts file from unSequence list
- Generate aligning by device .
- Method executeBatchStatement .
- Check the match index for the node .
- Derive the inner hash .
- Adds a node to the cluster .
- Prints the chunk .
- Commit the given commit index to the given commitIndex .
iotdb Key Features
iotdb Examples and Code Snippets
Community Discussions
Trending Discussions on iotdb
QUESTION
Before flushing the data, will it writes data in the memory firstly in Apache IoTDB?
...ANSWER
Answered 2022-Apr-15 at 02:21The memory cache will be written first, but there is also wal to prevent sudden power failure and data loss. You can try to increase the synchronous disk interval (force_wal_period_in_ms) of the wal, or put the wal on the solid state disk (wal_dir) alone, or even try to turn off the wal (enable_wal).
QUESTION
Why did the time of the data change after I used groupby with apache iotdb database？the original timestamp is 17:52:05.050+08:00. run the sql"group by". i found the timestamp became"17:51:44". it looks strange. looing for the explanation. enter image description here
...ANSWER
Answered 2022-Mar-31 at 05:15when doing “Group by” it will offset the time to align... If you want to keep the original time, change the start time in "Group BY"
QUESTION
Experts, We have a maven project with following dependencies in porn.xml.
...ANSWER
Answered 2022-Mar-24 at 01:49This is due to thrift dependency conflict between iotdb-session and hive. Try to use mvn dependency:tree to see which dependency conflicts with iotdb-session. Then, use to remove the dependency
QUESTION
2022-03-09 10:17:10,158 [pool-12-IoTDB-RPC-Client-1] WARN o.a.i.d.u.ErrorHandlingUtils:61 - Status code: INTERNAL_SERVER_ERROR(500), operation: "select count(tenantId$s) from root.benchmark.type.model_850_7.device_model850_15". executeStatement failed java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: Invalid input: 95 at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:192) at org.apache.iotdb.db.service.thrift.impl.TSServiceImpl.executeStatement(TSServiceImpl.java:637) at org.apache.iotdb.service.rpc.thrift.TSIService$Processor$executeStatement.getResult(TSIService.java:2853) at org.apache.iotdb.service.rpc.thrift.TSIService$Processor$executeStatement.getResult(TSIService.java:2833) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:38) at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:38) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:248) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.lang.IllegalArgumentException: Invalid input: 95 at org.apache.iotdb.tsfile.file.metadata.enums.MetadataIndexNodeType.deserialize(MetadataIndexNodeType.java:70) at org.apache.iotdb.tsfile.file.metadata.MetadataIndexNode.deserializeFrom(MetadataIndexNode.java:107) at org.apache.iotdb.tsfile.read.TsFileSequenceReader.getMetadataAndEndOffset(TsFileSequenceReader.java:980) at org.apache.iotdb.tsfile.read.TsFileSequenceReader.getLeafMetadataIndexPair(TsFileSequenceReader.java:471) at org.apache.iotdb.tsfile.read.TsFileSequenceReader.readTimeseriesMetadata(TsFileSequenceReader.java:443) at org.apache.iotdb.db.engine.cache.TimeSeriesMetadataCache.get(TimeSeriesMetadataCache.java:194) at org.apache.iotdb.db.utils.FileLoaderUtils.loadTimeSeriesMetadata(FileLoaderUtils.java:168)
...ANSWER
Answered 2022-Mar-11 at 02:03You can do this if you have another disk:
Add the path of the second disk to data_dir in the iOTDB configuration file
Move some TS files from the first disk to the second disk
QUESTION
Apache IoTDB compiling error ：maven-download-plugin has wget (get-thrift-executable) EOFException
ran "mvn clean package -pl distribution -am -DskipTests" and then received the error. [INFO] -------------------< org.apache.iotdb:iotdb-thrift >-------------------- [INFO] Building rpc-thrift 0.12.5-SNAPSHOT [4/17] [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] --- maven-clean-plugin:3.1.0:clean (default-clean) @ iotdb-thrift --- [INFO] Deleting /Users/qiaojialin/Documents/git_workspace/incubator-iotdb/thrift/target [INFO] [INFO] --- maven-checkstyle-plugin:3.0.0:check (validate) @ iotdb-thrift --- [INFO] [INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-maven-version) @ iotdb-thrift --- [INFO] Skipping Rule Enforcement. [INFO] [INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-version-convergence) @ iotdb-thrift --- [INFO] Skipping Rule Enforcement. [INFO] [INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (vulnerability-checks) @ iotdb-thrift --- [INFO] Skipping Rule Enforcement. [INFO] [INFO] --- spotless-maven-plugin:2.4.2:check (spotless-check) @ iotdb-thrift --- [INFO] [INFO] --- download-maven-plugin:1.3.0:wget (get-thrift-executable) @ iotdb-thrift --- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary for Apache IoTDB Project Parent POM 0.12.5-SNAPSHOT: [INFO] [INFO] Apache IoTDB Project Parent POM .................... SUCCESS [ 8.961 s] [INFO] TsFile ............................................. SUCCESS [ 19.869 s] [INFO] sql-antlr .......................................... SUCCESS [ 4.801 s] [INFO] rpc-thrift ......................................... FAILURE [ 0.301 s] [INFO] rpc-thrift-cluster ................................. SKIPPED [INFO] rpc-thrift-sync .................................... SKIPPED [INFO] Service-rpc ........................................ SKIPPED [INFO] IoTDB Jdbc ......................................... SKIPPED [INFO] IoTDB Server ....................................... SKIPPED [INFO] IoTDB Session ...................................... SKIPPED [INFO] IoTDB Cli .......................................... SKIPPED [INFO] IoTDB Grafana ...................................... SKIPPED [INFO] cluster ............................................ SKIPPED [INFO] Compile Tools ...................................... SKIPPED [INFO] Tools: Thrift ...................................... SKIPPED [INFO] Client for cpp ..................................... SKIPPED [INFO] IoTDB Distribution ................................. SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 34.350 s [INFO] Finished at: 2022-03-02T10:31:28+08:00 [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal com.googlecode.maven-download-plugin:download-maven-plugin:1.3.0:wget (get-thrift-executable) on project iotdb-thrift: IO Error: EOFException -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn -rf :iotdb-thrift
...ANSWER
Answered 2022-Mar-04 at 05:43delete directory".m2/repository/.cache/download-maven-plugin". Then compile again. It will work.
QUESTION
Describe the bug
Today I wanted to create a continuous query, so I gave it a run. Already when running the first query I got from the documentation I got an error - and whatever I wrote, I got the same error:
...ANSWER
Answered 2022-Feb-28 at 02:50CQ will come with 0.13.x. You can download IoTDB repo, checkout to the master branch, build and have a try :D
QUESTION
I want to COUNT the data GROUP BY day. SQL is shown below. However, the result is wrong. I only got one number rather than each day's number. Hope someone can help me with the SQL writing. Note: I use Apache IoTDB Database and the data is consumed by kafaka and written by flink.
...ANSWER
Answered 2022-Feb-25 at 10:15Your endTime in group by clause is less than your startTime, which is not right. And BTW, you should use the Unix timestamp instead.
QUESTION
org.apache.thrift.transport.TTransportException:java.net.SocketException:断开的管道(Write failed) at ora.apache.thrift.transport.TIOStreamTransport.flush(TIOStreamTransport.iava:213) at org.apache.iotdb.rpc.TElasticFramedTransport.flush(TElasticFramedTransport.java:140) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:60) at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:38) at ora.apache.thrift.server.TThreadPoolServersWorkerProcess.run(TThreadPoolServer.iava:248) at iava.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor,iava:1149) at iava.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.iava:624 at java.lang.Thread.run(Thread.java:748) Caused by: java.net.SocketException:断开的管道(Write failed) at java.net.SocketOutputStream.socketWrite0(Native Method) at iava.net.SocketOutputStream.socketWrite(SocketOutputStream.iava:111) at iava.net.SocketOutputStream.write(SocketOutputStream.iava:155) at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.iava:82) at java.io.BufferedOutputstream.flush(BufferedOutputStream.java:140) at org.apache.thrift.transport.TIOStreamTransport.flush(TIOStreamTransport.java:208) 7 common frames omittedenter image description here enter image description here
...ANSWER
Answered 2022-Feb-23 at 13:42It's because creating close connections too frequently. You can use SessionPool to reuse connections.
QUESTION
I'm currently inserting data into IoTDB and I see some small TsFiles is merging into the large files. I would like to know how often the TsFiles be merged and how the merge process is triggered. Thanks!
...ANSWER
Answered 2022-Feb-22 at 09:09In the 0.12.x IoTDB iotdb-engine.properties file, there is a configuration merge_fileSelection_time_budget=30000, which means if there are enough amount of TsFiles of one level existed (seq_file_num_in_each_level=6 or unseq_file_num_in_each_level=10), the merge task will start. After 30000ms then, IoTDB will check if there still are enough TsFiles existed and start the next merge task.
QUESTION
I want to know more about Apache IoTDB Database too. In a 3-node cluster, if one node breaks, will it affect the normal use of the entire cluster? Thanks!
...ANSWER
Answered 2022-Feb-21 at 10:35It depends on how many replicas you config. If you set the replica num >= 3, then if one replica breaks, it won't affect the normal use of the entire cluster.
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install iotdb
IoTDB provides three installation methods, you can refer to the following suggestions, choose the one fits you best:. Here in the Quick Start, we give a brief introduction of using source code to install IoTDB. For further information, please refer to User Guide.
Installation from source code. If you need to modify the code yourself, you can use this method.
Installation from binary files. Download the binary files from the official website. This is the recommended method, in which you will get a binary released package which is out-of-the-box.
Using Docker：The path to the dockerfile is https://github.com/apache/iotdb/tree/master/docker/src/main
Under the root path of iotdb:. After being built, the IoTDB server is located at the folder: "server/target/iotdb-server-{project.version}".
Under the root path of iotdb:. After being built, the IoTDB cli is located at the folder "cli/target/iotdb-cli-{project.version}".
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page
