opentsdb | A scalable, distributed Time Series Database | Database library
kandi X-RAY | opentsdb Summary
kandi X-RAY | opentsdb Summary
OpenTSDB is a distributed, scalable Time Series Database (TSDB) written on top of HBase. OpenTSDB was written to address a common need: store, index and serve metrics collected from computer systems (network gear, operating systems, applications) at a large scale, and make this data easily accessible and graphable. Thanks to HBase's scalability, OpenTSDB allows you to collect thousands of metrics from tens of thousands of hosts and applications, at a high rate (every few seconds). OpenTSDB will never delete or downsample data and can easily store hundreds of billions of data points. OpenTSDB is free software and is available under both LGPLv2.1+ and GPLv3+. Find more about OpenTSDB at
Support
Quality
Security
License
Reuse
Top functions reviewed by kandi - BETA
- Called when a module is loaded
- Build a panel for customizations
- Builds a panel containing the axes of the graph
- Refresh logs
- Sets the defaults
- Loads the static variables for this class
- Determines if a property exists in the map
- Executes a command
- Handles a PUT request
- Performs CRUD methods
- Entry point for testing
- Loads the serializers
- Performs the synchronization
- Merge data points into the local row
- Main entry point
- Loops through the entire DGE
- Evaluate the moving average window size
- Handle authentication
- Imports a single data point
- Get the next value
- Command line parser
- Compute the intersection of the sub - queries
- Get the next data point
- Assembles the UI UI
- Evaluate a series of data points
- Evaluate the series and return an array of data points
opentsdb Key Features
opentsdb Examples and Code Snippets
Community Discussions
Trending Discussions on opentsdb
QUESTION
ANSWER
Answered 2020-Jan-16 at 18:48The problem is not resolved yet and has been filed as a bug report. The latest status can be seen here:
QUESTION
I am trying to apply the deployment.yaml
file to my Kubernetes cluster with the command:
kubectl apply -f .\deployment.yaml
but I get this error:
error: error parsing .\deployment.yaml: error converting YAML to JSON: yaml: line 27: could not find expected ':'
The yaml file is the exact same with the original one at github:
...ANSWER
Answered 2019-Nov-22 at 13:23QUESTION
A friend asked me how to store raw video, frame by frame, in HBase. The typical access pattern would be to retrieve frames for a block of time. Each frame is approx. 7MB and the footage is captured at about 30 frames-per-second. A 20-minute video, for example, would take about 250GB of storage.
I saw an excellent video by Lars George, author of HBase: the definitive guide, titled HBase Schema Design: things you need to know, where he talks about storing video "chunks" (the snippet where he's talking about video starts at 1:07:12 and ends at 1:08:52), so it's seems like HBase could, potentially, be a fit for this use-case.
I created a couple of row-key options:
Scenario 0: rowkey=video ID + timestamp; frames in a single column (tall, skinny table), e.g. ...ANSWER
Answered 2017-Jun-18 at 07:28I like you approach but I would suggest to use (videoID % number_of_regions) + videoID + timestamp. This way you are not restricted to 1 min limit, but reads are consequtive and whole video is stored in same region.
QUESTION
I am trying to convert the following ConfigMap
yaml file (link here) into a kubernetes_config_map
but am running into syntax errors when trying to define it.
In particular, I can't get around the dot notation inside the opentsdb.conf
file
ANSWER
Answered 2019-Jul-22 at 10:20Welcome file Welcome file As was already mentioned by ydaetskcoR, you should fix your Terraform syntax and add quotations.
Here is a link to Configuration Syntax in Terraform.
A block is a container for other content:
QUESTION
Is there currently a way out there to convert CSV files to the OpenTSDB format? It was suggested to me to write a custom Java program to do this conversion, but I'm not really sure where to start there. Any help would be appreciated.
...ANSWER
Answered 2019-Mar-21 at 07:04First, I would create a class that can read from that CSV, you can use OpenCSV library, you can find information all around the internet regarding that library. And after that extract what you need (if you have to - I am not sure if you only want simply just convert or to parse the file and get info from inside the file.) And then you have to know your OpenTSDB format and do the magic you have to do. Your question is a bit too general, can you be more specific? You have the link with the OpenTSDB documentation here.
Hopefully I have helped you a bit.
QUESTION
when I am reading the code of opentsdb:
...ANSWER
Answered 2019-Mar-20 at 15:52Probably only if you used System.setIn()
to override the standard input. One normally does not close the standard input, it's handled by JVM process shutdown.
QUESTION
We need to store and read exact counter data (integers) over many years basically just with time filtering. Historical imports into the database will be necessary as well and the data is available in fixed time windows (every minute / hour).
It seems that Prometheus, for instance, is not a good fit because they don't ensure 100% accuracy. There are so many listings and comparisons but this is often not even mentioned although it is definitely an important detail.
So the question is: which modern database would be a good fit for such data?
The amount of possible TS databases seems to be endless. Would one or more of InfluxDB, Druid, Riak TS, graphite, OpenTSDB or timely be suitable? Or maybe some other candidate?
...ANSWER
Answered 2019-Feb-08 at 18:33It looks like you need some ACID-compliant database. For example TimescaleDB.
QUESTION
Updated with more information
I am trying to set up OpenTSDB on Bigtable, following this guide: https://cloud.google.com/solutions/opentsdb-cloud-platform
Works well, all good.
Now I was trying to open the opentsdb-write
service with a LoadBalancer (type). Seems to work well, too.
Note: using a GCP load balancer.
I am then using insomnia to send a POST to the ./api/put
endpoint - and I get a 204
as expected (also, using the ?details
shows no errors, neither does the ?sync
) (see http://opentsdb.net/docs/build/html/api_http/put.html)
When querying the data (GET on ./api/query
), I don't see the data (same effect in grafana). Also, I do not see any data added in the tsdb
table in bigtable.
My conclusion: no data is written to Bigtable, although tsd is returning 204.
Interesting fact: the metric is created (I can see it in Bigtable (cbt read tsdb-uid
) and also the autocomplete in the opentsdb-ui (and grafana) pick the metric up right away. But no data.
When I use the Heapster-Example as in the tutorial, it all works.
And the interesting part (to me):
NOTE: It happened a few times, with massive delay or after stoping/restarting the kubernetes cluster, that the data appeared. Suddenly. I could not reproduce as of now.
I must be missing something really simple.
Note: I don't see any errors in the logs (stackdriver) and UI (opentsdb UI), neither bigtable, nor Kubernetes, nor anything I can think of.
Note: the configs I am using are as linked in the tutorial.
The put I am using (see the 204):
and if I add ?details
, it indicates success:
ANSWER
Answered 2019-Jan-10 at 20:21My guess is that this relates to the opentsdb flush frequency. When a tsdb cluster is shutdown, there's an automatic flush. I'm not 100% sure, but I think that the tsd.storage.flush_interval
configuration manages that process.
You can reach the team that maintains the libraries via the google-cloud-bigtable-discuss group, which you can get to from the Cloud Bigtable support page for more nuanced discussions.
As an FYI, we (Google) are actively updating the https://cloud.google.com/solutions/opentsdb-cloud-platform to the latest versions of OpenTSDB and AsyncBigtable which should improve performance at high volumes.
QUESTION
This is relevant to Opentsdb 2.3.1 writing to Google Cloud BigTable (the Opentsdb config can be found here).
I'm writing to OpenTSDB time series like this (via the HTTP API -- api/put
) like so:
ANSWER
Answered 2019-Jan-02 at 21:41There are 2 reasons this was happening:
- The data is stored in Bigtable instead of HBase.
- The config had salting enabled.
I removed the following line from our config and the issue went away:
QUESTION
I'm having troubles starting OpenTSDB because no JDK is found allthough I've installed it and set JAVA_HOME. Here's what I've done:
1. Install JDK
...ANSWER
Answered 2017-Oct-10 at 17:12Do you try with these command after install jdk?
update-alternatives --display java update-alternatives --config javawith this command select default JDK for the system.
Regards!
Community Discussions, Code Snippets contain sources that include Stack Exchange Network
Vulnerabilities
No vulnerabilities reported
Install opentsdb
You can use opentsdb like any standard Java library. Please include the the jar files in your classpath. You can also use any IDE and you can run and debug the opentsdb component as you would do with any other Java program. Best practice is to use a build tool that supports dependency management such as Maven or Gradle. For Maven installation, please refer maven.apache.org. For Gradle installation, please refer gradle.org .
Support
Reuse Trending Solutions
Find, review, and download reusable Libraries, Code Snippets, Cloud APIs from over 650 million Knowledge Items
Find more librariesStay Updated
Subscribe to our newsletter for trending solutions and developer bootcamps
Share this Page