snappydata | Project SnappyData - memory optimized analytics database

by TIBCOSoftware Scala Version: v1.3.1 License: Non-SPDX

X-Ray Key Features Code Snippets Community Discussions(2)Vulnerabilities Install Support

kandi X-RAY | snappydata Summary

snappydata is a Scala library typically used in Big Data, Spark applications. snappydata has no bugs, it has no vulnerabilities and it has medium support. However snappydata has a Non-SPDX License. You can download it from GitHub.

SnappyData (aka TIBCO ComputeDB) is a distributed, in-memory optimized analytics database. SnappyData delivers high throughput, low latency, and high concurrency for unified analytics workload. By fusing an in-memory hybrid database inside Apache Spark, it provides analytic query processing, mutability/transactions, access to virtually all big data sources and stream processing all in one unified cluster. One common use case for SnappyData is to provide analytics at interactive speeds over large volumes of data with minimal or no pre-processing of the dataset. For instance, there is no need to often pre-aggregate/reduce or generate cubes over your large data sets for ad-hoc visual analytics. This is made possible by smartly managing data in-memory, dynamically generating code using vectorization optimizations and maximizing the potential of modern multi-core CPUs. SnappyData enables complex processing on large data sets in sub-second timeframes. !!!Note SnappyData is not another Enterprise Data Warehouse (EDW) platform, but rather a high performance computational and caching cluster that augments traditional EDWs and data lakes.

Support

Quality

Security

License

Reuse

Support

snappydata has a medium active ecosystem.

It has 1033 star(s) with 207 fork(s). There are 84 watchers for this library.

It had no major release in the last 12 months.

There are 90 open issues and 118 have been closed. On average issues are closed in 77 days. There are 27 open pull requests and 0 closed requests.

It has a neutral sentiment in the developer community.

The latest version of snappydata is v1.3.1

Quality

snappydata has no bugs reported.

Security

snappydata has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.

License

snappydata has a Non-SPDX License.

Non-SPDX licenses can be open source with a non SPDX compliant license, or non open source licenses, and you need to review them closely before use.

Reuse

snappydata releases are available to install and integrate.

Installation instructions, examples and code snippets are available.

Top functions reviewed by kandi - BETA

kandi's functional review helps you automatically verify the functionalities of the libraries and avoid rework.
Currently covering the most popular Java, JavaScript and Python libraries. See a Sample of snappydata

Get all kandi verified functions for this library.

snappydata Key Features

No Key Features are available at this moment for snappydata.

snappydata Examples and Code Snippets

No Code Snippets are available at this moment for snappydata.

Community Discussions

Trending Discussions on snappydata

PySpark Structured Streaming Query - query in dashbord visibility

Load data from MS SQL table to snappyData

QUESTION

PySpark Structured Streaming Query - query in dashbord visibility

Asked 2020-Nov-30 at 14:11

I wrote some example code which connect to kafka broker, read data from topic and sink it to snappydata table.

...

ANSWER

Answered 2020-Nov-30 at 14:11

SnappyData supports Python jobs to be submitted only in Smart Connector mode, which means it'll always be launched via a separate Spark Cluster to talk to SnappyData cluster. Hence, you see that your Python job is seen on this Spark cluster's UI and not on SnappyData's dashboard.

Source https://stackoverflow.com/questions/65072860

QUESTION

Load data from MS SQL table to snappyData

Asked 2020-Feb-05 at 09:52

I am using Tibco ComputeDB, which is new to me. It uses sparkDB and snappyData. I want to add data from MS SQL to in memory table of snappyData.

I can read data from CSV and load that in snappyDaya with below command.

=> CREATE EXTERNAL TABLE IF NOT EXISTS AirlineData USING csv OPTIONS(path '/home/ubuntu/Downloads/airline-data-small/*.csv')

Now same way I want to read data from MS SQL and want to add it in snappyData but not able to find proper way to do it. I followed below documentation and able to connect to MS SQL server and display data using spark/scala. But didn't find way to add it in snappyData.

=> https://docs.microsoft.com/en-us/azure/databricks/data/data-sources/sql-databases

There is also documentation which shows how to do it for MySQL but not for MS SQL.

=> https://snappydatainc.github.io/snappydata/howto/load_data_from_external_data_stores/

Came across below link and made changes for sqlserver but getting error.

=> How can I get external table jdbc url in SnappyData

For SQL Server:-

create external table Test_1 using jdbc options(url 'jdbc:sqlserver://server:port;database=dbname;user=username;password=pswd', driver 'com.microsoft.sqlserver.jdbc.SQLServerDriver',dbtable 'CERTIFICATES');

Error:-

ERROR 42000: (SQLState=42000 Severity=20000) (Server=localhost/127.0.0.1[1528] Thread=ThriftProcessor-0) Syntax error or analysis exception: com.microsoft.sqlserver.jdbc.SQLServerDriver

...

ANSWER

Answered 2020-Feb-05 at 09:09

Looks like JDBC driver jar for SQL server is not added to the classpath.

In order to do that you will have to deploy JDBC driver jar of SQL server using the following SQL command:

deploy jar 'path-to-jar'

Check this link for more details: https://snappydatainc.github.io/snappydata/reference/sql_reference/deploy_jar/

The latest JDBC driver can be downloaded from here: https://www.microsoft.com/en-US/download/details.aspx?id=11774

After deploying jar try creating the external table and it should work. Tested with the following query with Microsoft SQL Server 2016:

Source https://stackoverflow.com/questions/60057985

Community Discussions, Code Snippets contain sources that include Stack Exchange Network

Vulnerabilities

No vulnerabilities reported

Install snappydata

Multiple options are provided to get started with SnappyData. Easiest way to get going with SnappyData is on your laptop. You can also use any of the following options:.
On-premise clusters
AWS
Docker
Kubernetes