PyAthenaJDBC | Amazon Athena JDBC driver wrapper for the Python DB API | AWS library

by laughingman7743 Python Version: 3.0.1 License: MIT

X-Ray Key Features Code Snippets Community Discussions(6)Vulnerabilities Install Support

kandi X-RAY | PyAthenaJDBC Summary

PyAthenaJDBC is a Python library typically used in Cloud, AWS, Amazon S3 applications. PyAthenaJDBC has no bugs, it has no vulnerabilities, it has a Permissive License and it has low support. However PyAthenaJDBC build file is not available. You can install using 'pip install PyAthenaJDBC' or download it from GitHub, PyPI.

PyAthenaJDBC is an Amazon Athena JDBC driver wrapper for the Python DB API 2.0 (PEP 249).

Support

Quality

Security

License

Reuse

Support

PyAthenaJDBC has a low active ecosystem.

It has 94 star(s) with 28 fork(s). There are 4 watchers for this library.

It had no major release in the last 12 months.

There are 6 open issues and 48 have been closed. On average issues are closed in 149 days. There are no pull requests.

It has a neutral sentiment in the developer community.

The latest version of PyAthenaJDBC is 3.0.1

Quality

PyAthenaJDBC has 0 bugs and 0 code smells.

Security

PyAthenaJDBC has no vulnerabilities reported, and its dependent libraries have no vulnerabilities reported.

PyAthenaJDBC code analysis shows 0 unresolved vulnerabilities.

There are 0 security hotspots that need review.

License

PyAthenaJDBC is licensed under the MIT License. This license is Permissive.

Permissive licenses have the least restrictions, and you can use them in most projects.

Reuse

PyAthenaJDBC releases are available to install and integrate.

Deployable package is available in PyPI.

PyAthenaJDBC has no build file. You will be need to create the build yourself to build the component from source.

Top functions reviewed by kandi - BETA

kandi has reviewed PyAthenaJDBC and discovered the below as its top functions. This is intended to give you an instant insight into PyAthenaJDBC implemented functionality, and help decide if they suit your requirements.

The column description
Returns the name for the given type code
Return the value for the given type
Visit a create table
Generate post - create statement
Return the type of a datetime
Return a time stamp
Visit VARBINARY
Return binary type
Visitor for floating point types
Determine type
Visits a numeric type
Return an astroid Decimals node as string
Format a query
Get the mapping for a given type
Convert a result_set into a result set
Set a converter function
Gets the code for the given type
Downloads the JDBC driver
Return type of binary
Return nclob
Return the type of a clob

Get all kandi verified functions for this library.

PyAthenaJDBC Key Features

No Key Features are available at this moment for PyAthenaJDBC.

PyAthenaJDBC Examples and Code Snippets

No Code Snippets are available at this moment for PyAthenaJDBC.

Community Discussions

Trending Discussions on PyAthenaJDBC

RuntimeError: Unable to start JVM because of Deprecated: convertStrings

Failing to querying AWS Athena from Python 2.7, when passing AWS session Token in pyathenajdbc.connect()

PyAthenaJDBC query string formatting issue

java.sql.SQLExceptionPyRaisable on the second attempt connecting to Athena using Django

Connecting with Athena using Python and pyathenajdbc

HIVE Arguments in PyAthenaJDBC (AWS athena)

QUESTION

RuntimeError: Unable to start JVM because of Deprecated: convertStrings

Asked 2019-Jun-27 at 00:44

I run an automated python job on an EMR cluster that updates Amazon Athena Tables.

It was running well until few days ago (on python 2.7 and 3.7). Here is the script:

...

ANSWER

Answered 2019-Jun-25 at 13:59

Got the same issue today. Try to downgrade JPype1 to 0.6.3. JPype1 released 0.7.0 today, which is not compatible with old interfaces.

Source https://stackoverflow.com/questions/56754718

QUESTION

Failing to querying AWS Athena from Python 2.7, when passing AWS session Token in pyathenajdbc.connect()

Asked 2017-May-10 at 19:42

I'm trying to connect to Athena using pyathenajdbc.connect(). I have AWS credentials setup via Multi-factor Authentication. When I don't include the AWS Token in connection string I get following error.

athena_conn = connect(access_key=AWS_KEY_ID, secret_key=AWS_SECRET, s3_staging_dir='s3://abc-pqr-xyz/processed/athena-outputs/',region_name=REGION)

EROR: pyathenajdbc.error.DatabaseError: The security token included in the request is invalid. (Service: AmazonAthena; Status Code: 400; Error Code: UnrecognizedClientException; Request ID: 0d488c0b-1eed-11e7-bad8-711e54af6b73)

When I include the AWS Token in connection string I get following error -->

athena_conn = connect(access_key=AWS_KEY_ID, secret_key=AWS_SECRET, token=AWS_SESSION_TOKEN, s3_staging_dir='s3://abc-pqr-xyz/processed/athena-outputs/',region_name=REGION) ERROR: pyathenajdbc.error.DatabaseError: The security token included in the request is invalid. (Service: AmazonAthena; Status Code: 400; Error Code: UnrecognizedClientException; Request ID: 91751051-1eed-11e7-8347-153dfe3d84a6)

Does anyone know what is wrong here??

Here is my entire code.

...

ANSWER

Answered 2017-Apr-12 at 12:42

The issue is not straightforward but i'm guessing it has something to do with your credentials. You should investigate a bit: try printing your keys and verify if they are valid or not.

Here is an alternative that I use to input my credentials :

Source https://stackoverflow.com/questions/43354951

QUESTION

PyAthenaJDBC query string formatting issue

Asked 2017-Apr-22 at 05:24

I am trying to use the PyAthenaJDBC library to make a python script that will query an S3 bucket using Athena. The library is pretty great but I'm having issues with formatting.

I'm constructing the queries as strings in a separate function and passing the query string back to cursor.execute(query).

The query string has quotes in it, and looks like this:

...

ANSWER

Answered 2017-Apr-22 at 05:24

If the query is used as a string to be formatted, you need to double any % characters you want to survive as literal % characters.

Instead of WHEN elb_response_code LIKE '5%' THEN 1, use WHEN elb_response_code LIKE '5%%' THEN 1. After the line you indicate in formatter.py runs, %% will have been transformed into a single %.

Source https://stackoverflow.com/questions/43554354

QUESTION

java.sql.SQLExceptionPyRaisable on the second attempt connecting to Athena using Django

Asked 2017-Apr-19 at 12:10

I am using the python module called PyAthenaJDBC in order to query Athena using the provided JDBC driver. Here is the link : https://pypi.python.org/pypi/PyAthenaJDBC/

I have been facing some persistent issue. I keep getting this java error whenever I use the Athena connection twice in a row.

As a matter of fact, I was able to connect to Athena, show databases, create new tables and even query the content. I am building an application using Django and running its server to use Athena However, I am obliged to re-run the server in order for the Athena connection to work once again,

Here is a glimpse of the class I have built

...

ANSWER

Answered 2017-Mar-21 at 14:43

Update: After posting the issue in github, the author solved this problem and released a new version that works perfectly. It was a multi-threading problem with JPype.

Question answered!

ref : https://github.com/laughingman7743/PyAthenaJDBC/pull/8

Source https://stackoverflow.com/questions/42864927

QUESTION

Connecting with Athena using Python and pyathenajdbc

Asked 2017-Apr-19 at 12:09

I am trying to connect to AWS Athena using python. I am trying to use pyathenajdbc to achieve this task. The issue I am having is obtaining a connection. When I run the code below, I receive an error message stating it cannot find the AthenaDriver. ( java.lang.RuntimeException: Class com.amazonaws.athena.jdbc.AthenaDriver not found). I did download this file from AWS and I have confirmed it is sitting in that directory.

...

ANSWER

Answered 2017-Mar-27 at 09:19

Try this :

Source https://stackoverflow.com/questions/43006368

QUESTION

HIVE Arguments in PyAthenaJDBC (AWS athena)

Asked 2017-Apr-19 at 12:07

I am using the python module called PyAthenaJDBC in order to query Athena using the provided JDBC driver. Here is the link : https://pypi.python.org/pypi/PyAthenaJDBC/

The connection is established successfully, the queries are working as well (Show databases, show tables, Select ... ) However, whenever I try to define a custom table using Hive arguments such as 'ROW FORMAT SERDE..' It's not working anymore, Here is my code :

...

ANSWER

Answered 2017-Mar-15 at 11:29

Your query is malformed.

It is due to this line:

Source https://stackoverflow.com/questions/42808082

Community Discussions, Code Snippets contain sources that include Stack Exchange Network

Vulnerabilities

No vulnerabilities reported

Install PyAthenaJDBC

You can install using 'pip install PyAthenaJDBC' or download it from GitHub, PyPI.
You can use PyAthenaJDBC like any standard Python library. You will need to make sure that you have a development environment consisting of a Python distribution including header files, a compiler, pip, and git installed. Make sure that your pip, setuptools, and wheel are up to date. When using pip it is generally recommended to install packages in a virtual environment to avoid changes to the system.

Support

For any new features, suggestions and bugs create an issue on GitHub. If you have any questions check and ask questions on community page Stack Overflow .

Find more information at: