Back ArrowExplore all kits

How to Export pandas Dataframe to json and back to a dataframe

share link

by shivanisanju03 dot icon Updated: Feb 9, 2023

technology logo
technology logo

Solution Kit Solution Kit  

In this kit we are going to see how to convert pandas DataFrame to list of JSON-strings. Pandas DataFrames are tabular representations of data where columns represent the various data points in single data entry and each row is unique data entry. Whereas JSON is a text written in JavaScript Object notations. To convert pandas DataFrames to JSON format we use the function DataFrame.to_json () from the pandas library in Python. There are multiple customizations available in the to_json function to achieve the desired formats of JSON.


Please check the below code to know how to convert pandas DataFrame to list of JSON-strings

Fig: Preview of the output that you will get on running this code from your IDE

Code

In this solution we're using pandas and json libraries

Export pandas dataframe to json and back to a dataframe with columns in the same order

PythondotLines of Code : 56dotLicense : Strong Copyleft (CC BY-SA 4.0)

Dependent Libraries : 
df = pd.DataFrame({
        'C':list('abcdef'),
         'B':[4,5,4,5,5,4],
         'A':[7,8,9,4,2,3],
})

print (df.to_json(orient='split'))

{"columns":["C","B","A"],
 "index":[0,1,2,3,4,5],
 "data":[["a",4,7],["b",5,8],
         ["c",4,9],["d",5,4],["e",5,2],["f",4,3]]}

df.to_json('file.json', orient='split')
df = pd.read_json('file.json', orient='split')
print (df)
   C  B  A
0  a  4  7
1  b  5  8
2  c  4  9
3  d  5  4
4  e  5  2
5  f  4  3

df.to_pickle('file')
df = pd.read_pickle('file')

import json

j = {'columns': df.columns.tolist(), 'data' : df.to_dict(orient='records')}
print (j)
{'columns': ['C', 'B', 'A'], 
 'data': [{'C': 'a', 'B': 4, 'A': 7}, 
          {'C': 'b', 'B': 5, 'A': 8}, 
          {'C': 'c', 'B': 4, 'A': 9}, 
          {'C': 'd', 'B': 5, 'A': 4}, 
          {'C': 'e', 'B': 5, 'A': 2}, 
          {'C': 'f', 'B': 4, 'A': 3}]}

file = 'file.json'
with open(file, 'w') as f_obj:
    json.dump(j, f_obj)

with open(file) as f_obj:
    json_data = json.load(f_obj)

df = pd.DataFrame(json_data['data'], columns=json_data['columns'])
print(df)
   C  B  A
0  a  4  7
1  b  5  8
2  c  4  9
3  d  5  4
4  e  5  2
5  f  4  3

Instructions

Follow the steps carefully to get the output easily.

  1. Install pandas and json on your IDE(Any of your favorite IDE).
  2. Copy the snippet using the 'copy' and paste it in your IDE.
  3. Run the file to generate the output.


I hope you found this useful. I have added the link to dependent library, version information in the following sections.


I found this code snippet by searching for ' Export pandas dataframe to json and back to a dataframe'in kandi. You can try any such use case!

Environment tested

I tested this solution in the following versions. Be mindful of changes when working with other versions.

  1. The solution is created in Jupyter notebook 6.5.2.
  2. The solution is tested on Python 3.8.10.
  3. pandas 1.5.3 and simplejson 3.18.3


Using this solution, we are able to understand how to convert pandas DataFrame to list of JSON-strings with simple steps. This process also facilities an easy way to use, hassle-free method to create a hands-on working version of code which would help us how to convert pandas DataFrame to list of JSON-strings.

Dependent Libraries

pandasby pandas-dev

Python doticonstar image 38689 doticonVersion:v2.0.2doticon
License: Permissive (BSD-3-Clause)

Flexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects, statistical functions, and much more

Support
    Quality
      Security
        License
          Reuse

            pandasby pandas-dev

            Python doticon star image 38689 doticonVersion:v2.0.2doticon License: Permissive (BSD-3-Clause)

            Flexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects, statistical functions, and much more
            Support
              Quality
                Security
                  License
                    Reuse

                      simplejsonby simplejson

                      Python doticonstar image 1555 doticonVersion:v3.18.3doticon
                      License: Others (Non-SPDX)

                      simplejson is a simple, fast, extensible JSON encoder/decoder for Python

                      Support
                        Quality
                          Security
                            License
                              Reuse

                                simplejsonby simplejson

                                Python doticon star image 1555 doticonVersion:v3.18.3doticon License: Others (Non-SPDX)

                                simplejson is a simple, fast, extensible JSON encoder/decoder for Python
                                Support
                                  Quality
                                    Security
                                      License
                                        Reuse

                                          You can also search for any dependent libraries on kandi like 'pandas', 'simplejson'

                                          Support

                                          1. For any support on kandi solution kits, please use the chat
                                          2. For further learning resources, visit the Open Weaver Community learning page.


                                          See similar Kits and Libraries

                                          Open Weaver – Develop Applications Faster with Open Source

                                          kandi

                                          Community and Support

                                          Company

                                          Follow

                                          • © 2023 Open Weaver Inc.