Back ArrowExplore all kits

How to Extract all Numbers from a String Column in Python Pandas

share link

by Abdul Rawoof A R dot icon Updated: Jan 31, 2023

technology logo
technology logo

Solution Kit Solution Kit  

Extracting numbers from a text column in a Pandas DataFrame and creating a new column with those numbers is a common data pre-processing task. This can be accomplished using a combination of pandas and regular expression (regex) functions. 


Extracting numbers from a text column and adding them to a new column in a Pandas DataFrame has a variety of possible uses. Several instances include: 

  • Data cleaning and preprocessing for machine learning: You can develop new features that can be used as input to a model by taking numerical values out of text data. 
  • Financial analysis: A dataset for financial analysis can be created by extracting numerical values from news stories or financial reports. 
  • Text analytics: By extracting numerical information from text data, one can learn more about the text's substance, such as the frequency with which particular numbers are referenced or the dataset's average value. 
  • Data visualization: Extracting numerical values can create charts, graphs, and other visualizations to help understand the data and communicate insights to others. 


Here's how to use Pandas to extract numbers from a text and store them in a new column:  

Fig : Preview of the output that you will get on running this code from your IDE.

Code

In this solution we're using Pandas library.

python pandas extracting numbers within text to a new column

PythondotLines of Code : 10dotLicense : Strong Copyleft (CC BY-SA 4.0)

Dependent Libraries : 
import pandas as pd

df = pd.DataFrame({"A": ["hellothere_3.43", "hellothere_3.9"]})
df["B"] = df["A"].str.extract("(\d*\.?\d+)", expand=True)
print(df)

                 A     B
0  hellothere_3.43  3.43
1   hellothere_3.9   3.9

Instructions

Follow the steps carefully to get the output easily.

  1. Install pandas on your IDE(Any of your favorite IDE).
  2. Copy the snippet using the 'copy' and paste it in your IDE.
  3. Add required dependencies and import them in Python file.
  4. Run the file to generate the output.


I hope you found this useful. I have added the link to dependent libraries, version information in the following sections.


I found this code snippet by searching for 'pandas extracting numbers within text to a new column' in kandi. You can try any such use case!

Environment Tested

I tested this solution in the following versions. Be mindful of changes when working with other versions.

  1. The solution is created in PyCharm 2021.3.
  2. The solution is tested on Python 3.9.7.
  3. Pandas version-v1.5.2.


Using this solution, we are able to extract numbers within text to a new column with simple steps. This process also facilities an easy way to use, hassle-free method to create a hands-on working version of code which would help us to extract numbers within text to a new column.

Dependent Library

pandasby pandas-dev

Python doticonstar image 38689 doticonVersion:v2.0.2doticon
License: Permissive (BSD-3-Clause)

Flexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects, statistical functions, and much more

Support
    Quality
      Security
        License
          Reuse

            pandasby pandas-dev

            Python doticon star image 38689 doticonVersion:v2.0.2doticon License: Permissive (BSD-3-Clause)

            Flexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects, statistical functions, and much more
            Support
              Quality
                Security
                  License
                    Reuse

                      You can also search for any dependent libraries on kandi like 'pandas'.

                      Support

                      1. For any support on kandi solution kits, please use the chat
                      2. For further learning resources, visit the Open Weaver Community learning page.


                      See similar Kits and Libraries

                      Open Weaver – Develop Applications Faster with Open Source

                      kandi

                      Community and Support

                      Company

                      Follow

                      • © 2023 Open Weaver Inc.