Back ArrowExplore all topics
technology logo
technology logo

How to Remove names from Noun Chunks in SpaCy

share link

by vigneshchennai74 dot icon Updated: Jan 31, 2023

Solution Kit Solution Kit  

To remove names from noun chunks, you can use the SpaCy library in Python. You can first load the library and load a pre-trained model, then use the noun chunks attribute to extract all of the noun chunks in a given text. Then you can use a loop to iterate through each chunk and an if statement to check if the chunk contains a proper noun. If the chunk contains a proper noun, you can remove it from the text.  


The removal of names from noun chunks has a variety of uses, such as:  

  • Data anonymization: To respect people's privacy and adhere to data protection laws, text can be made anonymous by removing personal identifiers.  
  • Text summarization: By omitting proper names from the text, it is possible to condense the length of a summary while maintaining the important points.  
  • Text classification: By lowering the amount of noise in the input data, removing proper names from text improves text classification algorithms' performance.  
  • Sentiment analysis: By removing proper names, sentiment analysis can be made more objective.  
  • Text-to-Speech: By removing appropriate names from the discourse, text-to-speech can sound more natural.  


Here is how you can remove names from noun chunks:  

Preview of the output that you will get on running this code from your IDE

Code

In this solution we have used Spacy library of python.

Removing names from noun chunks in spacy

PythondotLines of Code : 14dotLicense : Strong Copyleft (CC BY-SA 4.0)

Dependent Libraries : 
import spacy
# loading the model
nlp = spacy.load('en_core_web_lg')
doc = nlp(u'"John Smith is lookin for Apple ipod"')
# creating the filter list for tokens that are identified as person
fil = [i for i in doc.ents if i.label_.lower() in ["person"]]
# looping through noun chunks
for chunk in doc.noun_chunks:
    # filtering the name of the person
    if chunk not in fil:
        print(chunk.text)

Apple ipod
  1. Copy the code using the "Copy" button above, and paste it in a Python file in your IDE.
  2. Enter the Text
  3. Run the code that collect the names from noun chunks


I hope you found this useful. I have added the link to dependent libraries, version information in the following sections.


I found this code snippet by searching for "Remove Name from noun chuncks using SpaCy" in kandi. You can try any such use case!

Environment Tested

I tested this solution in the following versions. Be mindful of changes when working with other versions.


  1. The solution is created in Python 3.7.15 Version
  2. The solution is tested on Spacy 3.4.3 Version


Using this solution, we can Extract names from noun chuncks with the help of function in spacy . This process also facilities an easy to use, hassle free method to create a hands-on working version of code which would help us extract the Nouns python.

Dependent Library

spaCyby explosion

Python doticonstar image 26205 doticonVersion:v3.5.3doticon
License: Permissive (MIT)

💫 Industrial-strength Natural Language Processing (NLP) in Python

Support
    Quality
      Security
        License
          Reuse

            spaCyby explosion

            Python doticon star image 26205 doticonVersion:v3.5.3doticon License: Permissive (MIT)

            💫 Industrial-strength Natural Language Processing (NLP) in Python
            Support
              Quality
                Security
                  License
                    Reuse

                      If you do not have SpaCy that is required to run this code, you can install it by clicking on the above link and copying the pip Install command from the Spacy page in kandi.

                      You can search for any dependent library on kandi like SpaCy

                      Support

                      1. For any support on kandi solution kits, please use the chat
                      2. For further learning resources, visit the Open Weaver Community learning page

                      See similar Kits and Libraries

                      Open Weaver – Develop Applications Faster with Open Source

                      kandi

                      Community and Support

                      Company

                      Follow

                      • © 2023 Open Weaver Inc.