Back ArrowExplore all topics
technology logo
technology logo

Find complete sentence that contain your keyword

share link

by vigneshchennai74 dot icon Updated: Jan 31, 2023

Solution Kit Solution Kit  

Using SpaCy, you may utilize the techniques below to identify the full sentence that includes a particular keyword:  

  • Load the desired language model and import the SpaCy library.  
  • By feeding the text data via the SpaCy nlp object, you can process it.  
  • Repeat over the sentences in the processed text, ensuring that each one has the keyword.  

Finding entire phrases that contain a particular term can be done using a variety of apps, including:  

  • Text mining: This technique can be used to extract pertinent facts from massive amounts of text data by looking for sentences that include a particular keyword.  
  • Information retrieval: Users can quickly locate pertinent information in a document or group of documents by searching for sentences that contain a particular keyword.  
  • Question-answering: Finding sentences that answer a question can help question-answering systems be more accurate.  
  • Text summarization: Finding sentences with essential words in them can aid in creating a summary of a text that accurately conveys its primary concepts.  
  • Evaluation of the language model: The ability of the language model to produce writing that is human-like can be assessed by locating full sentences that contain a keyword.  


Here is how you can find the complete sentence that contains your keyword:  

Preview of the output that you will get on running this code from your IDE

Code

In this solution we have used Matcher function of SpaCy Library.

How to extract sentences with key phrases in spaCy

PythondotLines of Code : 22dotLicense : Strong Copyleft (CC BY-SA 4.0)

Dependent Libraries : 
import spacy
from spacy.matcher import PhraseMatcher

text = """I like tomtom and I cannot lie. In computer science, artificial intelligence (AI), sometimes called machine intelligence, is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals.  Leading AI textbooks define the field as the study of "intelligent agents": any device that perceives its  environment and takes actions that maximize its chance of successfully achieving its goals.[1] Colloquially,  the term "artificial intelligence" is often used to describe machines (or computers) that mimic "cognitive"  functions that humans associate with the human mind, such as "learning" and "problem solving".[2] """

nlp = spacy.load("en_core_web_sm")

phrase_matcher = PhraseMatcher(nlp.vocab)
phrases = ['machine learning', 'artificial intelligence']
patterns = [nlp(text) for text in phrases]
phrase_matcher.add('AI', None, *patterns)

doc = nlp(text)

for sent in doc.sents:
    for match_id, start, end in phrase_matcher(nlp(sent.text)):
        if nlp.vocab.strings[match_id] in ["AI"]:
            print(sent.text)

In computer science, artificial intelligence (AI), sometimes called machine intelligence, is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals.  
Colloquially,  the term "artificial intelligence" is often used to describe machines (or computers)
  1. Copy the code using the "Copy" button above, and paste it in a Python file in your IDE.
  2. Enter the Text
  3. Run the code that Find the Complete Sentence you looking for.


I hope you found this useful. I have added the link to dependent libraries, version information in the following sections.


I found this code snippet by searching for "How to extract sentence with key phrases in SpaCy" in kandi. You can try any such use case!


Note


In this snippet we are using a Language model (en_core_web_sm)

  1. Download the model using the command python -m spacy download en_core_web_sm .
  2. paste it in your terminal and download it.


Check the user's spacy version using pip show spacy command in users terminal.

  1. if its version 3.0, you will need to load it using nlp = spacy.load("en_core_web_sm")
  2. if its version is less than 3.0 you will need to load it using nlp = spacy.load("en")


Environment Tested

I tested this solution in the following versions. Be mindful of changes when working with other versions.


  1. The solution is created in Python 3.7.15 Version
  2. The solution is tested on Spacy 3.4.3 Version


Using this solution, we can collect the complete sentence that user need with the help of function in spacy . This process also facilities an easy to use, hassle free method to create a hands-on working version of code which would help us collect the sentence or keywords the user needs in python.

Dependent Library

spaCyby explosion

Python doticonstar image 26205 doticonVersion:v3.5.3doticon
License: Permissive (MIT)

💫 Industrial-strength Natural Language Processing (NLP) in Python

Support
    Quality
      Security
        License
          Reuse

            spaCyby explosion

            Python doticon star image 26205 doticonVersion:v3.5.3doticon License: Permissive (MIT)

            💫 Industrial-strength Natural Language Processing (NLP) in Python
            Support
              Quality
                Security
                  License
                    Reuse

                      If you do not have SpaCy that is required to run this code, you can install it by clicking on the above link and copying the pip Install command from the Spacy page in kandi.

                      You can search for any dependent library on kandi like SpaCy

                      Support

                      1. For any support on kandi solution kits, please use the chat
                      2. For further learning resources, visit the Open Weaver Community learning page

                      See similar Kits and Libraries

                      Open Weaver – Develop Applications Faster with Open Source

                      kandi

                      Community and Support

                      Company

                      Follow

                      • © 2023 Open Weaver Inc.