help@rskworld.in +91 93305 39277
RSK World
  • Home
  • Development
    • Web Development
    • Mobile Apps
    • Software
    • Games
    • Project
  • Technologies
    • Data Science
    • AI Development
    • Cloud Development
    • Blockchain
    • Cyber Security
    • Dev Tools
    • Testing Tools
  • Blog
  • About
  • Contact

Theme Settings

Color Scheme
Display Options
Font Size
100%
Back to Project
RSK World
nlp-text-analysis-bot
RSK World
nlp-text-analysis-bot
NLP Text Analysis Bot - Python + NLP + Flask + Machine Learning + Text Analysis + AI
nlp-text-analysis-bot
  • static
  • templates
  • .gitignore393 B
  • ADVANCED_FEATURES.md5.4 KB
  • CHANGELOG.md1.3 KB
  • FINAL_CHECK.md4.6 KB
  • GITHUB_RELEASE_INSTRUCTIONS.md4.1 KB
  • LICENSE1.2 KB
  • PROJECT_INFO.md2.7 KB
  • PROJECT_STATUS.md4 KB
  • QUICKSTART.md3.1 KB
  • README.md5.8 KB
  • RELEASE_NOTES.md3.8 KB
  • advanced_keywords.py3.9 KB
  • app.py3 KB
  • config.py668 B
  • emotion_detection.py4.3 KB
  • entity_recognition.py3 KB
  • example_usage.py2.7 KB
  • install.bat853 B
  • install.sh808 B
  • language_detection.py2.7 KB
  • nlp_pipeline.py7.1 KB
  • pos_tagging.py2.9 KB
  • readability_analysis.py3.5 KB
  • requirements.txt334 B
  • semantic_understanding.py4 KB
  • sentiment_analysis.py3.9 KB
  • setup.py1.4 KB
  • test_analysis.py2.5 KB
  • text_classification.py5 KB
  • text_preprocessing.py4.2 KB
  • text_similarity.py4.1 KB
  • text_summarization.py5 KB
  • validate_project.py4.2 KB
test_chatbot.pytext_summarization.py
text_summarization.py
Raw Download
Find: Go to:
"""
Text Summarization Module
Provides extractive and abstractive text summarization

Developer: RSK World
Website: https://rskworld.in
Email: help@rskworld.in
Phone: +91 93305 39277
Year: 2026
"""

from transformers import pipeline
from nltk.tokenize import sent_tokenize
import re

class TextSummarizer:
    """
    Text summarization class using multiple methods
    Developer: RSK World - https://rskworld.in
    """
    
    def __init__(self):
        """Initialize summarization models"""
        try:
            # Abstractive summarization model
            self.abstractive_summarizer = pipeline(
                "summarization",
                model="facebook/bart-large-cnn",
                device=-1  # Use CPU
            )
        except Exception as e:
            print(f"Warning: Could not load abstractive summarizer: {e}")
            self.abstractive_summarizer = None
    
    def extractive_summarize(self, text, num_sentences=3):
        """
        Extractive summarization using sentence scoring
        
        Args:
            text (str): Input text
            num_sentences (int): Number of sentences in summary
            
        Returns:
            str: Extracted summary
        """
        sentences = sent_tokenize(text)
        
        if len(sentences) <= num_sentences:
            return ' '.join(sentences)
        
        # Simple scoring based on word frequency
        words = text.lower().split()
        word_freq = {}
        for word in words:
            if word.isalnum():
                word_freq[word] = word_freq.get(word, 0) + 1
        
        # Score sentences
        sentence_scores = {}
        for sentence in sentences:
            sentence_words = sentence.lower().split()
            score = sum(word_freq.get(word, 0) for word in sentence_words if word.isalnum())
            sentence_scores[sentence] = score
        
        # Get top sentences
        sorted_sentences = sorted(sentence_scores.items(), key=lambda x: x[1], reverse=True)
        summary_sentences = [sent for sent, score in sorted_sentences[:num_sentences]]
        
        # Maintain original order
        summary = []
        for sentence in sentences:
            if sentence in summary_sentences:
                summary.append(sentence)
                if len(summary) >= num_sentences:
                    break
        
        return ' '.join(summary)
    
    def abstractive_summarize(self, text, max_length=130, min_length=30):
        """
        Abstractive summarization using transformer model
        
        Args:
            text (str): Input text
            max_length (int): Maximum summary length
            min_length (int): Minimum summary length
            
        Returns:
            str: Generated summary or None
        """
        if self.abstractive_summarizer is None:
            return None
        
        try:
            # Truncate if too long (model limit is 1024 tokens)
            max_input_length = 1024
            if len(text) > max_input_length:
                text = text[:max_input_length]
            
            result = self.abstractive_summarizer(
                text,
                max_length=max_length,
                min_length=min_length,
                do_sample=False
            )
            
            return result[0]['summary_text']
        except Exception as e:
            print(f"Error in abstractive summarization: {e}")
            return None
    
    def summarize(self, text, method='extractive', num_sentences=3):
        """
        Summarize text using specified method
        
        Args:
            text (str): Input text
            method (str): 'extractive' or 'abstractive'
            num_sentences (int): Number of sentences for extractive
            
        Returns:
            dict: Summary results
        """
        result = {
            'method': method,
            'original_length': len(text),
            'summary': None
        }
        
        if method == 'extractive':
            summary = self.extractive_summarize(text, num_sentences)
            result['summary'] = summary
            result['summary_length'] = len(summary)
            result['compression_ratio'] = len(summary) / len(text) if text else 0
        elif method == 'abstractive':
            summary = self.abstractive_summarize(text)
            if summary:
                result['summary'] = summary
                result['summary_length'] = len(summary)
                result['compression_ratio'] = len(summary) / len(text) if text else 0
            else:
                # Fallback to extractive
                result['method'] = 'extractive (fallback)'
                summary = self.extractive_summarize(text, num_sentences)
                result['summary'] = summary
                result['summary_length'] = len(summary)
                result['compression_ratio'] = len(summary) / len(text) if text else 0
        
        return result

151 lines•5 KB
python
🚀 Support RSK World

Subscribe to our YouTube channel for latest tutorials & updates!



Click subscribe & support our work ❤️

About RSK World

Founded by Molla Samser, with Designer & Tester Rima Khatun, RSK World is your one-stop destination for free programming resources, source code, and development tools.

Founder: Molla Samser
Designer & Tester: Rima Khatun

Development

  • Game Development
  • Web Development
  • Mobile Development
  • AI Development
  • Development Tools

Legal

  • Terms & Conditions
  • Privacy Policy
  • Disclaimer

Contact Info

Nutanhat, Mongolkote
Purba Burdwan, West Bengal
India, 713147

+91 93305 39277

hello@rskworld.in
support@rskworld.in

© 2026 RSK World. All rights reserved.

Content used for educational purposes only. View Disclaimer