TextAnalyzer

Step 1: Setting Up Your Environment

Make sure you have Python installed. You can use any text editor or IDE (like VSCode, PyCharm, or even Jupyter Notebook).

Step 2: Install Required Libraries

For our text analyzer, we will use the nltk library for natural language processing. You can install it using pip:

pip install nltk

You may also need to download some additional resources:

import nltk
nltk.download('punkt')

Step 3: Create the Text Analyzer

Here’s a simple implementation of a text analyzer:

import nltk
from nltk.tokenize import word_tokenize, sent_tokenize
from collections import Counter
import string

class TextAnalyzer:
    def __init__(self, text):
        self.text = text
        self.words = word_tokenize(text)
        self.sentences = sent_tokenize(text)
        
    def word_count(self):
        return len(self.words)

    def sentence_count(self):
        return len(self.sentences)

    def frequency_distribution(self):
        # Remove punctuation and convert to lower case
        cleaned_words = [word.lower() for word in self.words if word not in string.punctuation]
        return Counter(cleaned_words)

    def analyze(self):
        analysis = {
            'word_count': self.word_count(),
            'sentence_count': self.sentence_count(),
            'frequency_distribution': self.frequency_distribution()
        }
        return analysis

# Example usage
if __name__ == "__main__":
    text = """This is a simple text analyzer. It analyzes text and provides word and sentence counts, as well as word frequency."""
    
    analyzer = TextAnalyzer(text)
    analysis_results = analyzer.analyze()
    
    print("Word Count:", analysis_results['word_count'])
    print("Sentence Count:", analysis_results['sentence_count'])
    print("Word Frequency Distribution:", analysis_results['frequency_distribution'])

Step 4: Running the Analyzer

1. Save the code to a file named text_analyzer.py.
2. Run the script using:

python text_analyzer.py

Explanation of the Code

• TextAnalyzer Class: The main class for analyzing text.
  • __init__: Initializes the object with the provided text and tokenizes it into words and sentences.
  • word_count: Returns the number of words in the text.
  • sentence_count: Returns the number of sentences in the text.
  • frequency_distribution: Returns the frequency of each word, excluding punctuation and in lowercase.
  • analyze: Compiles all the analysis results into a dictionary.

Step 5: Customize and Expand

You can enhance the analyzer by adding features such as:

• Removing stop words.
• Analyzing character frequency.
• Visualizing results using libraries like Matplotlib or Seaborn.