Remove Stopwords From Text

This agent ingests text and removes stopwords from it, then returns the cleaned text.

The stopword list is a combination of the spaCy and NLTK libraries, covering common short words like 'a', 'and', etc. Removing these words is important for NLP and textual analysis as they provide little semantic value while consuming tokens and costing $$$.

The agent also removes extraneous content including HTML elements and JS code.

The text is normalized by removing duplicate spaces and standardizing spacing between words while preserving the basic structure of sentences.

Input text has a character limit of 75k (roughly 13k-15k words).