Differences between revisions 5 and 6
⇤ ← Revision 5 as of 2025-01-10 16:19:06 →
Size: 629
Editor: DominicRicottone
Comment: Killing NaturalLanguageProcessing page
← Revision 6 as of 2025-01-10 16:19:13 → ⇥
Size: 628
Editor: DominicRicottone
Comment: Typo
Deletions are marked like this. Additions are marked like this.
Line 25: Line 25:
Finally, the output matrix must be interpretted. Semantic meaning is lost so care must be taken to ensure that sourced documents have a common context. Finally, the output matrix must be interpreted. Semantic meaning is lost so care must be taken to ensure that sourced documents have a common context.

Bag of Words Model

A bag of words model is essentially counting words per document.

Contents

  1. Bag of Words Model
    1. Data Structure
    2. Implementation

Data Structure

Rows are documents and columns are words or phrases. Inevitably this is a sparse matrix.

Implementation

First the words and phrases across all documents must be tokenized.

Next, the count of each key word/phase is extracted from each document.

Finally, the output matrix must be interpreted. Semantic meaning is lost so care must be taken to ensure that sourced documents have a common context.

CategoryRicottone

Statistics/BagOfWordsModel (last edited 2025-01-10 16:19:13 by DominicRicottone)