|
⇤ ← Revision 1 as of 2023-10-28 03:05:47
Size: 623
Comment:
|
Size: 686
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 1: | Line 1: |
| ## page was renamed from NaturalLanguageProcessing/BagOfWords |
Bag of Words
A bag of words model is essentially counting words per document.
Contents
Data Structure
Rows are documents and columns are words or phrases. Inevitably this is a sparse matrix.
Implementation
First the words and phrases across all documents must be tokenized.
Next, the count of each key word/phase is extracted from each document.
Finally, the output matrix must be interpretted. Semantic meaning is lost so care must be taken to ensure that sourced documents have a common context.