CFA Level I · CFA Level I Exam · Introduction to Financial Data Science
In text preprocessing, converting the tokens "earnings", "earned" and "earning" to a single base form "earn" by using a crude rule-based removal of suffixes is most likely:
This is stemming. Stemming applies rule-based suffix stripping to reduce related word forms to a common root, which may not be a proper word. Tokenization only splits text into units, and bag-of-words only records token counts, so neither reduces the variants to one form.
- AstemmingCorrect
- Btokenization
- Cbag-of-words representation
Explanation
Stemming chops affixes using rules to reach a common root, and the result may not be a real word. Tokenization splits text into tokens, and bag-of-words counts token occurrences in a document without any word reduction.
Did you get it right without looking?
One question tells you little. A timed set on Introduction to Financial Data Science shows your real accuracy, how long you take and where you lose marks.
More Introduction to Financial Data Science questions
- An analyst's dataset of customer incomes contains several extreme values far above the rest, and the analyst wants to reduce the influence o…
- An analyst applies a clustering algorithm to the return histories of 500 stocks to find groups that behave similarly, without predefining an…
- An analyst builds a bag-of-words document term matrix from 2,000 corporate disclosures to predict whether a firm will cut its dividend. Comp…
- An analyst prepares text data from company filings for a model and removes common words such as 'the', 'and', and 'of' before counting word …
- A data scientist converts a column of text analyst comments into numerical features that a machine learning model can use. Which step in tex…
- An analyst collects a dataset containing each firm's credit rating (AAA, AA, A, BBB), where the ratings have a clear ranking but the gaps be…