Convert the case of tokens

tokens_tolower() and tokens_toupper() convert the features of a tokens object and re-index the types.

tokens_tolower(x, keep_acronyms = FALSE)

tokens_toupper(x)

Arguments

x

the input object whose character/tokens/feature elements will be case-converted

keep_acronyms

logical; if TRUE, do not lowercase any all-uppercase words (applies only to *_tolower() functions)

Examples

# for a document-feature matrix
toks <- tokens(c(txt1 = "b A A", txt2 = "C C a b B"))
tokens_tolower(toks)
#> Tokens consisting of 2 documents.
#> txt1 :
#> [1] "b" "a" "a"
#> 
#> txt2 :
#> [1] "c" "c" "a" "b" "b"
#> 
tokens_toupper(toks)
#> Tokens consisting of 2 documents.
#> txt1 :
#> [1] "B" "A" "A"
#> 
#> txt2 :
#> [1] "C" "C" "A" "B" "B"
#>