Get unique types of tokens from a tokens object.

types(x)

Arguments

x

a tokens object

See also

Examples

toks <- tokens(data_corpus_inaugural)
head(types(toks), 20)
#>  [1] "Fellow-Citizens" "of"              "the"             "Senate"         
#>  [5] "and"             "House"           "Representatives" ":"              
#>  [9] "Among"           "vicissitudes"    "incident"        "to"             
#> [13] "life"            "no"              "event"           "could"          
#> [17] "have"            "filled"          "me"              "with"