Separate dictionary values using tokenizer

Apply tokens() to dictionary values to improve pattern matching.

Usage

tokenize_dictionary(dictionary, ...)

Arguments

dictionary

a dictionary object.

...

passed to tokens().