Token frequency

The type–token distinction separates types (abstract descriptive concepts) from tokens (objects that instantiate concepts) . For example: “bicycle” represents a type: the concept of a bicycle; whereas “my bicycle” represents a token of that type: an object that instantiates that type.

Tokens that reside on blockchains include reward tokens, currency tokens, utility tokens, security tokens, and asset tokens .

Type and token frequency are seen from the lexical vantage point, i.e. type frequency counts the number of words containing a particular phonological unit while token frequency records the frequency of occurrence of these words .

The term “token” refers to the total number of words in a text, corpus etc, regardless of how often they are repeated. The term “type” refers to the number of distinct words in a text, corpus etc.4 Kas 2015