3. Explain the following terms in detail :

i) Tokens

ii) Pattern

iii) Lexemes

iv) Sentinels

v) Sentential foam