Contents    Page-10    Prev    Next    Page+10    Index   

Lexical Analyzer

The Lexical Analyzer (or Lexer) will convert characters into ``words'' or tokens, such as:

The Lexical Analyzer may be called as a subroutine such as gettoken() to get the next token from the input string. It, in turn, calls the Line Handler routines.

The Lexical Analyzer returns a token data structure, consisting of: