[/==============================================================================
    Copyright (C) 2001-2011 Joel de Guzman
    Copyright (C) 2001-2011 Hartmut Kaiser

    Distributed under the Boost Software License, Version 1.0. (See accompanying
    file LICENSE_1_0.txt or copy at http://www.boost.org/LICENSE_1_0.txt)
===============================================================================/]

[section:lexer_primitives Lexer Primitives]

[/ Describe the primitive lexer constructs, such as token_def, lexer ]

[/ Describe the primitive lexer constructs usable in parsers, such as 
   in_state[], set_state(), token(), tokenid(), etc. ]

[endsect]