lexical analysis in Japanese
lexical analysis in Japanese
字句解析
(computer science) The conversion of a stream of characters to a stream of meaningful tokens; normally to simplify parsing.