
	Where results make sense

Topic: Lexer

In the News (Sun 27 Dec 09)

Northern Trust

Marvin Harrison

Peter Chernin

Gary Locke

Match Play

Penelope Cruz

Mickey Rourke

AR Rahman

Danny Boyle

Hugh Jackman

	Lexical analysis - Wikipedia, the free encyclopedia
		Lexical analysis is the process of taking an input string of characters (such as the source code of a computer program) and producing a sequence of symbols called "lexical tokens", or just "tokens", which may be handled more easily by a parser.
		It is not generally considered sufficient for applications with a complicated set of lexical rules and severe performance requirements; for instance, the GNU Compiler Collection uses hand-written lexers.
		Lecture notes that discuss parsers, lexers and scanners, in the context of parsing C++.
	en.wikipedia.org /wiki/Lexer (668 words)

	[No title]
		The lexer gets the character at position i using styler.SafeGetCharAt(i); The startPos and length parameters indicate the range of text to be recolored; the lexer must determine the proper color for all characters in positions startPos through startPos+length.
		The lexer code The task of a lexer can be summarized briefly: for each range r of characters that are to be colored the same, the lexer should call styler.ColourTo(i, state) where i is the position of the last character of the range r.
		The lexer should set the state variable to the coloring state of the character at position i and continue until the entire text has been colored.
	www.scintilla.org /Lexer.txt (1189 words)

	com.Ostermiller.Syntax.Lexer (Site not responding. Last check: 2007-09-18)
		A CToken is a token that is returned by a lexer that is lexing a C source file.
		A PlainToken is a token that is returned by a lexer that is lexing a plain text file.
		A SQLToken is a token that is returned by a lexer that is lexing an SQL source file.
	ostermiller.org /syntax/docs/com/Ostermiller/Syntax/Lexer/package-summary.html (162 words)

	Info: (cppinternals) Lexer (Site not responding. Last check: 2007-09-18)
		It is a hand-coded lexer, and not implemented as a state machine.
		The lexer does not make an initial pass to strip out trigraphs and escaped newlines, but handles them as they are encountered in a single pass of the input file.
		The lexer is written to treat each of `\r', `\n', `\r\n' and `\n\r' as a single new line indicator.
	www.cse.msu.edu /cgi-bin/info2html?(cppinternals)Lexer (2304 words)

	A lexer generator
		Lexer buffers are an abstract data type implemented in the library unit
		In general, a lexer must be able to handle all characters that can appear in the input.
		It is better to let the lexer scan keywords the same way as identifiers and then use an auxiliary function to distinguish between them.
	www.dina.kvl.dk /~sestoft/manual/node18.html (646 words)

	A lexical analyzer generator for Standard ML. Version 1.6.0, October 1994
		The lexer resolves conflicts among rules by choosing the rule with the longest match, and in the case two rules match the same string, choosing the rule listed first in the specification.
		The integer is the number of characters that the lexer wishes to read; the function may return any non-zero number of characters.
		The lexer tries to read a large number of characters from the input function at once, and it is desirable that the input function return as many as possible.
	www.smlnj.org /doc/ML-Lex/manual.html (2254 words)

	Indexing, 5 of 11 (Site not responding. Last check: 2007-09-18)
		Lexer for extracting tokens from text in languages, such as English and most western European languages that use white space delimited words.
		Any processing the lexer does to tokens before indexing (for example, removal of characters, and base-letter conversion) are also performed on query terms at query time.
		This lexer is supported for backward compatibility with older versions of Oracle Text that supported only this Korean lexer.
	www.ucs.louisiana.edu /~oracle9i/text.901/a90121/cdatadi5.htm (2264 words)

	Indexing, 5 of 11 (Site not responding. Last check: 2007-09-18)
		Use the lexer preference to specify the language of the text to be indexed.
		Lexer used for extracting tokens from text in languages, such as English and most western European languages that use single-byte character sets.
		Lexer used for indexing tables containing documents of different languages.
	www.usd.edu /oracle/doc/inter.817/a77063/cdatadi5.htm (1581 words)

	PyLR maual (Site not responding. Last check: 2007-09-18)
		There is an 'engine' which takes the output of the lexer and triggers the back end of parsing.
		The one time it's common to use the flags is when you want the lexer to match something but not return anything until the next match.
		Those values are either the value returned by the lexer, if the symbol is terminal, or a value returned by one of these special methods, if the symbol is a nonterminal.
	starship.python.net /crew/scott/manual.html (1418 words)

	The Lexer Interface (Site not responding. Last check: 2007-09-18)
		It is an abstract base class, which allows to abstract the lexer itself from the other parts of the library.
		This lexer object is expected to have a constructor taking three parameters: the begin and end iterators of the underlying input stream to analyse and the file_position of the point in the input stream, which corresponds to the first of the given iterators.
		It specifies the token type to be returned by the actual C++ lexer.
	spirit.sourceforge.net /distrib/spirit_1_7_0/wave/doc/class_reference_lexer.html (503 words)

	Lexer and parser generators (ocamllex, ocamlyacc)
		Lexer buffers are an abstract data type implemented in the standard library module
		Parsing functions take as arguments a lexical analyzer (a function from lexer buffers to tokens) and a lexer buffer, and return the semantic attribute of the corresponding entry point.
		This is commonly caused by lexer definitions that have separate rules for each of the alphabetic keywords of the language, as in the following example.
	caml.inria.fr /pub/docs/manual-ocaml/manual026.html (2226 words)

	lexer : Java Glossary
		The first part is the job of the lexer, the second of the parser.
		The most famous lexer is LEX which came with early versions of Unix.
		Lexers can also be used to implement finite state automata.
	mindprod.com /jgloss/lexer.html (159 words)

	Cached.net - The place to get 0wned. (Site not responding. Last check: 2007-09-18)
		After that, LeXer took advantage of his stacked health, armor and weapons, and continued to rout Daler around the map, either spawn fragging him or attacking him from behind.
		LeXer's rail was literally close to perfect for the first few minutes, and every shot seemed to chip away at Daler's chance at a comeback.
		LeXer tried to do what he did in the early game, chasing him around the map, using rocket jumps to his advantage to be where Daler would not expect him to be.
	www.cached.net /?go=main/eventcoverage/single/943 (1630 words)

	Paul's 8051 Code Library, Fixed String Lexer
		This simple fixed string lexer searches for any number of fixed strings of any length (with some limitations) in a stream of characters.
		The most likely use for this simple lexer is an 8051 based system which receives commands from a computer, probably while performing other tasks.
		This lexer allows you to easily implement several multiple character command words in your project/product.
	www.pjrc.com /tech/8051/lexer-fixed-string.html (256 words)

	Lexer (IntelliJ IDEA Open API)
		Restores the lexer to the specified state and position.
		Internal lexer state is supposed to be initial.
		This method is used to incrementally relex changed characters using lexing data acquired from this particular lexer sometime in the past.
	www.jetbrains.com /idea/openapi/5.0/com/intellij/lexer/Lexer.html (260 words)

	CYBERFIGHT.ORG / Demos @ Cyberfight.ru
		Lexer won it too early, made half the demo a walk in the park.
		LeXer loaded up lightning, mega, rockets and red armor, then he hustled over to the round wall under the rail walkway.
		To finish, LeXer pulls the machine gun and with two pellets, the first frag is his and he practically tears off to get in position for his next play.
	www.cyberfight.org /site/demos/4381 (860 words)

	CTX_DDL Package, 10 of 28 (Site not responding. Last check: 2007-09-18)
		A lexer for default must be defined before the multi-lexer can be used in an index.
		The sub-lexer preference must not be a multi-lexer lexer.
		Specify DEFAULT to assign a default sub-lexer to use when the value of the language column in the base table is null, invalid, or unmapped to a sub-lexer.
	www.ucs.louisiana.edu /~oracle9i/text.901/a90121/cddlpk10.htm (396 words)

	Language Implemtation Tools - make-lexer (Site not responding. Last check: 2007-09-18)
		A lexer is built from a specification that consists of regexps and actions.
		The return value of the procedure is returned from the lexer.
		The rule that longest matches may be overrided for a particular type of lexeme by putting the keyword :shortest after the action in the lexer specification.
	ofb.net /gnu/guile/lang_9.html (280 words)

	ToHTML (Site not responding. Last check: 2007-09-18)
		Write the html version of the output from the given lexer as a stand alone html document with the given title.
		The type of syntax highlighting done will be determined first by the class name for the lexer, then by the mime type, then by the file extension.
		If a lexer is explicitly given, it is used, otherwise if the mime type is recognized, an appropriate style for that mime type is used, otherwise if the file extension is recognized, an appropriate style for that extension is used, otherwise, no style is given.
	ostermiller.org /syntax/docs/com/Ostermiller/Syntax/ToHTML.html (2334 words)

	The Mason Book
		In this chapter we'll discuss four of the persistent objects in the Mason framework: the Interpreter, Resolver, Lexer, and Compiler.
		The Lexer is responsible for actually processing the component source code and finding the Mason directives within it.
		By the way, you may be wondering why the Lexer isn't called a Parser, since its main job seems to be to parse the source of a component.
	www.masonbook.com /book/chapter-6.mhtml (3344 words)

	CYBERFIGHT.ORG / News / M19*LeXeR: I'm ready at 60-70% @ Cyberfight.ru
		As you already know, LeXeR is already in New-York and after a while he'll have nice trip to Texas in order to defend his QuakeCon 2002 Winner Title at QC2003, not an easy task, but we wish LeXeR best of luck and victory of course.
		LeXeR: Hey man, my mood is amazing since I spend really nice time with my uncle, we ridein his car among New-York, listen to hip-hop to the max, drink Hennesey.
		LeXeR: I think I'm ready at 60-70%, not much, but I hope it will be enough.
	cyberfight.org /site/news/17897 (300 words)

	REGEX/CLAWK/LEXER Packages
		This is a tar file containing the REGEX, CLAWK, and LEXER packages, as well as some test code.
		It produces lexers that are compatible with the parsers produced with Xanalys's DEFPARSER macro.
		The LEXER package implements a lexical-analyzer-generator called DEFLEXER, which is built on top of both REGEX and CLAWK.
	www.geocities.com /mparker762/clawk.html (2674 words)

	Lexer Project Specification
		EOF in string literal, when the lexer encounters the end of file during the processing of a string literal.
		Note that the lexer should attempt to process all files on the command line, even if one or more of them fail to open.
		For the last three cases, both the INCLUDE and the offending token are discarded, and the lexer should continue looking for a valid token.
	www-cse.ucsd.edu /classes/fa00/cse131a/lexer.htm (1101 words)

	JavaScript 2.0 Lexer
		See the stages and lexer semantics sections in the formal description chapter for the details.
		The lexer recognizes several nonreserved words that have special meanings in some contexts but can be used as identifiers.
		When a numeric literal is be immediately followed by an optional underscore and an identifier, the lexer drops the underscore if it is present and converts the identifier to a string literal.
	www.mozilla.org /js/language/js20-2000-07/core/lexer.html (544 words)

	Entropy Overload
		The lexer's job is to split the input into discrete lumps of text, with each lump annotated with kind, such as IDENTIFIER, NUMBER or PLUS.
		Another part of the lexer's job is to ignore whitespace and comments.
		The factor rule eats the INTEGER token from the lexer, causing the lexer to move on to the next token (PLUS), and returns to the expression rule.
	barrkel.blogspot.com (1744 words)

	Lojban Reference Grammar: Chapter 21
		The strings of tokens to be labelled with lexer tokens are found in rule terminals labelled with numbers between 900 and 1099.
		Two sets of lexer tokens are defined in the token set so as to be compatible with either option.
		Order of inserting lexer tokens IS significant, since some shorter strings that would be marked with a lexer token may be found inside longer strings.
	www.lojban.org /files/reference-grammar/chap21.html (4039 words)

	Elkhound Tutorial
		The lexer interface includes functions that return information about the tokens, mainly to assist in debugging.
		Specifically, we wrap the lexer with a version that just yields the nonterminal name, and substitute the given actions with actions that build a parse tree.
		The only slightly tricky part is that we deallocate the strings allocated by the lexer when they are consumed.
	www.cs.berkeley.edu /~smcpeak/elkhound/sources/elkhound/tutorial.html (3970 words)

	LablGTK : Xml_lexer
		The lexer altogether ignores the following 'events': comments, processing instructions, XML prolog and doctype declaration.
		Internal entities declarations are not taken into account (the lexer just skips the doctype declaration).
		This exception is raised in case of an error during the parsing.
	oandrieu.nerim.net /ocaml/lablgtk/doc/Xml_lexer.html (132 words)

	[No title]
		* User-defined lexer class members: These are the member declarations that you defined for your class: * End of user-defined lexer class members *** String literals used in the parser The following string literals were used in the parser.
		An actual code generator would arrange to place these literals into a table in the generated lexer, so that actions in the generated lexer could match token text against the literals.
		String literals used in the lexer are not listed here, as they are incorporated into the mainstream lexer processing.
	www.antlr.org /grammar/multiParser/SimpleLexer.txt (881 words)

	3.2 pyggy.lexer - The lexing engine
		is returned by the lexer whenever a character is encountered which cannot be lexed.
		The lexer class provides an extensible lexer class capable of lexing tokens from an input source based on tables generated by PyLly.
		The class can be subclassed to provide lexers with different input behaviors.
	www.lava.net /~newsham/pyggy/html/module-pyggy.lexer.html (212 words)

	A Lexer for Haskell in Haskell
		If so, the DFA produced by a lexer generator could be much smaller.
		Generate the lexer from a specification that is as close as possible to the specification in the Haskell 98 Report.
		This turned out to be useful when reusing the lexer in an Haskell-to-HTML converter.
	www.cse.ogi.edu /~hallgren/Talks/LHiH/2002-01-14.html (594 words)

Try your search on: Qwika (all wikis)