Package dev.omnist.schema

Class OsdLexer

java.lang.Object

dev.omnist.schema.OsdLexer

public class OsdLexer
extends Object

Tokenizer for OSD (Omnist Schema Definition) grammar (omnist-spec §5.3).

Recognizes four lexical rules in priority order:

1. STRING — a double-quoted field name ("label")
2. CARDINALITY — a bracket-enclosed cardinality expression ([m,n])
3. Punctuation — { } : , ?
4. IDENT / Keywords — record, root, or any other identifier

Whitespace, newlines, and #-comments are silently skipped between tokens.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static final record	OsdLexer.Token	An individual token produced by OsdLexer.
static enum	OsdLexer.TokenType	Token types produced by the OSD lexer (omnist-spec §5.3).

Constructor Summary

Constructors

Constructor	Description
OsdLexer(String source)	Constructs a lexer for the given OSD source text.

Method Summary

Modifier and Type	Method	Description
OsdLexer.Token	nextToken()	Scans and returns the next token, advancing the lexer position.
List<OsdLexer.Token>	tokenizeAll()	Tokenizes the entire source, returning a list ending with a single OsdLexer.TokenType.EOF token.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

OsdLexer

public OsdLexer(String source)

Constructs a lexer for the given OSD source text.

Parameters:

source - the OSD text to tokenize; null is treated as an empty string

Method Details

tokenizeAll

public List<OsdLexer.Token> tokenizeAll()

Tokenizes the entire source, returning a list ending with a single OsdLexer.TokenType.EOF token.

Returns:

the complete token list, never empty (always contains at least EOF)

Throws:

OsdParseException - if any lexical error is encountered

nextToken

public OsdLexer.Token nextToken()

Scans and returns the next token, advancing the lexer position. Whitespace, newlines, and #-to-end-of-line comments are skipped first.

Returns:

the next OsdLexer.Token; OsdLexer.TokenType.EOF at end of input

Throws:

OsdParseException - if no rule matches the current character