Skip to main content

pd_cipher::crypto::token_classifier

Token classification system for determining token types. Token classification system for determining token types.

This module provides explicit classification of tokens into numeric or string types, replacing the anti-pattern of using parse failure as control flow.

Structs​

TokenClassifier​

Token classifier for determining token types.

pub struct TokenClassifier

Enums​

TokenType​

Represents the type of a token after classification.

pub enum TokenType {
    Numeric,
    String,
}