Skip to main content
Each strategy in the pipeline can be toggled, tuned, or replaced independently. This page summarizes every feature and links to its dedicated guide.

Feature Matrix

Note: Speed ratings are relative comparisons, not validated benchmarks. Actual performance depends on your dictionary size, hardware, and configuration.

Core Features

Syllable Validation

The foundation of mySpellChecker. Validates Myanmar syllable structure using orthographic rules and dictionary lookup. Key capabilities:
  • Rule-based syllable structure validation
  • Consonant-medial-vowel pattern checking
  • Dictionary syllable lookup
  • O(1) validation performance

Word Validation

Validates complete words using dictionary lookup and the SymSpell algorithm for efficient suggestion generation. Key capabilities:
  • Dictionary word lookup
  • SymSpell O(1) suggestions
  • Edit distance calculation
  • Compound word handling

Context Checking

Detects “real-word errors” where a word is spelled correctly but used incorrectly in context. Key capabilities:
  • Bigram probability analysis
  • Trigram context windows
  • Statistical language modeling
  • Real-word error detection

Advanced Features

POS Tagging

Part-of-Speech tagging with multiple backend options for different accuracy/speed trade-offs. Tagger options:

Grammar Checking

Rule-based syntactic validation using POS tags to detect grammatical errors. Key capabilities:
  • Particle usage validation
  • Verb-modifier agreement
  • Sentence structure checking
  • Custom grammar rule support

Grammar Engine

Comprehensive syntactic rule checker coordinating eight specialized checkers. Key capabilities:
  • Particle typo detection
  • Medial confusion detection (ျ vs ြ)
  • POS sequence validation
  • Verb-particle agreement
  • Configurable confidence thresholds

Semantic Checking

Deep learning-based context analysis using ONNX models for the highest accuracy. Key capabilities:
  • BERT/RoBERTa masked language modeling
  • Semantic context understanding
  • Confidence scoring
  • Quantized CPU inference

Performance Features

Batch Processing

Efficient processing of multiple texts with parallelization. Key capabilities:
  • Cython-optimized processing
  • OpenMP parallelization
  • Batch result aggregation
  • Memory-efficient streaming

Async API

Non-blocking async operations for web applications. Key capabilities:
  • Native async/await support
  • FastAPI/Starlette integration
  • Concurrent request handling
  • Async batch processing

Integration Features

Connection Pool

Thread-safe database connection management for high-concurrency scenarios. Key capabilities:
  • Configurable min/max pool size
  • Automatic connection health checks
  • Connection aging and recreation
  • Pool statistics and monitoring

Segmenters

Multiple text segmentation strategies for Myanmar text. Segmenter types:

Homophones Detection

Detects sound-alike words that may be confused in context.

Colloquial Variant Handling

Detects colloquial (informal) spellings and suggests standard forms. Key capabilities:
  • Colloquial form detection
  • Standard form suggestion
  • Configurable strictness levels
Configuration:

Internationalization (i18n)

Localized error messages in English and Myanmar.
Supported languages: "en" (English), "my" (Myanmar)

Streaming API

Memory-efficient stream processing for large documents with progress callbacks. Key capabilities:
  • Generator-based synchronous streaming
  • Async iteration support
  • Progress callbacks and statistics
  • Memory limits with backpressure
  • Cross-sentence context validation

Custom Providers

Pluggable storage backends for different use cases.

Feature Comparison by Use Case

Real-Time Typing

Document Checking

Quality Assurance

High-Volume Processing

Feature Dependencies

Legend:
  • Green: Core features (always available)
  • Blue: Advanced features (optional)
  • Purple: AI features (requires extra dependencies)

Text Processing Features

Named Entity Recognition

Identifies names, locations, and organizations to reduce false positives. Key capabilities:
  • Heuristic-based NER (fast, ~70% accuracy)
  • Transformer-based NER (~93% accuracy)
  • Hybrid mode with automatic fallback
  • Entity filtering for spell checking

Morphology Analysis

Word structure analysis for POS inference and OOV recovery. Key capabilities:
  • Suffix-based POS guessing
  • Word decomposition (root + suffixes)
  • Multi-POS support for ambiguous words
  • Numeral detection
  • Productive reduplication validation (AA, AABB, ABAB patterns)
  • Compound word synthesis (DP-based splitting into known morphemes)
  • Morpheme-level suggestions (correct typos inside compounds)

Text Utilities

Specialized utilities for Myanmar text processing. Key capabilities:
  • Stemmer: Rule-based suffix stripping with caching
  • Phonetic Hasher: Sound-based fuzzy matching
  • Tone Disambiguator: Context-based tone resolution
  • Zawgyi Detection: Legacy encoding detection

Grammar Features

Suggestion Ranking

Multi-factor ranking system for spelling suggestions. Ranker types:

Grammar Checkers

Eight specialized checkers for Myanmar grammar validation.

Text Normalization

Unified normalization service for consistent text processing. Key capabilities:
  • Purpose-specific normalization methods
  • Zawgyi detection and conversion
  • Unicode NFC normalization
  • Myanmar diacritic reordering

Validation Strategies

Strategy-based validation pipeline for composable error detection. Strategies (by priority):

Architecture

Dependency Injection

Lightweight DI system for component management. Key components:
  • ServiceContainer for lazy initialization
  • Factory functions for component creation
  • Singleton and transient service support
  • Thread-safe service resolution

Reference

Rules System

YAML configuration files for linguistic rules. Key files:
  • particles.yaml - 91 linguistic particles
  • typo_corrections.yaml - Common typo patterns
  • morphology.yaml - Suffix/prefix patterns
  • morphotactics.yaml - Compound word POS pattern rules
  • aspects.yaml - Verb aspect markers
  • classifiers.yaml - Numeral classifiers
  • register.yaml - Formal/colloquial mappings

Guides

Configuration Guide

Comprehensive configuration options. Topics:
  • SpellCheckerConfig and nested configs
  • Pre-defined configuration profiles
  • Loading from files and environment

Logging Guide

Centralized logging system. Features:
  • Development and production modes
  • JSON structured logging
  • Module-specific log levels
  • get_logger() for consistent naming

Training Features

Training Pipeline

End-to-end pipeline for training custom semantic models. Pipeline stages:
  1. Tokenizer Training (Byte-Level BPE)
  2. Model Training (RoBERTa/BERT MLM)
  3. ONNX Export (quantized)

Text Validation

Comprehensive Myanmar text quality validation with 30+ validation categories. Key capabilities:
  • Structural validation (syllable structure, encoding)
  • Zawgyi artifact detection
  • Quality filtering (fragments, truncation)
  • Known invalid word detection

Next Steps