Skip to content

Add streaming text validation - #16

Merged
andrew merged 1 commit into
mainfrom
feat/streaming-text-validation
Oct 1, 2026
Merged

andrew merged 1 commit into
mainfrom
feat/streaming-text-validation

Conversation

@andrew

@andrew andrew commented Oct 1, 2026

Copy link
Copy Markdown
Contributor

Add TextValidator for validating text as it is read, using fixed memory and handling UTF-8, UTF-16 and UTF-32 sequences split across chunks. Its io.Writer interface works with io.Copy; Result(Options) applies complete-file or prefix validation and control-character policy to a snapshot.

DetectWithOptions shares the same text validator. Format and MIME detection continue through the existing detection APIs.

@andrew
andrew force-pushed the feat/streaming-text-validation branch from ae87b02 to 3dfe84d Compare October 1, 2026 14:28
@andrew
andrew merged commit f82631d into main Oct 1, 2026
7 checks passed
@andrew
andrew deleted the feat/streaming-text-validation branch October 1, 2026 14:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant