Tokenizer | VS Code Extension Ecosystem Directory

Bot releases are visible (Hide)

Tokenizer - Microsoft.DeepDev.TokenizerLib 1.3.3 Release Latest Release

Published by shengyfu 9 months ago

You can find the published NuGet package here.
You can find the Tokenizer.exe in the attached Tokenizer.zip.
To run performance benchmark, you can download the attached PerfBenchmark.zip.

Tokenizer - Microsoft.DeepDev.TokenizerLib 1.3.2 Release

Published by shengyfu over 1 year ago

You can find the published NuGet package here.
You can find the Tokenizer.exe in the attached Tokenizer_1.3.2.zip.
To run performance benchmark, you can download the attached PerfBenchmark_1.3.2.zip.

Tokenizer - Microsoft.DeepDev.TokenizerLib 1.3.1 release.

Published by shengyfu over 1 year ago

You can find the published NuGet package here.
You can find the Tokenizer.exe in the attached Tokenizer_1.3.1.zip.
To run performance benchmark, you can download the attached PerfBenchmark_1.3.1.zip.

Tokenizer - Microsoft.DeepDev.TokenizerLib 1.3.0 open source release.

Published by shengyfu over 1 year ago

You can find the published NuGet package here.
You can find the Tokenizer.exe in the attached Tokenizer_1.3.0.zip.
To run performance benchmark, you can download the attached PerfBenchmark_1.3.0.zip.