JapaneseTokenizers

aim to use JapaneseTokenizer as easy as possible

MIT License

Downloads
995
Stars
138
Committers
4
View Code on GitHub
Ecosystems: Python

Commit Statistics

Past Year

All Time

Total Commits
127
Total Committers
4
Avg. Commits Per Committer
31.75
Bot Commits
0

Issue Statistics

Past Year

All Time

Total Pull Requests
0
28
Merged Pull Requests
0
28
Total Issues
0
34
Time to Close Issues
N/A
2 months
Package Rankings
Top 12.62% on Pypi.org
Badges
Extracted from project README
MIT License
Related Projects
janome

Japanese morphological analysis engine written in pure Python

14 Feb 2015 852
python-boilerplate

Python boilerplate using uv, pre-commit, prettier, pytest, GitHub Actions, mypy, ruff, bandit & d...

16 Jun 2022 52
conformal-tights

👖 Conformal Tights adds conformal prediction of coherent quantiles and intervals to any scikit-le...

01 Mar 2024 82
minbpe

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

16 Feb 2024 9,074
spacy-js

🎀 JavaScript API for spaCy with Python REST API

25 Oct 2018 186
pnlp

NLP预/后处理工具。

18 Apr 2019 29
ml-workspace

🛠 All-in-one web-based IDE specialized for machine learning and data science.

27 May 2019 3,406
python-template

Python project and library template for clean, reliable, open-source projects.

12 May 2022 266
JumpStart

A lean web application template with FastAPI, Uvicorn, Docker, and GitHub Actions.

05 Feb 2024 72
class-resolver

🔍 Lookup classes and instantiate them with style

02 Mar 2021 62
pypackage-template

A project template for Python package with heavy use of Github actions

14 Jun 2020 53
xontrib-argcomplete

Argcomplete support to tab completion of python and xonsh scripts in xonsh shell.

07 Sep 2020 27
mecab-text-cleaner

Simple Python package (CLI/Python API) for getting japanese readings (yomigana) and accents using...

01 Sep 2023 4
augtxt

yet another text augmentation python package

22 Nov 2020 2
kshingle

Split strings into (character-based) k-shingles

02 Dec 2020 4