token2index

A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and Tensorflow.

GPL-3.0 License

Downloads
38
Stars
49
Committers
1
View Code on GitHub Visit Website View on X
Ecosystems: NumPy, Python, PyTorch, Tensorflow

Commit Statistics

Past Year

All Time

Total Commits
109
Total Committers
1
Avg. Commits Per Committer
109.0
Bot Commits
0

Issue Statistics

Past Year

All Time

Total Pull Requests
0
5
Merged Pull Requests
0
4
Total Issues
0
1
Time to Close Issues
N/A
1 day
Package Rankings
Top 20.22% on Pypi.org
Badges
Extracted from project README
Build Documentation Status Coverage Status Compatibility License: GPL v3 Code style: black
Related Projects
ttok

Count and truncate text based on tokens

18 May 2023 263
text-to-text-transfer-transformer

Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transfo...

17 Oct 2019 5,931
tablite

multiprocessing enabled out-of-memory data analysis library for tabular data.

27 Jun 2020 36
tslearn

The machine learning toolkit for time series analysis in Python

04 May 2017 2,853
TensorflowLite-UNet

Implementation of UNet by Tensorflow Lite. Semantic segmentation without using GPU with Raspberry...

18 Oct 2018 78
ignite

High-level library to help with training and evaluating neural networks in PyTorch flexibly and t...

23 Nov 2017 4,484
TensorLayer

Deep Learning and Reinforcement Learning Library for Scientists and Engineers

07 Jun 2016 7,302
tensorly

TensorLy: Tensor Learning in Python.

21 Oct 2016 1,504
pytorch-widedeep

A flexible package for multimodal-deep-learning to combine tabular data with text and images usin...

21 Oct 2017 1,243
TensorLayerX

TensorLayerX: A Unified Deep Learning and Reinforcement Learning Framework for All Hardwares, Bac...

03 Dec 2021 537
LexicalRichness

A module to compute textual lexical richness (aka lexical diversity).

09 May 2018 90
accelerate

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed conf...

30 Oct 2020 7,759
ktrain

ktrain is a Python library that makes deep learning and AI more accessible and easier to apply

06 Feb 2019 1,226