fast-aug
is a library for fast text augmentation, available for both Rust and Python as fast-aug
.
It is designed with focus on performance and real-time usage (e.g. during training), while providing a wide range of text augmentation methods.
Please refer to respective READMEs for details:
rust
- see fast_aug/README.md;python
- see bindings/python/README.md.Flow
Text
Models and utils
Rust
Python
Clone the repository:
git clone [email protected]:k4black/fast-aug.git
cd fast-aug
For rust library development:
For python bindings development:
cd bindings/python && python -m venv .venv
pip >= 23.1
to use --config-settings
, see pip issue
The Makefile
contains all the commands needed for development.
make help
*-rust
- all targets related to rust library (fast_aug/
folder)*-python
- all targets related to python bindings (bindings/python/
folder)All text benchmarks are run on the tweet_eval dataset - sentiment task, test set, 12k rows.
cat test_data/tweet_eval_sentiment_test_text.txt | wc
12284 182576 1156877
This project and respective libraries are licensed under the MIT License - see the LICENSE file for details.