A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and Tensorflow.
python nlp deep-learning tensorflow numpy transformers pytorch indexing transformer rnn seq2seq deeplearning token rnns stoi w2i t2i itos i2t i2w
-
Updated
Dec 6, 2024 - Python