Vladimir Blagojevic 66f3f42a46

fix: Replace multiprocessing tokenization with batched fast tokenization (#3089) ...

* Replace multiprocessing tokenization with batched fast tokenization

* Replace deprecated tokenization method invocations

2022-08-31 07:33:39 -04:00

..

__init__.py

[CI refactoring] Categorize tests into folders (#2554)

2022-05-17 09:55:53 +01:00

test_distillation.py

[CI refactoring] Categorize tests into folders (#2554)

2022-05-17 09:55:53 +01:00

test_dpr.py

Simplify language_modeling.py and tokenization.py (#2703)

2022-07-22 16:29:30 +02:00

test_inference.py

Simplify language_modeling.py and tokenization.py (#2703)

2022-07-22 16:29:30 +02:00

test_language.py

Simplify language_modeling.py and tokenization.py (#2703)

2022-07-22 16:29:30 +02:00

test_prediction_head.py

Simplify language_modeling.py and tokenization.py (#2703)

2022-07-22 16:29:30 +02:00

test_processor_save_load.py

Simplify language_modeling.py and tokenization.py (#2703)

2022-07-22 16:29:30 +02:00

test_processor.py

Simplify language_modeling.py and tokenization.py (#2703)

2022-07-22 16:29:30 +02:00

test_question_answering.py

Simplify language_modeling.py and tokenization.py (#2703)

2022-07-22 16:29:30 +02:00

test_tokenization.py

fix: Replace multiprocessing tokenization with batched fast tokenization (#3089)

2022-08-31 07:33:39 -04:00