Constrain tokenizers version
@@ -28,6 +28,7 @@ requirements:
- sentence-transformers ==2.2.2
- setuptools ==62.6.0
- pytorch ==1.12.1
+ - tokenizers >=0.11.1,!=0.11.3,<0.13
- tree_sitter ==0.20.1
- tree_sitter_languages ==1.5.0
