FT
NLPOptimize/flash-tokenizer
EFFICIENT AND OPTIMIZED TOKENIZER ENGINE FOR LLM INFERENCE SERVING
509 9 +0/wk
GitHub
bert berttokenizer cpp cpp17 deep-learning flash huggingface nlp pybind11 python tokenizer trie
Trend
0
Star & Fork Trend (36 data points)
Stars
Forks
Multi-Source Signals
Growth Velocity
NLPOptimize/flash-tokenizer has +0 stars this period . 7-day velocity: -0.8%.
Deep analysis is being generated for this repository.
Signal-backed technical analysis will be available soon.
| Metric | flash-tokenizer | pba | Compendium-of-free-ML-reading-resources | mergoo |
|---|---|---|---|---|
| Stars | 509 | 509 | 508 | 510 |
| Forks | 9 | 84 | 121 | 33 |
| Weekly Growth | +0 | +0 | +0 | +0 |
| Language | C++ | Jupyter Notebook | N/A | Python |
| Sources | 1 | 1 | 1 | 1 |
| License | N/A | Apache-2.0 | N/A | LGPL-3.0 |
Capability Radar vs pba
flash-tokenizer
pba
Maintenance Activity 66
Last code push 66 days ago.
Community Engagement 60
Fork-to-star ratio: 1.8%. Lower fork ratio may indicate passive usage.
Issue Burden 70
Issue data not yet available.
Growth Momentum 30
No measurable growth in the current period (first-day cold start expected).
License Clarity 30
No clear license detected — proceed with caution.
Risk scores are computed from real-time repository data. Higher scores indicate healthier metrics.