Add support for tokens of lengths 5-7

[zalenskivolt]

Closes #299

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 58.91%. Comparing base (7cea026) to head (4dd2bd0).
Report is 1 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #329      +/-   ##
==========================================
+ Coverage   58.52%   58.91%   +0.38%     
==========================================
  Files           8        8              
  Lines         639      645       +6     
  Branches      145      146       +1     
==========================================
+ Hits          374      380       +6     
  Misses        228      228              
  Partials       37       37              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[twyatt]

Looks great!
I pushed some commits that restructure the unit tests.
Will merge after getting another approval.

[davertay-j]

Excellent work, thanks @zalenskivolt