haiperdohp-jemaytreeah/tools
malonehunter bcd1308020 v2.3: Proper-Case normalization + 6,421 common words (216,088 entries)
- Normalize db.txt to Proper Case (capitalize first letter of every word), preserving acronyms
  (NASA), Roman numerals (XXXIII), mixed-case (iPhone); ~60% re-cased. Only the 5 case-sensitive
  ciphers change value (~unused).
- Fill 6,421 common words from the original 20K Gematro wordlist. 209,667 -> 216,088.
- Add tools/normalize_caps.py (smart Proper-Case pass; reusable, shareable).
- db.json + db_lite.json ship as v2.3 Release assets (gitignored).

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-29 05:48:39 -04:00
..
all_ciphers.py v2.1: DB restoration (209k entries), cipher fixes & renames, generator tools 2026-05-24 18:06:43 -04:00
generate_db_json.py ux: default loadout -> base 4; add 'Curated' preset (config.recommendedCiphers) 2026-05-28 14:53:40 -04:00
normalize_caps.py v2.3: Proper-Case normalization + 6,421 common words (216,088 entries) 2026-05-29 05:48:39 -04:00
README.md README: point to release db.json download for instant matching; update db counts to 209,667 2026-05-24 18:40:40 -04:00

Tools

Rebuilding the precomputed database (db.json)

The calculator works out of the box in live mode — it loads db.txt (one phrase per line) and computes cipher values on the fly. For instant matching (~100ms vs 2–5s per query), it can instead load a precomputed db.json containing all 69 cipher values per entry.

db.json is a build artifact derived from db.txt + calc/ciphers.js. It is not committed to the repo (it's large). Two ways to get it:

  1. Download the prebuilt db.json from the latest GitHub Release. Place it next to index.html.

  2. Regenerate it yourself:

    python3 tools/generate_db_json.py db.txt db.json
    

    Requires Python 3. Reads cipher definitions from calc/ciphers.js, scores every entry in db.txt against all 69 English-applicable ciphers, and writes db.json.

The calculator auto-detects db.json (see databaseMode in config.js, default "auto"): it tries db.json first and falls back to db.txt if absent.

Files

  • generate_db_json.py — builds db.json from a flat db.txt.
  • all_ciphers.py — parses calc/ciphers.js and scores text against all English ciphers (used by the generator). Handles case-sensitive ciphers and strips [...] display annotations before scoring, matching the live engine.