haiperdohp-jemaytreeah/tools
Hermes Agent 8c35752d9d feat(db): provision verified Ingglish phonetic lexicon and AQ attractor corpus
- Provision 872 verified Ingglish phonetic entries (253 Tier-1 lexicon/bridge
  items + 619 Tier-2 multi-scale 333/666/777/Numogram equations) formatted
  with native `[Ingglish: <English Gloss>]` comment brackets.
- Guard short Ingglish syllables (`di`, `li`, `mi`, `vi`, `iv`) against Roman-numeral
  false positives in `tools/normalize_caps.py`.
- Add newcomer onboarding documentation (`docs/ONBOARDING-INGGLISH-AQ.md`).
- Bump `databaseVersion` in `config.default.js` to cache-bust precomputed JSON.
- Verified 100% pass rate across all 4 CI gates (0 normalize mutations,
  100.0% classify_candidates keep rate, 0 comment-strip/AQ mismatches).
2026-11-03 03:50:39 +00:00
..
all_ciphers.py v2.1: DB restoration (209k entries), cipher fixes & renames, generator tools 2026-05-24 18:06:43 -04:00
classify_candidates.py v2.5: NetVoid 2026 review merge (+13,855) + calibrated classify_candidates tool 2026-06-03 06:21:50 -04:00
generate_db_json.py ux: default loadout -> base 4; add 'Curated' preset (config.recommendedCiphers) 2026-05-28 14:53:40 -04:00
normalize_caps.py feat(db): provision verified Ingglish phonetic lexicon and AQ attractor corpus 2026-11-03 03:50:39 +00:00
README.md README: point to release db.json download for instant matching; update db counts to 209,667 2026-05-24 18:40:40 -04:00

Tools

Rebuilding the precomputed database (db.json)

The calculator works out of the box in live mode — it loads db.txt (one phrase per line) and computes cipher values on the fly. For instant matching (~100ms vs 2–5s per query), it can instead load a precomputed db.json containing all 69 cipher values per entry.

db.json is a build artifact derived from db.txt + calc/ciphers.js. It is not committed to the repo (it's large). Two ways to get it:

  1. Download the prebuilt db.json from the latest GitHub Release. Place it next to index.html.

  2. Regenerate it yourself:

    python3 tools/generate_db_json.py db.txt db.json
    

    Requires Python 3. Reads cipher definitions from calc/ciphers.js, scores every entry in db.txt against all 69 English-applicable ciphers, and writes db.json.

The calculator auto-detects db.json (see databaseMode in config.js, default "auto"): it tries db.json first and falls back to db.txt if absent.

Files

  • generate_db_json.py — builds db.json from a flat db.txt.
  • all_ciphers.py — parses calc/ciphers.js and scores text against all English ciphers (used by the generator). Handles case-sensitive ciphers and strips [...] display annotations before scoring, matching the live engine.