Compare commits

...
45 changed files with 526469 additions and 0 deletions

No files matched your search

+323
View File
@@ -0,0 +1,323 @@
# Row 309 / O2 W1 / Gitea #1823
2026-10-24 — Glomgold (d17504fd-2f56-4d9f-bff9-eabb450f8a94).
Base: d16958bcf; branch glomgold/row309. Read AGENTS.md, seat README,
W1, D2, D22, Proposed rows, G1 and CURRENT.md. Approved assignment provides
scope and acceptance; no runtime integration or new design approval required.
## Intended build and acceptance
Retain all 18 original WordNet files as text, preserving Princeton LICENSE
bytes; add NOTICE and per-file provenance. Keep the downloaded ZIP outside git.
No binary source archive needs to land. Implement a deterministic offline
importer/converter with source integrity, strict records and count checks.
Ship JSON lookup data plus license/notice under src/public/thesaurus, not source
or converter code. Prefer explicit sense identifiers, glosses, lemmas, index
and exceptions over a lossy synonym-only table. Record deterministic output
hashes and bytes; measure JSON parse heap under Node with explicit GC, labeling
it as Node rather than browser evidence. All tests and measurements await Sage
CLEAR, followed by Boyd review and a single Duckworth landing review. No runtime
fetch, UI, route, worker, CSP change, live stack or private books.
## Source intake — blocked on count mismatch
Fetched only the assigned source:
https://raw.githubusercontent.com/nltk/nltk_data/96f9b3252457a2b97e52aec64c3dfceeb5c312d5/packages/corpora/wordnet.zip
Archive retained outside repository:
/mnt/storage/scratch/tmp/glomgold-wordnet-3.0.zip
- Archive bytes: 10,775,600 — matches.
- Archive SHA-256: cbda5ea6eef7f36a97a43d4a75f85e07fccbb4f23657d27b4ccbc93e2646ab59 — matches.
- Regular entries: 18; uncompressed total: 36,353,991 — matches.
- data.*, index.* and *.exc total: 35,435,978 — matches.
- Synsets: 117,659 — matches.
- Distinct literal lemma strings in data.*: 149,229.
- Distinct lowercased lemmas after removing adjective (a)/(p)/(ip) suffixes: 147,306.
- Distinct first-field strings across index.noun/index.verb/index.adj/index.adv:
147,306. This is 28 above D22's cited Princeton statistic of 147,278.
Counting method: read the verified ZIP using Python standard-library zipfile;
exclude header lines beginning with two spaces. Each remaining data.* line is
one synset; field 4 is the hexadecimal word count and following alternating
word/lex_id fields supply its lemmas. Independently take the first whitespace
field of each nonheader index.* line into a union set across the four files.
Both normalized data and index counts agree at 147,306. This was source intake,
not a test-suite run. No converter, generated data, tests or heap measurement
has run or been written. Per explicit assignment, stop on differing count and
ask Sage to resolve the expected count before proceeding. No alternate source.
Queue next from the linked worktree refused because queue operations require
the canonical checkout. Retried there and received row 309. Claim operation
is glomgold-0001, initially still pending; do not repeat with a fresh key.
Claim completed: `ok glomgold-0001 rev 3856 row 309 briefed→in-progress`.
Sage notified through T3, glomgold-0002 at 05:38:57Z. No commit/push.
Session and BUILD-LOG registry entries require Sage coordination because those
shared files are outside the assignment's exclusive owned-file list. Proposed
session line: 2026-10-24 | glomgold | row 309 / #1823 W1 source intake |
blocked: pinned archive has 147,306 distinct headwords versus cited 147,278;
archive bytes/hash and synsets match; no tests, commit or push.
## Sage ruling sage-3972 (05:40:30Z)
Proceed with the exact pinned mirror. Pin 147,306 distinct headwords, 117,659
synsets and the source hashes. Record literal data lemmas =149,229. The 147,278
is the cited Princeton page figure, not an expected count measured on this ZIP.
The 28-string gap remains open for review and is not a build blocker.
Bounded investigation: the Princeton statistics page reports per-POS strings
117,798 noun; 11,529 verb; 21,479 adjective; 4,481 adverb, total 155,287.
All four match the pinned mirror. The page explicitly states its 147,278 is
the cross-POS union, so summing per-POS counts does not explain the gap.
Mirror index lowercasing, replacing underscores with spaces, and collapsing
repeated underscores each leave 147,306. Removing underscores entirely gives
146,449, not the cited count. Data normalization independently gives 147,306;
case/marker differences explain literal 149,229, not the remaining 28-string
gap. No proven explanation found; no source substitution or extra upstream
archive comparison. Investigation ended after these bounded checks.
References: https://wordnet.princeton.edu/documentation/wnstats7wn and
https://wordnet.princeton.edu/documentation/wndb5wn (format description).
Implementation choice: one JSON shard per POS, retaining glosses and full
lemma spelling (including markers), lowercase ordered sense index and exception
lists. This lets a future consumer release unused POS objects. JSON is data,
with no script, worker, UI or route. Consumer hints (max senses/synonyms) are
explicit tunable defaults and never truncate the dataset at build time.
The importer takes an explicit local ZIP, validates its bytes/hash before
Python stdlib extraction, and never downloads. Normal converter builds use
only the verified retained text; no archive or Python needed for regeneration.
Tests authored before converter; first run will follow implementation under
Sage's explicit code-then-CLEAR workflow rather than unslotted red runs.
Code and data tests written; no test/build/heap run yet. Proposed CLEAR work:
- Node syntax checks for both new converters and the new test.
- Offline archive import to scratch and generation into shipped public path.
- Independent thesaurus-data.test.mjs, with THESAURUS_ARCHIVE naming the verified
external ZIP (round-trip coverage), two full conversions and shipped-byte checks.
- Fresh-process --expose-gc measurement three times, recorded here as plain text.
- Full affected WebUI suite serially, preserving any existing failure for Sage.
- git diff --check and binary diff review before own-branch commit/push.
All commands run with TMPDIR from mktemp /mnt/storage/scratch/tmp/XXXXXX.
## Verification under CLEAR sage-3975
Runtime: Node v26.8.1; Python 3.12.8; Linux x64. Converter uses only Node standard
library; importer uses only Python stdlib zipfile, invoked over verified stdin.
Node syntax checks for both converters and the new test exited 0.
First generation refused `index.noun: 'hood`: my index grammar omitted the
aggregated domain pointer symbols `;` and `-` used in index files (data files
use the expanded variants). Inspected all source index pointer symbols,
added those two index-only symbols, regenerated successfully. No source edit
or old-test change. Generated evidence: generation.txt.
Independent test command (fresh scratch TMPDIR, THESAURUS_ARCHIVE set):
`node --test packages/webui/tests/thesaurus-data.test.mjs` — 8/8 pass, no skip,
no failure. Includes two complete conversions vs shipped bytes and each other,
all source/license hashes, malformed records, changed source/provenance,
missing license, extra inventory, invalid archive, full verified archive
round-trip and overwrite refusal. Log: thesaurus-test.tap.
Generated data: noun.json 15,617,486; verb.json 2,327,528; adj.json 3,319,398;
adv.json 648,351; LICENSE 1,625; NOTICE 649; manifest.json 1,623 bytes.
Total shipped: 21,916,660 bytes (plain text, no compressed/binary evidence).
The data files alone total 21,912,763 bytes. Suggested consumer limits in
manifest.json are maxSenses=8 and maxSynonyms=20, tunable hints; all data ships.
Fresh Node --expose-gc heap measurements (all four shards retained), each with
`uptime` immediately before the command; logs heap-1.txt through heap-3.txt:
| Run | Uptime display / load 1,5,15 | Baseline heap | Retained delta | Sampled post-parse delta |
| --- | --- | ---: | ---: | ---: |
| 1 | 00:44:34 / 1.47, 2.21, 2.52 | 4,758,736 | 59,679,616 | 60,374,568 |
| 2 | 00:44:34 / 1.47, 2.21, 2.52 | 4,758,984 | 59,679,616 | 60,374,568 |
| 3 | 00:44:35 / 1.47, 2.21, 2.52 | 4,758,736 | 59,679,616 | 60,374,568 |
Uptime is host-local; date -u is used for T3 headers. Measurements occurred
while Gyro's nice -n 19 cargo build was allowed concurrently. Retained delta
is after explicit GC, with objects kept live and 117,659 synsets checked.
The sampled post-parse number is not an instrumented high-water mark.
These are measured Node costs, not browser-memory claims. No browser/editor
code or actual books are involved.
Sage-3977 authorized ignored root node_modules symlink to canonical dependencies
and npm ci --ignore-scripts --no-audit --no-fund in packages/webui; two packages
installed from the existing lockfile. The first symlink command accidentally
used webui cwd; npm ci removed that temporary symlink, then the intended root
symlink was created. Canonical dependency files were not changed. Both final
node_modules paths are ignored and absent from git status --porcelain.
Full suite started with MOSAIC_REQUIRE_EDITOR_BUILD=1, concurrency=1 and the
verified external THESAURUS_ARCHIVE. No tracked package/lockfile changes.
Public-directory inventory review: shell.test.mjs enumerates only the font
subdirectory; editor-provenance.test.mjs hashes only third_party/editor and
specific editor outputs. No test found hashing/enumerating all src/public as
a closed file list. The new subdirectory does not enter those inventories.
SESSIONS and BUILD-LOG will be handled by Sage at landing (sage-3975).
## First full suite: missing dependency, superseded by isolated install
Full run exited 1: 426 tests, 376 pass, 50 fail, 0 skipped; 272657.498313 ms.
The summary confirms missing oauth4webapi (ERR_MODULE_NOT_FOUND). The authorized
canonical root node_modules symlink pointed at an incomplete installation.
No old tests or authentication code changed. Sage-3981 supersedes the base-worktree
comparison: remove ONLY my root symlink and npm ci from the root lockfile into
an isolated worktree root node_modules, then rerun decide-sso/granted-user once.
Only if both pass, run the full suite again. No baseline worktree was created.
Canonical node_modules remains untouched. All first-run failure details are
retained in webui-suite.tap; the five requested decide-sso stacks follow.
```text
test at packages/webui/tests/decide-sso.test.mjs:79:1
✖ a signed-in owner confirms and answers, with the session's provider, issuer and sub as the subject (26.393114ms)
Error [ERR_MODULE_NOT_FOUND]: Cannot find package 'oauth4webapi' imported from /home/jwoltje/.t3/worktrees/mosaic-stack/glomgold-row309/packages/webui/src/sso.mjs
at Object.getPackageJSONURL (node:internal/modules/package_json_reader:331:9)
at packageResolve (node:internal/modules/esm/resolve:784:25)
at moduleResolve (node:internal/modules/esm/resolve:873:18)
at defaultResolve (node:internal/modules/esm/resolve:1006:11)
at #cachedDefaultResolve (node:internal/modules/esm/loader:708:20)
at #resolveAndMaybeBlockOnLoaderThread (node:internal/modules/esm/loader:728:38)
at ModuleLoader.resolveSync (node:internal/modules/esm/loader:766:56)
at #resolve (node:internal/modules/esm/loader:690:17)
at ModuleLoader.getOrCreateModuleJob (node:internal/modules/esm/loader:610:35)
at node:internal/modules/esm/loader:639:32 {
code: 'ERR_MODULE_NOT_FOUND'
}
test at packages/webui/tests/decide-sso.test.mjs:99:1
✖ the listener gates: no session, a cross-origin page, a loopback Host, a GET, and a sign-out between the steps (31.164949ms)
Error [ERR_MODULE_NOT_FOUND]: Cannot find package 'oauth4webapi' imported from /home/jwoltje/.t3/worktrees/mosaic-stack/glomgold-row309/packages/webui/src/sso.mjs
at Object.getPackageJSONURL (node:internal/modules/package_json_reader:331:9)
at packageResolve (node:internal/modules/esm/resolve:784:25)
at moduleResolve (node:internal/modules/esm/resolve:873:18)
at defaultResolve (node:internal/modules/esm/resolve:1006:11)
at #cachedDefaultResolve (node:internal/modules/esm/loader:708:20)
at #resolveAndMaybeBlockOnLoaderThread (node:internal/modules/esm/loader:728:38)
at ModuleLoader.resolveSync (node:internal/modules/esm/loader:766:56)
at #resolve (node:internal/modules/esm/loader:690:17)
at ModuleLoader.getOrCreateModuleJob (node:internal/modules/esm/loader:610:35)
at node:internal/modules/esm/loader:639:32 {
code: 'ERR_MODULE_NOT_FOUND'
}
test at packages/webui/tests/decide-sso.test.mjs:121:1
✖ J16: without a decision transport the routes are read-only and /api/config says no; startServer refuses decide without sso or send (24.009216ms)
AssertionError [ERR_ASSERTION]: The input did not match the regular expression /need --sso and --send/. Input:
"Error [ERR_MODULE_NOT_FOUND]: Cannot find package 'oauth4webapi' imported from /home/jwoltje/.t3/worktrees/mosaic-stack/glomgold-row309/packages/webui/src/sso.mjs"
at process.processTicksAndRejections (node:internal/process/task_queues:104:5)
at async TestContext.<anonymous> (file:///home/jwoltje/.t3/worktrees/mosaic-stack/glomgold-row309/packages/webui/tests/decide-sso.test.mjs:124:3)
at async Test.run (node:internal/test_runner/test:1409:7)
at async Test.processPendingSubtests (node:internal/test_runner/test:974:7) {
generatedMessage: true,
code: 'ERR_ASSERTION',
actual: Error [ERR_MODULE_NOT_FOUND]: Cannot find package 'oauth4webapi' imported from /home/jwoltje/.t3/worktrees/mosaic-stack/glomgold-row309/packages/webui/src/sso.mjs
at Object.getPackageJSONURL (node:internal/modules/package_json_reader:331:9)
at packageResolve (node:internal/modules/esm/resolve:784:25)
at moduleResolve (node:internal/modules/esm/resolve:873:18)
at defaultResolve (node:internal/modules/esm/resolve:1006:11)
at #cachedDefaultResolve (node:internal/modules/esm/loader:708:20)
at #resolveAndMaybeBlockOnLoaderThread (node:internal/modules/esm/loader:728:38)
at ModuleLoader.resolveSync (node:internal/modules/esm/loader:766:56)
at #resolve (node:internal/modules/esm/loader:690:17)
at ModuleLoader.getOrCreateModuleJob (node:internal/modules/esm/loader:610:35)
at node:internal/modules/esm/loader:639:32,
expected: /need --sso and --send/,
operator: 'rejects',
diff: 'simple'
}
test at packages/webui/tests/decide-sso.test.mjs:147:1
✖ J19: a granted user's session gets decide false and the user page config, and a decision POST stops at owner-only (49.361897ms)
Error [ERR_MODULE_NOT_FOUND]: Cannot find package 'oauth4webapi' imported from /home/jwoltje/.t3/worktrees/mosaic-stack/glomgold-row309/packages/webui/src/sso.mjs
at Object.getPackageJSONURL (node:internal/modules/package_json_reader:331:9)
at packageResolve (node:internal/modules/esm/resolve:784:25)
at moduleResolve (node:internal/modules/esm/resolve:873:18)
at defaultResolve (node:internal/modules/esm/resolve:1006:11)
at #cachedDefaultResolve (node:internal/modules/esm/loader:708:20)
at #resolveAndMaybeBlockOnLoaderThread (node:internal/modules/esm/loader:728:38)
at ModuleLoader.resolveSync (node:internal/modules/esm/loader:766:56)
at #resolve (node:internal/modules/esm/loader:690:17)
at ModuleLoader.getOrCreateModuleJob (node:internal/modules/esm/loader:610:35)
at node:internal/modules/esm/loader:639:32 {
code: 'ERR_MODULE_NOT_FOUND'
}
test at packages/webui/tests/decide-sso.test.mjs:173:1
✖ N4: decision.resolve has no Console route, the --send caller names no decision verb, and consoleCall takes only the two console verbs (70.935161ms)
Error [ERR_MODULE_NOT_FOUND]: Cannot find package 'oauth4webapi' imported from /home/jwoltje/.t3/worktrees/mosaic-stack/glomgold-row309/packages/webui/src/sso.mjs
at Object.getPackageJSONURL (node:internal/modules/package_json_reader:331:9)
at packageResolve (node:internal/modules/esm/resolve:784:25)
at moduleResolve (node:internal/modules/esm/resolve:873:18)
at defaultResolve (node:internal/modules/esm/resolve:1006:11)
at #cachedDefaultResolve (node:internal/modules/esm/loader:708:20)
at #resolveAndMaybeBlockOnLoaderThread (node:internal/modules/esm/loader:728:38)
at ModuleLoader.resolveSync (node:internal/modules/esm/loader:766:56)
at #resolve (node:internal/modules/esm/loader:690:17)
at ModuleLoader.getOrCreateModuleJob (node:internal/modules/esm/loader:610:35)
at node:internal/modules/esm/loader:639:32 {
code: 'ERR_MODULE_NOT_FOUND'
}
```
## Environment repair and final candidate validation
Isolated worktree root npm ci installed 128 packages from the unchanged lockfile
(root-install.txt); no canonical install, lockfile or source edits.
`decide-sso.test.mjs` alone: 5/5 pass (decide-sso-rerun.tap).
`granted-user.test.mjs` alone: 19/19 pass (granted-user-rerun.tap).
Both used separate fresh scratch TMPDIRs and MOSAIC_REQUIRE_EDITOR_BUILD=1.
This confirms missing dependency setup rather than a W1 source regression;
no base worktree needed under sage-3981. Full serial suite restarted only after
both files passed; log webui-suite-final.tap.
Final source cleanup before the rerun: BUILD.json now explicitly records
Node v26.8.1 and the initial-import Python 3.12.8 in addition to API baselines
and input/output hashes. Removed the optional no-op heap-test wrapper: heap
measurement is three explicit CLI runs, not a reported test without assertions.
Regenerated metadata, syntax-checked all three new modules, reran the dedicated
data test independently: 7/7 pass, 0 skip (thesaurus-test-final.tap). Generated
data bytes/hashes are unchanged; only build metadata/input hashes changed.
## Landing hold mos-1573
Per sage-3980: W1 may build and push only glomgold/row309 for Boyd review.
Nothing lands on refactor until Jason decides whether roughly 58 MB of source
and derived text should be permanent repository history (Vikunja 618).
After a green local commit, measure the exact packed bytes via
`git rev-list --objects d16958bcf..HEAD | git pack-objects --stdout | wc -c`
and report `git count-objects -v` alongside it. No merge or protected-branch push.
Whitespace review: authored source/docs/data/evidence pass staged diff --check
when excluding only the original wordnet/ tree and its two exact LICENSE
copies. The unfiltered check reports 273,271 upstream whitespace findings in
13 files (all original WordNet text or LICENSE copies). Their exact bytes are
required by W1 and verified against the pinned archive; no normalization was
made. Evidence logs/stack excerpts have trailing blank-line spaces trimmed
for review only; test content, errors, statuses and counts are preserved.
No binary entries appear in staged numstat. The ZIP and the full whitespace
checker diagnostic remain outside git.
## Candidate completion
Final full affected suite:
`MOSAIC_REQUIRE_EDITOR_BUILD=1 THESAURUS_ARCHIVE=/mnt/storage/scratch/tmp/glomgold-wordnet-3.0.zip node --test --test-concurrency=1 packages/webui/tests/`
with fresh scratch TMPDIR — 425/425 pass, 0 failures, 0 skips, exit 0;
277018.268665 ms (webui-suite-final.tap). Old test files remained byte-identical.
This includes the required pinned esbuild provenance rebuild. The dedicated
new test independently passed 7/7 before the full run.
All committed additions are within W1's assigned source/data/test paths plus
this explicitly assigned seat work directory. Both node_modules paths are
ignored and absent from git status --porcelain. Source ZIP remains outside git.
Staged numstat contains no binary files. Authored-path staged diff --check
passes; the unmodified upstream whitespace findings are documented above.
License/provenance approval awaits Boyd, then Duckworth once on the landing
candidate. No refactor merge/push, release or deployment is authorized here.
Final registry line for Sage at landing: 2026-10-24 | glomgold | row 309 / #1823
W1 pinned WordNet data | 147306 headwords / 117659 synsets, deterministic
21,916,660-byte shipped data; Node retained heap 59,679,616 bytes (3 runs);
independent 7/7 and WebUI 425/425; source/data plain text; history-size hold
mos-1573 and independent review remain external gates.
@@ -0,0 +1,13 @@
✔ a signed-in owner confirms and answers, with the session's provider, issuer and sub as the subject (92.914873ms)
✔ the listener gates: no session, a cross-origin page, a loopback Host, a GET, and a sign-out between the steps (36.478745ms)
✔ J16: without a decision transport the routes are read-only and /api/config says no; startServer refuses decide without sso or send (206.814095ms)
✔ J19: a granted user's session gets decide false and the user page config, and a decision POST stops at owner-only (77.212086ms)
✔ N4: decision.resolve has no Console route, the --send caller names no decision verb, and consoleCall takes only the two console verbs (44.65112ms)
ℹ tests 5
ℹ suites 0
ℹ pass 5
ℹ fail 0
ℹ cancelled 0
ℹ skipped 0
ℹ todo 0
ℹ duration_ms 564.772519
@@ -0,0 +1,55 @@
{
"schema": 1,
"sourceManifestSha256": "e5a799a6693321be71c4e99080b9f89ba12a304c3092d05839bb85355194fe76",
"archive": {
"bytes": 10775600,
"sha256": "cbda5ea6eef7f36a97a43d4a75f85e07fccbb4f23657d27b4ccbc93e2646ab59"
},
"counts": {
"synsets": 117659,
"headwords": 147306,
"literalLemmas": 149229
},
"countMethod": "Union of first-field headwords across four index.* files; cross-checked with lowercased data.* lemmas stripping terminal (a)/(p)/(ip). Literal data lemmas counted without normalization.",
"openNote": "Princeton statistics page union 147278 differs by 28; unresolved, accepted in sage-3972.",
"tools": {
"node": "v26.8.1",
"initialImportPython": "3.12.8",
"converter": "Node.js >=24, standard library only; JSON UTF-8 LF, no timestamps, no locale sorting",
"importer": "Node.js >=24 plus Python 3 stdlib zipfile; local pinned ZIP only"
},
"inputs": {
"editor-data/import-wordnet.mjs": "9b3a668b83d40b5c2659b56c647c40db494d8a9f35fb7ab463b46892ae0d530a",
"editor-data/build-thesaurus.mjs": "f1b0b062452fedfb1298f9785f4934046a8b6a0ed8704f5cb82c683d6deb60aa"
},
"outputs": {
"noun.json": {
"bytes": 15617486,
"sha256": "5294d3f0e6cd7924f5be97d4d6e64b96a9dd8505f216e5c056c3f5b69c0c2dc9"
},
"verb.json": {
"bytes": 2327528,
"sha256": "3f99489858d8cbce9996c72135f82325bd2c067a64d2fb8b80dea386b99b6392"
},
"adj.json": {
"bytes": 3319398,
"sha256": "9965dbfdc35a11b829fedb19e7b22ab3ca8470f45c5532c1f310810012a23023"
},
"adv.json": {
"bytes": 648351,
"sha256": "c6effb7a1502cd3dcd81341cb296e039d238786712c91c30994f2e50ef1e9fcb"
},
"LICENSE": {
"bytes": 1625,
"sha256": "7731175a77952e259390b496fab905e57118b8d19ad3a8383c67eee724ff443f"
},
"NOTICE": {
"bytes": 649,
"sha256": "508e1a5d132e05ec888a79ec959b68d25203fee0aa3692b0610da7500a7c0251"
},
"manifest.json": {
"bytes": 1623,
"sha256": "2c58e1513991ea7505ffd8d9dda6e5e8189f8984a7167b051834eb9306e15c72"
}
}
}
@@ -0,0 +1,29 @@
✔ R6 G1 a granted user signs in, gets the user page and reaches the broker as itself (160.658638ms)
▶ R6 G2 a subject with no live grant in this business is refused subject-unknown
✔ a listed user with no grant (37.489252ms)
✔ a grant in another business (53.430666ms)
✔ an expired grant (54.675764ms)
✔ another user's grant (73.314097ms)
✔ a sub in no file (107.901995ms)
✔ a file the loader refuses (52.404505ms)
✔ R6 G2 a subject with no live grant in this business is refused subject-unknown (380.127672ms)
▶ R6 G3 a revoke counts on the next request: 401 and the session is gone
✔ grant removed (56.085631ms)
✔ subject removed (92.518855ms)
✔ grant expired (55.61104ms)
✔ file now refused (51.75472ms)
✔ R6 G3 a revoke counts on the next request: 401 and the session is gone (256.650806ms)
✔ R6 G4 every owner route answers 403 owner-only before any bus call (113.040167ms)
✔ R6 G5 the bus refuses every owner verb over the user transport on its own (62.938328ms)
✔ R6 G9 a user chat sends only the plugins read over the owner transport (103.067067ms)
✔ R6 G6 the user page holds the notice word for word (74.913868ms)
✔ R6 G7 the hub label and plain peer links render from config on both pages (794.402374ms)
✔ R6 G8 userCall spawns user-cli directly with the user nonce, no human nonce, and the user request (40.148927ms)
ℹ tests 19
ℹ suites 0
ℹ pass 19
ℹ fail 0
ℹ cancelled 0
ℹ skipped 0
ℹ todo 0
ℹ duration_ms 2123.05789
+17
View File
@@ -0,0 +1,17 @@
00:44:34 up 10 days, 16:04, 2 users, load average: 1.47, 2.21, 2.52
{
"runtime": "v26.8.1",
"platform": "linux",
"arch": "x64",
"files": [
"noun.json",
"verb.json",
"adj.json",
"adv.json"
],
"method": "Fresh Node --expose-gc process; GC before/after parsing all four JSON shards; heapUsed delta. parseHeapBytes is a sampled post-parse value, not peak instrumentation; not a browser measurement.",
"baselineHeapBytes": 4758736,
"retainedHeapBytes": 59679616,
"parseHeapBytes": 60374568,
"synsets": 117659
}
+17
View File
@@ -0,0 +1,17 @@
00:44:34 up 10 days, 16:04, 2 users, load average: 1.47, 2.21, 2.52
{
"runtime": "v26.8.1",
"platform": "linux",
"arch": "x64",
"files": [
"noun.json",
"verb.json",
"adj.json",
"adv.json"
],
"method": "Fresh Node --expose-gc process; GC before/after parsing all four JSON shards; heapUsed delta. parseHeapBytes is a sampled post-parse value, not peak instrumentation; not a browser measurement.",
"baselineHeapBytes": 4758984,
"retainedHeapBytes": 59679616,
"parseHeapBytes": 60374568,
"synsets": 117659
}
+17
View File
@@ -0,0 +1,17 @@
00:44:35 up 10 days, 16:04, 2 users, load average: 1.47, 2.21, 2.52
{
"runtime": "v26.8.1",
"platform": "linux",
"arch": "x64",
"files": [
"noun.json",
"verb.json",
"adj.json",
"adv.json"
],
"method": "Fresh Node --expose-gc process; GC before/after parsing all four JSON shards; heapUsed delta. parseHeapBytes is a sampled post-parse value, not peak instrumentation; not a browser measurement.",
"baselineHeapBytes": 4758736,
"retainedHeapBytes": 59679616,
"parseHeapBytes": 60374568,
"synsets": 117659
}
@@ -0,0 +1,3 @@
npm warn deprecated [email protected]: Use your platform's native DOMException instead
added 128 packages in 1s
@@ -0,0 +1,15 @@
✔ pinned source keeps all original files and Princeton license bytes (38.297773ms)
✔ two complete conversions match shipped bytes and pinned counts (3418.378387ms)
✔ changed source, missing license, changed provenance and extra files refuse before output (68.788374ms)
✔ data parser refuses malformed words, offsets, pointers, verb frames and trailing fields (0.365038ms)
✔ index parser refuses wrong counts, nonexistent senses and incorrect lemma mapping (0.292268ms)
✔ offline importer refuses incorrect archive bytes before extraction (0.416171ms)
✔ verified pinned ZIP round-trips to all original text files (366.007687ms)
ℹ tests 7
ℹ suites 0
ℹ pass 7
ℹ fail 0
ℹ cancelled 0
ℹ skipped 0
ℹ todo 0
ℹ duration_ms 3965.261961
@@ -0,0 +1,16 @@
✔ pinned source keeps all original files and Princeton license bytes (32.957522ms)
✔ two complete conversions match shipped bytes and pinned counts (3093.861766ms)
✔ changed source, missing license, changed provenance and extra files refuse before output (59.480475ms)
✔ data parser refuses malformed words, offsets, pointers, verb frames and trailing fields (0.334357ms)
✔ index parser refuses wrong counts, nonexistent senses and incorrect lemma mapping (0.233577ms)
✔ offline importer refuses incorrect archive bytes before extraction (0.371605ms)
✔ heap measurement runs explicitly in an isolated GC-enabled process (0.145852ms)
✔ verified pinned ZIP round-trips to all original text files (390.61197ms)
ℹ tests 8
ℹ suites 0
ℹ pass 8
ℹ fail 0
ℹ cancelled 0
ℹ skipped 0
ℹ todo 0
ℹ duration_ms 3637.750779
@@ -0,0 +1,458 @@
✔ row 194 T16 Settings Agents: unavailable read-only, launch follows its request, confirms, reason and refusal (13120.49989ms)
✔ row 256 T7 T8 the human page offers Delete on a creative instance, the tester page never does (594.900276ms)
✔ row 194 T16: each agent action makes one call with only its keys, logs the user and answers the request (19.279785ms)
✔ row 194 T16: the boundary refuses before any bus call (8.864838ms)
✔ row 194 T16: read-only when send is off or no writer is wired; no route has a --send exception (4.555721ms)
✔ row 194 T16: a bus refusal names its reason and nothing changed; an unknown outcome or a bad shape is never retried (3.135758ms)
✔ row 194 T16: the request read takes one id, adds the refusal reason and refuses an unexpected shape (4.707014ms)
✔ row 194 T16: delete joins add and change on /api/instances with only revision, instance and op (2.172666ms)
✔ row 194 T16 D4.1: the tester listener launches, terminates and reads requests; regenerate, veto and delete are refused with no call (4.058214ms)
✔ row 194 N5: agents.js is served as JavaScript and index.html loads it once (1.320432ms)
✔ row 239 T6: a delete closed -revoked says the tokens may already be revoked, and outcome-unknown-revoked is an open outcome (2.197169ms)
✔ Q169 the signed-in human names a seat and stops the assistant, one bus call each, logged with the user (15.385947ms)
✔ Q169 the name and stop routes need send on, the public name, the user, the exact Origin and same-origin Fetch Metadata (7.953505ms)
✔ Q169 the name and stop routes take JSON within 4 KiB and only their own keys, all text (4.763975ms)
✔ Row 167 a null body on the name and stop routes is 400 invalid-request with no write, and the next request is answered (2.613751ms)
✔ Q169 a bus refusal says nothing changed; a lost or odd answer says the change may have been made (4.454523ms)
✔ Q169 the names read is a bus read like the others (1.187961ms)
✔ the Board: held roles with no machine sessions, a claim with no address, the toggle kept across a reload, and Message addressed to the role (2826.381092ms)
✔ a Seen click while a Board read is in flight waits for that read, then posts (1097.524589ms)
✔ a redirect answer on a Board read, a bus read, a conversation read, a board POST, a module read and a send signs the page out: one line, nothing stale, no further reads (4974.029468ms)
✔ browser edge states: loading, empty, malformed, stale, hostile/long values, in-flight reply and appearance fallback (1167.906408ms)
Rendered contrast: {"failures":[],"count":330,"lowest":4.504658476260286}
✔ served Console browser: real board fixtures, keyboard, drafts, receipts, themes, 320px and failures (1361.244374ms)
✔ the README says a refused field table names the file or the key at fault, never a path (0.895092ms)
✔ S5 pages in a browser: real broker rows, inert text, Copy, routes, failures, layout and no writes (2997.413698ms)
✔ bus routes serve the four reads from the reader view, unescaped JSON for the page to escape (71.009621ms)
✔ decisions route serves the roles and recent lists from the reader view (35.642956ms)
✔ credentials route serves the broker credential status from the reader view (12.415355ms)
✔ replies route serves the replies to one message from the reader view (33.836567ms)
✔ bus routes are GET-only, have no write verb, and keep the same-origin checks (53.12275ms)
✔ bus refusals map to statuses and never carry a path or a stack (25.300216ms)
✔ humanCall speaks the human transport protocol without blocking the server (1652.166732ms)
✔ busReader takes --business, else the live bus host, else refuses (179.503984ms)
✔ humanCall kills a transport that runs past its timeout (528.73483ms)
✔ serve refuses a --business value that is not a business id (288.679832ms)
✔ WebUI channel off returns 503 and named recovery for every chat route without a chat operation (32.840935ms)
✔ WebUI only selection keeps web chat enabled while retaining the old read envelope (2.07606ms)
✔ WebUI channel-disabled recovery text is fixed and never echoes transport text (1.29965ms)
✔ chat browser: list/create named projects and threads, hostile labels inert and no implicit writes (641.425225ms)
✔ chat browser: thread drafts, receipts and cursor history stay isolated; refresh never writes (734.207819ms)
✔ chat browser: uncertain writes retain draft, ownership refusal clears it, read-only cannot send (733.502029ms)
✔ chat browser: a late read from A cannot paint B; sign-out clears private state and stops reads (956.0031ms)
✔ chat browser: page forward and deduplicate replies; pending and byte-limit submissions do not duplicate (653.519467ms)
✔ chat browser: scrolled history stays put, New messages and an own send return to the tail (651.214034ms)
✔ chat browser: automatic polling follows a reply without a POST or a lost draft (10567.99751ms)
✔ chat browser: display stays bounded while every forward page remains reachable (646.919125ms)
✔ chat browser: a confirmed visible message replaces its pending receipt; malformed receipts stay unknown (666.089089ms)
✔ chat browser: a refusal elsewhere forgets private chat drafts (649.343576ms)
✔ chat browser: a late project creation receipt cannot navigate away from another thread (734.318814ms)
✔ C2-09a picker: no silent choice, duplicate hostile labels stay inert, selection survives refresh and reaches POST (633.758399ms)
✔ C2-09a picker: metadata failure, empty set and removed pick explain disabled state and recover without switching (705.839055ms)
✔ C2-09a picker: a single instance is chosen explicitly but read-only mode cannot create a thread (603.87131ms)
✔ 264e chooser: two sessions keep drafts, cursors, deep links and counts independent (709.28204ms)
✔ 264e clear confirmation and status never resend, force-stop or change selection (646.479049ms)
✔ 264e new session keeps its operation key after an unknown response and uses no implicit open (629.483981ms)
✔ 264e cancel shows before/after retirement and never starts or replays work (748.8715ms)
✔ 272 B1: a bad-session deep link preserves the draft and lost clear operation on A (679.330701ms)
✔ C2-09a metadata uses the human listener bus, projects labels only and refuses unauthenticated reads (17.636401ms)
✔ C2-09a metadata uses the private tester listener own bus and no human transport (2.812051ms)
✔ C2-09a metadata refuses missing or malformed reads and never echoes untrusted fields (3.36452ms)
✔ C2-09a metadata stays behind the SSO session check and a GET never refreshes session activity (2.031401ms)
✔ 272 fallback: granted legacy route keeps default history, send and open without session controls (551.938108ms)
✔ 272 fallback guard: granted explicit-session route refuses without default history or writes (446.9789ms)
✔ 272 fallback guard: human-required catalog failure never enables default-thread access (438.616041ms)
✔ 272 fallback guard: timeout catalog failure never enables default-thread access (332.141995ms)
✔ 272 fallback guard: no-bus-host catalog failure never enables default-thread access (345.68892ms)
✔ 272 fallback guard: malformed catalog failure never enables default-thread access (457.527881ms)
✔ 272 fallback guard: owner route retains chooser and explicit default-session addressing (356.922913ms)
✔ chat reads map only fixed verbs, strict forward paging and pure GET (22.513107ms)
✔ chat refuses malformed and repeated query/id values before transport (5.490672ms)
✔ chat project.create: one verified write, fixed identity/class and private log (2.177988ms)
✔ chat project.create: each existing Console write fence makes zero bus calls (6.741435ms)
✔ chat project.create: refusal or lost/malformed receipt never retries or invents success (3.881328ms)
✔ chat thread.create: one verified write, fixed identity/class and private log (1.282899ms)
✔ chat thread.create: each existing Console write fence makes zero bus calls (6.492244ms)
✔ chat thread.create: refusal or lost/malformed receipt never retries or invents success (3.376929ms)
✔ chat thread.send: one verified write, fixed identity/class and private log (1.218434ms)
✔ chat thread.send: each existing Console write fence makes zero bus calls (5.297186ms)
✔ chat thread.send: refusal or lost/malformed receipt never retries or invents success (3.045893ms)
✔ chat thread.open: one verified write, fixed identity/class and private log (1.093096ms)
✔ chat thread.open: each existing Console write fence makes zero bus calls (5.706024ms)
✔ chat thread.open: refusal or lost/malformed receipt never retries or invents success (3.010259ms)
✔ chat createThread receipt requires an instance even when its id is valid (1.918607ms)
✔ chat write receipts expose only the fields belonging to their operation (3.206521ms)
✔ chat validates names, body, project and strict empty open payload (4.821072ms)
✔ chat read failures redact ownership and refuse invalid transport arrays (5.618177ms)
✔ REQ-USER-2 real broker: owned catalog, create/name/filter, isolated history and 403/404 without mutations (90.748147ms)
✔ chat repeats every POST boundary even when called behind an admitted request (0.833696ms)
✔ configured Console process injects chat through its existing human transport (133.521935ms)
✔ chat assets, GET purity, method and unknown-route refusals are explicit (11.226856ms)
✔ the chat seam names the transport it is given: the human one and the tester one both pass, anything else is a TypeError (0.427616ms)
✔ C2-09a createThread forwards an explicit instance through the existing channel (3.442901ms)
✔ C2-09a malformed instance and extra thread fields refuse before the channel write (3.151853ms)
✔ 264e session catalog/create and explicit selectors keep the human transport and strict keys (4.390959ms)
✔ 264e session writes retain Origin/identity fences and explicit selector errors (2.283871ms)
✔ 264e clear envelope is projected, pending is preserved and GET never repeats the clear (3.67385ms)
✔ 264e cancel is an authenticated, confirmed human write and retains retirement distinction (6.231344ms)
✔ 272 N1: malformed clear/cancel write receipts get one redacted outcome-unknown audit line (4.493454ms)
✔ conversation view: full history, collapsed tools, hidden thinking, inert hostile content, malformed and reconcile markers (1005.423417ms)
✔ conversation view: a fork keeps the open branch, says so, and opens the new one on request (1370.56904ms)
✔ conversation view: a newer session with no readable history keeps the marker (954.423136ms)
✔ conversation view: seats without history say so and offer no reply (661.083302ms)
✔ J16: no controls without sso and decide, read-only reasons, terminal lines kept, and only an eligible grant gets the panel (4815.646894ms)
✔ J17: one POST per click, confirm then answer, cancel, refusals and an unknown outcome never retry (3929.059474ms)
✔ a sign-in redirect at either step signs the page out and answers nothing (1457.865765ms)
✔ a signed-in owner confirms and answers, with the session's provider, issuer and sub as the subject (70.013805ms)
✔ the listener gates: no session, a cross-origin page, a loopback Host, a GET, and a sign-out between the steps (92.743885ms)
✔ J16: without a decision transport the routes are read-only and /api/config says no; startServer refuses decide without sso or send (172.195474ms)
✔ J19: a granted user's session gets decide false and the user page config, and a decision POST stops at owner-only (37.306927ms)
✔ N4: decision.resolve has no Console route, the --send caller names no decision verb, and consoleCall takes only the two console verbs (36.688496ms)
✔ a confirmation then a resolve answers once with the held choice and digest, and a second resolve refuses (2.676004ms)
✔ deny resolves without a grant field (0.334827ms)
✔ the gates before the body: method, read-only, sign-in and same origin (0.377549ms)
✔ a bad body, id or content type refuses before the bus (0.595313ms)
✔ a choice that is neither key is decision-stale, and a malformed preview is confirmation-unavailable (0.51847ms)
✔ bus refusals map by code, and an unknown or missing code is unavailable at preview and outcome-unknown at resolve (1.757134ms)
✔ a confirmation binds the session, decision and choice, and any mismatch spends it (0.48989ms)
✔ a session that ends between the steps refuses before the bus (0.311432ms)
✔ confirmations expire after the TTL, cap at the limit without dropping a live one, and are one use (0.195193ms)
✔ Discord row through real board/WebUI: independent brake/liveness, no Reply, literal content (580.425029ms)
✔ the editor: the list, hostile markdown that runs nothing, the draft, and each save receipt (1538.990805ms)
✔ the Console's CSP stands and the editor runs under it; hostile markdown on the load path runs and loads nothing (878.229666ms)
✔ hostile content pasted into the editor runs and loads nothing, and a bad link target is refused in the link bar (684.461512ms)
✔ a pasted image span is kept only for a target the link gate accepts, and a save writes only those (550.259133ms)
✔ a switch of view reads nothing; a reload, and a trip away and back, each read the file exactly once (2485.105458ms)
✔ an edit rewrites only the block touched; a save sends the rest byte for byte; the Source view carries the draft (985.988893ms)
✔ a file the editor cannot write back byte for byte opens as Source, says so, cannot save, and the Visual button works once it can (1940.942348ms)
✔ a link title pasted with line breaks in it is written on one line, so no HTML block comes of it (545.329956ms)
✔ an image alt pasted with line breaks in it is written on one line, so no HTML block comes of it (541.469322ms)
✔ an image title pasted with line breaks in it is written on one line, so no HTML block comes of it (541.761624ms)
✔ a code block info string pasted with line breaks in it is written on one line, so no HTML block comes of it (529.938542ms)
✔ a link title holding a quote after a backslash then a tag is written with the backslash escaped, so the title stays closed (589.242396ms)
✔ an image title holding a quote after a backslash then a tag is written with the backslash escaped, so the title stays closed (496.075229ms)
✔ a link title holding a trailing backslash is written with the backslash escaped, so the title stays closed (495.515484ms)
✔ an image title holding a trailing backslash is written with the backslash escaped, so the title stays closed (559.520726ms)
✔ a code block info string with a backtick, pasted, is dropped on Save, so the fence stays closed (522.449511ms)
✔ a code block info string with a backtick, as a tilde fence can have, is kept as source, not rewritten without it (560.892119ms)
✔ the imported source is the tagged upstream source plus the recorded local changes, and nothing else (11.805683ms)
✔ every package names its origin and license, and NOTICE lists each (0.494144ms)
✔ the build reads only imported source and the editor's own files; the bundle is the recorded build (5.659658ms)
✔ MOSAIC_REQUIRE_EDITOR_BUILD: a missing or wrong esbuild skips without it and fails with it; a wrong binary always fails (3.429329ms)
✔ the toolchain check, run as a program, exits non-zero without esbuild when the build is required (117.432817ms)
▲ [WARNING] Ignoring this import because "third_party/editor/prosemirror-transform/src/mark.ts" was marked as having no side effects [ignored-bare-import]
third_party/editor/prosemirror-transform/src/index.ts:10:7:
10 │ import "./mark"
╵ ~~~~~~~~
"sideEffects" is false in the enclosing "package.json" file:
third_party/editor/prosemirror-transform/package.json:13:2:
13 │ "sideEffects": false,
╵ ~~~~~~~~~~~~~
✔ rebuilding from the source gives the same bytes (needs the pinned esbuild; MOSAIC_REQUIRE_EDITOR_BUILD=1 makes its absence a failure) (70.671292ms)
✔ the editor routes serve the built files with their types and no cache (33.152872ms)
✔ open and save with no edit writes the same bytes: the goals review and a doc with every element (14.952097ms)
✔ open and save with no edit writes the same bytes: every repository doc under docs/ and spec/ (1354.689164ms)
✔ the editor source builds markup only with DOM calls, and the bundle has no eval (2.049203ms)
✔ the link gate and the image rule are the preview's (0.333066ms)
✔ R6 G1 a granted user signs in, gets the user page and reaches the broker as itself (82.134951ms)
▶ R6 G2 a subject with no live grant in this business is refused subject-unknown
✔ a listed user with no grant (40.944625ms)
✔ a grant in another business (42.037987ms)
✔ an expired grant (147.367931ms)
✔ another user's grant (139.465978ms)
✔ a sub in no file (63.607001ms)
✔ a file the loader refuses (62.135909ms)
✔ R6 G2 a subject with no live grant in this business is refused subject-unknown (496.381708ms)
▶ R6 G3 a revoke counts on the next request: 401 and the session is gone
✔ grant removed (49.252373ms)
✔ subject removed (62.077208ms)
✔ grant expired (91.401492ms)
✔ file now refused (43.84123ms)
✔ R6 G3 a revoke counts on the next request: 401 and the session is gone (247.211075ms)
✔ R6 G4 every owner route answers 403 owner-only before any bus call (91.916815ms)
✔ R6 G5 the bus refuses every owner verb over the user transport on its own (76.065246ms)
✔ R6 G9 a user chat sends only the plugins read over the owner transport (75.816462ms)
✔ R6 G6 the user page holds the notice word for word (68.007509ms)
✔ R6 G7 the hub label and plain peer links render from config on both pages (769.528743ms)
✔ R6 G8 userCall spawns user-cli directly with the user nonce, no human nonce, and the user request (38.957533ms)
✔ return flow through the conversation view: send, tool call, delayed result, peer message, exact long answers, relaunch (51936.406505ms)
✔ row 165 Settings: role instances read, add with a restart named, change without one, a refusal keeps the draft (991.579686ms)
✔ row 165 Console: the signed-in human adds an instance through a real broker; validate exits 0, the log names the human and no restart is needed (row 194) (193.463891ms)
✔ row 165 Console: the instance write needs send on, the public name, the user, the exact Origin and same-origin Fetch Metadata (5.88349ms)
✔ row 165 Console: the instance write takes JSON within 16 KiB and only its own keys; holder, credentials and an actor are refused (6.540542ms)
✔ row 165 Console: a bus refusal says nothing changed; a lost or odd answer says the change may have been made (9.74122ms)
✔ row 165 Console: the instances read takes no arguments, needs a bus and refuses an answer without a revision (4.463583ms)
✔ C2-04 CLI: both listener callback pairs dispatch library verbs with their own transport (130.905358ms)
✔ row 254: each library sync code maps to its status (0.572723ms)
✔ REQ-LIMIT-3 REQ-LIMIT-4 Settings shows token limits counted, not enforced and check failed; Reset posts one path; a save keeps the token limits (975.696605ms)
✔ Row 167 with an assistant draft open, a token limit reset gives the assistant submit its revision (669.50689ms)
✔ REQ-LIMIT-3 limits read returns only the token rows; no query or write is accepted (26.70046ms)
✔ REQ-LIMIT-3 a limits answer without a token list is refused, not shown as no limits (7.994198ms)
2026-10-24T05:53:21.357Z settings user="jason" changed
✔ REQ-LIMIT-3 a Settings reset reaches the human write with its paths; a reset alone is enough (5.567108ms)
✔ REQ-LIMIT-3 the Console reader asks the bus limits verb with no arguments (0.235819ms)
✔ the preview source names none of the four string-to-markup sinks (0.846655ms)
✔ headings, paragraphs, emphasis and inline code render (1.131421ms)
✔ lists, block quotes and code blocks render (0.397914ms)
✔ a link is made for http, https and relative targets, with rel and the target shown (0.889923ms)
✔ a link with any other scheme, or an evasion of the scheme, stays source text (0.706367ms)
✔ an image shows alt text and URL, is never an img element and never loads (0.140692ms)
✔ raw HTML, entities and unsupported blocks show as source text, never as elements (0.276815ms)
✔ markup inside code and inside link text stays text (0.153012ms)
✔ hostile and pathological input stays within its look-ahead budget and under the nesting cap (31.828155ms)
✔ trailing blanks and closing hashes are cut by a walk from the end, not a regex that retries inside a blank run (25.168256ms)
✔ a link opener with no closer searches at most SPAN characters ahead (137.844248ms)
✔ the look-ahead work of one render is a fixed multiple of the text, whatever the opener (712.427405ms)
✔ past the budget an opener is source text, through the path all other text takes (14.790124ms)
✔ a normal 200 KiB document renders exactly as it did without a budget, and spends little of it (18.081668ms)
✔ a line separator inside a heading, a list item or a fence line does not end the marker line (0.486523ms)
✔ a thematic-break line is a paragraph, every other marker line opens a list (0.367498ms)
✔ every short line over space, tab, - * _ and a letter is a break exactly when the old regex said so (37.762407ms)
✔ one line of marks does not throw, at 4 MiB, whatever the mark or the spacing (6004.208904ms)
✔ CRLF and tabs are read like LF and spaces; empty input renders nothing (0.166234ms)
✔ messages HTTP read pages and preserves metadata; bad arguments refuse before a read; other reads unchanged (84.34292ms)
✔ Console Messages lists late unsolicited messages on polling with sender class time read state and trail; nav count includes beyond the page; reads never deliver (837.761934ms)
✔ Messages nav count polls on Tasks and Board and clears on a Board refusal; messages 403 refuses local pages (1639.975112ms)
✔ copy writes the Console paths at the full id, read-only, and leaves an existing copy alone (1706.657673ms)
✔ copy refuses a commit off refactor, an unknown one, a worktree and a bad copies directory (2260.993696ms)
✔ copy writes nothing when an archived path is missing at the commit (1015.292402ms)
✔ a copy that loses the rename race leaves no read-only temp directory behind (1239.052354ms)
✔ a copy whose rename fails with no target refuses, writes no copy and leaves no temp directory (1057.788945ms)
✔ a copy that meets a target holding files says exists: and moves nothing into it (1076.400999ms)
✔ a copy that meets an empty target directory replaces it by rename, not by moving into it (1032.466352ms)
✔ serve runs from a copy: /healthz 200, the config check, roles and RELEASE from the copy, the queue from --checkout (1472.800878ms)
✔ serve refuses a --checkout that is not an absolute directory path (273.230223ms)
✔ consoleReads runs the queue read under queueRoot and reads RELEASE under root (48.380515ms)
✔ preview options are all three or none, and each is checked (6.428862ms)
✔ the CLI refuses a partial or invalid preview flag set at start (664.583698ms)
✔ the CLI with all three flags serves the preview mode (146.290409ms)
✔ a request for the public name needs the header equal to the user id, else 401 and nothing read (21.367837ms)
✔ the header name matches without regard to case, and the value compare is exact (4.268357ms)
✔ the public name with the header reads the bus views, and the Host and Origin are checked first (28.252132ms)
✔ in preview mode every write answers 403 read-only, from the public name and loopback, and reaches nothing (13.326316ms)
✔ loopback requests are unchanged in preview mode, and the bus views work with the board down (5.577205ms)
✔ a proxy that rewrites Host to the loopback port gets 403 on its first request, whatever the user (18.130558ms)
✔ a repeated Host is 400 before any other check, in preview mode and without it (10.389963ms)
✔ without the preview flags the public name is refused and writes still reach the board (5.672682ms)
✔ processing browser: keyboard Stop, confirmed Resume, unknown outcome and persistent banner (765.31904ms)
✔ processing browser: Q175 read-only interim keeps both writes disabled and names CLI recovery at 320px (589.583065ms)
✔ processing browser: sign-out from config redirect blocks later refresh and writes (700.36576ms)
✔ processing browser: sign-out from state redirect blocks later refresh and writes (692.089186ms)
✔ processing browser: sign-out from write redirect blocks later refresh and writes (699.263448ms)
✔ processing browser: sign-out from config sign-in required blocks later refresh and writes (680.376298ms)
✔ processing browser: sign-out from state sign-in required blocks later refresh and writes (675.832789ms)
✔ processing browser: sign-out from write sign-in required blocks later refresh and writes (657.336986ms)
ROW191_LAYOUT {"width":400,"height":1000,"controls":97,"tree":324.0625,"main":1450.703125,"top":181.5,"bottom":217.5,"barBottom":129,"projectsTop":352.59375,"order":"0","visible":true}
ROW191_LAYOUT {"width":1440,"height":1000,"controls":127,"tree":914,"main":914,"top":135.5,"bottom":171.5,"barBottom":53,"projectsTop":636.59375,"order":"0","visible":true}
ROW191_LAYOUT {"width":1440,"height":420,"controls":127,"tree":334,"main":907.734375,"top":135.5,"bottom":171.5,"barBottom":53,"projectsTop":636.59375,"order":"0","visible":true}
ROW191_LAYOUT {"width":800,"height":420,"controls":127,"tree":334,"main":1131.65625,"top":135.5,"bottom":171.5,"barBottom":53,"projectsTop":618.59375,"order":"0","visible":true}
✔ processing browser: static nav controls keep Stop visible, ordered and keyboard reachable (603.718005ms)
✔ interim read-only controls show CLI recovery, disable both writes and retain a halted banner across views (7.334084ms)
✔ Stop sends one empty halt and Resume confirms before sending the displayed generation (2.849813ms)
✔ a cancelled resume never calls the writer (1.09297ms)
✔ unknown writes are not retried or displayed as success and partial stops remain explicit (1.839818ms)
✔ the persistent shell loads the control outside route-specific content with accessible status and native buttons (0.406741ms)
✔ read-only Console can read processing state but neither human control writes without --send (18.503358ms)
✔ Console halt and generation-bound resume use only the management writer and keep partial stops honest (3.909099ms)
✔ processing write fences refuse cross-site, wrong origin, unnamed host, duplicate identity and bad payload before writer (6.015997ms)
✔ tester cannot invoke either control writer and failures never echo backend text (3.943577ms)
✔ processing writes use the existing SSO signer and still require --send and same-origin (4.161332ms)
✔ processing handler independently refuses wrong origin and cross-site before its writer (0.550006ms)
✔ a signed-in same-origin save reaches exactly one human operation and returns the new commit (17.503534ms)
✔ a save needs send, the named Host, the user, the exact Origin and same-origin Fetch Metadata (6.181398ms)
✔ a save validates JSON, strict keys, text values and the 1 MiB body before the bus is asked (15.0983ms)
✔ a body that is JSON but not an object is refused 400, not thrown on (4.888629ms)
✔ the 1 MiB limit is this route only; Settings and messages keep 16 KiB (2.188725ms)
✔ a bus refusal is reported as not saved with its own status; stale-base tells the user to reload (5.071686ms)
✔ a save whose answer is lost or unusable is reported unknown and is never retried (3.102732ms)
✔ the file list and one file read take strict queries and arrive in the expected shape (4.368356ms)
✔ reads work without --send; an unusable bus answer is a bad response, a refusal keeps its status (2.429382ms)
✔ /api/config says edit only where a save can pass (1.854521ms)
✔ a repository-name project refusal is an HTTP conflict (0.512679ms)
✔ proof startup refuses partial flags non-preview and invalid fixture file metadata or bytes (1169.034096ms)
✔ serve argv carries only fixture proof path and header; startup explicitly reports proof on or off (243.582574ms)
✔ CLI applies proof on the main listener and rejects that header on its tester listener (226.911465ms)
✔ proxy proof admits named reads and sends, reads its fixture once, and never exposes the value (29.428285ms)
✔ proxy proof refuses missing wrong short or repeated proof before auth and before any read (8.872495ms)
✔ proxy proof header is refused on other Hosts and on the tester listener (4.215652ms)
✔ proof options reject unsafe or colliding header names without disclosing file contents (0.628262ms)
✔ redactor: config, dataRoot, any absolute path, Discord ids and the JSON parser quote (1.187629ms)
✔ credential state from the date alone, as the bus states it (0.131716ms)
✔ queue: rows, one row, ids and methods, notes; no path or id from a row (324.251778ms)
✔ queue: a refused read fails closed with the store's text, redacted (166.918485ms)
✔ queue: a store that fails to load, or a child that dies, gives a fixed message with no path or stack (702.513606ms)
✔ business: names, vars on the allowlist, authority, credential metadata only (8.976419ms)
✔ business: missing or invalid file refuses with the module's text, redacted (6.080389ms)
✔ business without --business: the live bus host, else no-bus-host; no system config: not-configured (6.341439ms)
✔ settings: release, board, loopback address, notifier binding name only (98.9594ms)
✔ task fields: the committed table with no reads configured, GET only; a bad table refuses with no path (16.845946ms)
✔ bus-status: a refused boot shows reason, file and last good load; a live host or an ok boot clears it (6.721379ms)
✔ both presentations replace old activity with relaunch notice, label retained history, then resume after new activity (636.416956ms)
✔ reported return flow and relative Age: reply sent from the inspector, then the new answer appears there without manual refresh (20712.001803ms)
organization: {"event":"reload-needs-restart","business":"acme"}
organization: {"event":"reload-needs-restart","business":"acme"}
✔ row 65 Settings: the routing table lists every instance, saves a harness, model, thinking and fallback to the file, and keeps the draft on each refusal (1289.24343ms)
organization: {"event":"reload-needs-restart","business":"acme"}
✔ row 65 Console: the signed-in human saves a route through a real broker; each refusal says nothing changed and leaves the file and the log (103.948331ms)
✔ row 65 Console: the routes write needs send on, a writer, the public name, the user, the exact Origin and same-origin Fetch Metadata (6.771368ms)
✔ row 65 Console: the routes write takes JSON within 16 KiB with a revision and routes only; an actor is refused and routes are never logged (7.008611ms)
✔ row 65 Console: a bus refusal maps to its status and says nothing changed; a lost or odd answer says the change may have been made (25.506113ms)
✔ row 65 Console: the routes read takes no arguments, needs a bus and refuses an odd answer (5.997376ms)
✔ the send box: held roles, the draft and caret across a refresh, each receipt, one POST per Send, and the trail link; the board Reply on a 4xx and a 5xx (2339.8884ms)
✔ a sent receipt lists its replies as the page refreshes, oldest first and capped, and marks none delivered or read (11096.659422ms)
✔ startServer takes send only as a function and only with the preview mode (5.436794ms)
✔ the CLI refuses --send without the preview flags, and without a configured bus (449.118647ms)
✔ the CLI with --send and a configured bus sends through the human transport and logs one line (150.581681ms)
✔ without --send the route is read-only like every other write, and config says no send (7.231271ms)
✔ with --send every other write is still 403 read-only, and nothing reaches the board or bus (5.874475ms)
✔ config says send only on the public name with --send on (2.230966ms)
✔ a send without the signed-in user is 401 and is neither sent nor logged, loopback included (3.855927ms)
✔ each request check refuses before anything is sent, and logs the refusal without the body (12.123809ms)
✔ a send passes exactly to, body and in_reply_to, answers the id, and logs it (2.548018ms)
✔ a crafted role name cannot forge a log line (1.815113ms)
✔ a bus refusal is not sent, with its status; an outcome the bus could not confirm is unknown and never retried (6.025781ms)
✔ through the human transport the request is exactly the business, message.send and the keys (82.134733ms)
✔ against a real broker: the message is written once as a human send, and its refusals map (32.652181ms)
✔ loopback host and board origin fail closed (6.088571ms)
✔ real board fixture passes through WebUI; assets and isolated seen/reply work (71.586234ms)
✔ proxy preserves exact request bytes, status and receipt, rejects forms and malformed JSON, never follows redirect (39.352406ms)
✔ unreachable board reports URL; CLI rejects unsupported options (398.535455ms)
✔ tester service render carries the tester port alongside existing flags (95.469287ms)
✔ tester service refuses forwarded 7332 even with another main port (58.686381ms)
✔ tester service invalid ports refuse render and install with exit 4 and leave the unit alone (703.380562ms)
✔ tester service counts the digits as written before it strips leading zeros (65.126118ms)
✔ tester service install and status show the tester port without changing send reporting (358.896996ms)
✔ render prints the unit without the preview flags (33.100741ms)
✔ render carries every serve flag, the preview set included (34.839285ms)
✔ a partial preview set is refused (94.945574ms)
✔ a value the unit cannot carry is refused, for every flag (1668.211167ms)
✔ the rendered unit names none of the human proof agent markers and sets no agent variable (105.101552ms)
✔ install into --dir with --no-reload writes the file whole, then reports unchanged (193.571828ms)
✔ install without --no-reload runs daemon-reload and nothing that starts the unit (44.720501ms)
✔ uninstall refuses while the unit is running, with or without --no-reload, and removes it once it is not (441.860555ms)
✔ status prints the unit state and GET /healthz on the installed port (265.638824ms)
✔ usage: an unknown verb or flag, and start or enable, exit 4 (629.337843ms)
✔ without --send, render is the template with its placeholders filled, byte for byte (173.097355ms)
✔ render --send with the preview set ends ExecStart with --send and changes nothing else (279.635691ms)
✔ --send without the whole preview set is refused and writes nothing (667.172745ms)
✔ install --send into --dir with --no-reload writes the sending unit, and status says whether it sends (450.623337ms)
✔ uninstall and status take no --send (149.404818ms)
✔ install refuses while the unit is running, in any state but inactive or failed, and changes nothing (654.290201ms)
✔ when the state read fails, install and uninstall refuse with one line and change nothing (210.540626ms)
✔ install needs --copy naming a copy that exists, and refuses outside the canonical checkout without --allow-worktree (293.268822ms)
✔ install refuses unless the bus unit runs from the same copy, naming both paths, and changes nothing (631.243119ms)
✔ render --copy runs the copy and reads the queue in the checkout; without --copy the unit is unchanged (93.452901ms)
✔ the uid header takes only an Authentik uid; the username header still takes a username (1786.499417ms)
✔ a preview value cannot start with - or . (190.355117ms)
✔ status names the copy and whether refactor has moved past it, and says when the unit runs from no copy (521.398589ms)
✔ proxy proof render carries both flags but never opens the fixture file (35.027753ms)
✔ proxy proof render refuses incomplete non-preview missing unsafe-mode and repo/copy paths (378.504771ms)
✔ proxy proof status retains send and tester reporting with both proof flags (156.354779ms)
✔ row196 socket flag renders only for supporting targets and refuses mixed transports (91.044454ms)
✔ Settings form shows every scope and held role; gated save, exact payload, retained draft and no automatic retry (1149.397483ms)
✔ Q169 Assistant section: gated, changed fields only, name and stop posts, retained draft and no automatic retry (1202.434375ms)
✔ Row 167 a refused names read gives the refused usage page; another names failure keeps the Assistant section (828.93179ms)
✔ Row 167 with a limits draft open, an assistant save gives the limits submit its revision and the typed limit stays (698.454133ms)
✔ Row 167 with an assistant draft open, a launch save gives the assistant submit its revision, and reload reads the current one (686.551532ms)
2026-10-24T05:54:48.215Z settings user="jason" changed
✔ REQ-WEB-1 signed-in same-origin Settings write reaches exactly one human operation (16.774402ms)
✔ REQ-WEB-1 Settings writes require enabled send, named Host, identity, exact Origin and same-origin Fetch Metadata (5.785092ms)
✔ REQ-WEB-1 Settings validates JSON, size, revision and strict writable keys before broker call (4.72348ms)
✔ Q169 a Console change of the assistant reaches the human operation unchanged, and the log names the signed-in user (2.505956ms)
✔ tokens.css and icons.svg are byte copies of docs/design (0.744344ms)
✔ JetBrains Mono files match the digests in their sources file, with the OFL text (1.776009ms)
✔ shipped strings are unchanged, and the web keeps its write boundary (3.276718ms)
ROW191_LAYOUT {"width":1440,"height":1000,"controls":212.5,"tree":914,"main":914}
✔ shell in a browser: System default, seeded states, 400px, focus and the Ctrl+K palette (5611.131411ms)
✔ five states on Board, Inbox, Tasks, Agents and Trail (2403.421938ms)
✔ a 401 sign-in required on each fetch path signs the page out with a sign-in link and stops the refresh; another 401 stays an error (5576.793869ms)
✔ the Sign out form shows only when /api/config says sso, and posts to /auth/logout (989.677029ms)
✔ positive: an RS256 provider signs in and sends one message, and the session reads (91.893637ms)
✔ positive: an ES256 provider signs in and sends (15.625044ms)
✔ positive: two providers each sign in their own subjects, and one provider's subject is unknown to the other (66.787533ms)
✔ 1: a forged x-authentik header without a cookie is 401 on the API and a sign-in redirect on a page (42.725108ms)
✔ 2: an HS256 ID token keyed with the client secret and a real RSA kid is refused (23.753077ms)
✔ 3: a wrong aud, and an aud list holding another client with no azp, are refused (98.135791ms)
✔ 4: a token that expired 10 minutes ago is refused (36.300718ms)
✔ 5: another issuer, and the issuer without its trailing slash, are refused (51.400149ms)
✔ 6: a nonce mismatch and a missing nonce are refused (38.472602ms)
✔ 7: state mismatch, no login cookie, a replay, an expired record and two login cookies are refused (89.360558ms)
✔ 8: the token request carries the PKCE verifier, and the OP refuses a wrong one (89.511481ms)
✔ 9: alg none, a changed payload under a real kid, and an unknown kid even after the refetch are refused (122.689814ms)
✔ 10: a valid token for a subject not configured is 403 with one subject-unknown line (30.706987ms)
✔ 11: start refusals: HS or none algs, reserved names, HS-only discovery, an empty JWKS, no S256, an issuer mismatch, a short RSA key (260.021698ms)
✔ 11: slot files: a symlink, mode 0644, mode 0640 and a file under the repository are refused, and no message holds the value (2.066508ms)
✔ 11: the CLI refuses --sso with the old flags and without console.sso, and starts with a good one (1041.934871ms)
✔ 12: under --sso the tester listener refuses each kind of sign-in, has no /auth, and startServer refuses tester with sso (72.329262ms)
✔ 13: idle and absolute expiry, logout then reuse, a cross-origin logout, and background reads that don't keep a session (61.151874ms)
✔ 13: the CSP lets the Sign out form reach the provider's end-session origin, and only under --sso (83.673402ms)
✔ 14: open redirects land on /, and a path on the Console lands there (43.000196ms)
✔ 15: a callback for A carrying B's code and iss, and a provider= query, is refused (179.356624ms)
✔ 16: a provider with RS256 and ES256 takes either, and refuses PS256 with a usable PS256 key in the JWKS (73.208932ms)
✔ 17: 33 started logins leave 32 records, and the first one's callback finds none (83.204408ms)
✔ 18: after a key rotation a sign-in works through one refetch, and the removed kid is refused (68.667369ms)
✔ 20 and 21: the store holds no raw session id, and the cookie strings are exact (52.309181ms)
✔ 22: a loopback Host is 403 on a page, a read and a write; /healthz on loopback is 200; a redirect_uri never comes from the Host (47.799698ms)
✔ 23: a provider down at start leaves the Console up and 503, and the retry makes sign-in work (220.406623ms)
✔ 19: no captured log line holds a token, code, state, nonce, verifier, client secret or session id (4.620525ms)
✔ tester Console banner exposes only instance route and name editors and saves a route as tester (775.631416ms)
✔ row 177: the tester Console chat composer is enabled and a send shows in its own thread (615.88403ms)
✔ tester-port validates range tunnel main port and requires configured bus before listening (886.511066ms)
✔ CLI tester listener binds a private Unix socket and spawns TESTER_CLI for every Console bus read (2552.468157ms)
✔ main listener refuses x-mosaic-tester before any board or bus read for every Host (18.054152ms)
✔ tester listener rejects preview binding and requires its fixed logical Host and no proxy auth header (101.487921ms)
✔ tester listener writes only instances routes and names with tester receipts and actor (118.690594ms)
✔ tester listener refuses every human-only write with no bus call (78.483618ms)
✔ tester-off and tester-required reads return HTTP 403 (81.141155ms)
✔ tester credentials routes and committed project reads keep secrets and paths bounded (151.187355ms)
✔ row 177 W1: the tester chat makes, sends to, opens and reads its own thread as tester (22.229762ms)
✔ row 177 W2: tester chat writes refuse a missing or foreign Origin, cross-site, text/plain and the proxy header with no bus call (11.497956ms)
✔ row 177 W3: the human thread through the tester chat is thread-not-owned, and bus.tester off answers tester-off (27.903135ms)
✔ row 177 W4: the main listener refuses x-mosaic-tester on chat reads and writes before the chat (1.945782ms)
✔ Row 252: the tester listener has no decision answer routes, and its config never offers them (80.149998ms)
✔ private tester HTTP serves on 0600 socket in 0700 parent and fixed origin (61.944248ms)
✔ private tester refuses symlink, unsafe parent and long path without repairs (0.861963ms)
✔ tester cleanup must leave a replacement inode untouched (1.465444ms)
✔ pinned source keeps all original files and Princeton license bytes (36.50702ms)
✔ two complete conversions match shipped bytes and pinned counts (4310.208292ms)
✔ changed source, missing license, changed provenance and extra files refuse before output (64.379074ms)
✔ data parser refuses malformed words, offsets, pointers, verb frames and trailing fields (0.3536ms)
✔ index parser refuses wrong counts, nonexistent senses and incorrect lemma mapping (0.261971ms)
✔ offline importer refuses incorrect archive bytes before extraction (0.385742ms)
✔ verified pinned ZIP round-trips to all original text files (456.953703ms)
✔ row278 browser lists held claims and release preserves role rows and totals (624.706447ms)
✔ row278 browser claims 403 stays local and role section remains byte-equal (631.071998ms)
✔ row278 browser renders only four escaped claim fields and never instance or other extras (576.777382ms)
✔ row278 browser sign-out removes claims and prevents reuse of cached answers (640.568833ms)
✔ row278 tester browser keeps role rows without requesting the owner claims section (467.05576ms)
✔ row278 browser discards a late claims answer after sign-out (614.541457ms)
✔ row278 HTTP read returns held claims without send and refuses arguments before the bus (29.289475ms)
✔ row278 HTTP read preserves bus refusal and rejects a malformed result (8.116407ms)
✔ row278 tester socket refuses thread claims explicitly with zero bus calls (4.484986ms)
✔ row278 Console adapter calls argument-free thread.claims through the normal transport (124.206412ms)
✔ 193d HTTP shares use the caller, plain/shared lists, exact args and write fences (75.202228ms)
✔ 193d config supplies only the signed-in user live collaborator scopes and updates on downgrade (34.238825ms)
✔ 193d viewer UI has no composer, resume, share, session mutations or create controls (516.480948ms)
✔ 193d mixed grants keep viewer project read-only and collaborator own thread writable; downgrade hides controls (634.31794ms)
✔ 193d owner has share controls on own threads and shared threads remain read-only (407.707207ms)
✔ 193d bypassed UI checks still reach a refusing bus for every viewer write (481.425536ms)
✔ 193d collaborator shares stay read-only and never expose reshare or wake controls (476.049259ms)
✔ REQ-LIMIT-4 Settings shows all token kinds and unknown turns beside every total, as a read-only separate section (568.273975ms)
✔ REQ-WEB-1 usage read keeps unknown counts and each token kind; no query or write is accepted (28.001462ms)
✔ REQ-WEB-1 malformed usage is refused instead of shown as zero (5.810443ms)
✔ R6-N1 with the userRoute gate open, a user session reaches no owner option over HTTP (121.924867ms)
✔ Queue, Business and Settings in their five states, with no move button (3101.488368ms)
✔ seeded secrets, Discord ids and paths reach no response and no page; business refusals in the module's words (1089.111187ms)
✔ the server log names no config path when the system config refuses (317.48495ms)
ℹ tests 425
ℹ suites 0
ℹ pass 425
ℹ fail 0
ℹ cancelled 0
ℹ skipped 0
ℹ todo 0
ℹ duration_ms 277018.268665
File diff suppressed because it is too large. Load diff
+55
View File
@@ -0,0 +1,55 @@
{
"schema": 1,
"sourceManifestSha256": "e5a799a6693321be71c4e99080b9f89ba12a304c3092d05839bb85355194fe76",
"archive": {
"bytes": 10775600,
"sha256": "cbda5ea6eef7f36a97a43d4a75f85e07fccbb4f23657d27b4ccbc93e2646ab59"
},
"counts": {
"synsets": 117659,
"headwords": 147306,
"literalLemmas": 149229
},
"countMethod": "Union of first-field headwords across four index.* files; cross-checked with lowercased data.* lemmas stripping terminal (a)/(p)/(ip). Literal data lemmas counted without normalization.",
"openNote": "Princeton statistics page union 147278 differs by 28; unresolved, accepted in sage-3972.",
"tools": {
"node": "v26.8.1",
"initialImportPython": "3.12.8",
"converter": "Node.js >=24, standard library only; JSON UTF-8 LF, no timestamps, no locale sorting",
"importer": "Node.js >=24 plus Python 3 stdlib zipfile; local pinned ZIP only"
},
"inputs": {
"editor-data/import-wordnet.mjs": "9b3a668b83d40b5c2659b56c647c40db494d8a9f35fb7ab463b46892ae0d530a",
"editor-data/build-thesaurus.mjs": "f1b0b062452fedfb1298f9785f4934046a8b6a0ed8704f5cb82c683d6deb60aa"
},
"outputs": {
"noun.json": {
"bytes": 15617486,
"sha256": "5294d3f0e6cd7924f5be97d4d6e64b96a9dd8505f216e5c056c3f5b69c0c2dc9"
},
"verb.json": {
"bytes": 2327528,
"sha256": "3f99489858d8cbce9996c72135f82325bd2c067a64d2fb8b80dea386b99b6392"
},
"adj.json": {
"bytes": 3319398,
"sha256": "9965dbfdc35a11b829fedb19e7b22ab3ca8470f45c5532c1f310810012a23023"
},
"adv.json": {
"bytes": 648351,
"sha256": "c6effb7a1502cd3dcd81341cb296e039d238786712c91c30994f2e50ef1e9fcb"
},
"LICENSE": {
"bytes": 1625,
"sha256": "7731175a77952e259390b496fab905e57118b8d19ad3a8383c67eee724ff443f"
},
"NOTICE": {
"bytes": 649,
"sha256": "508e1a5d132e05ec888a79ec959b68d25203fee0aa3692b0610da7500a7c0251"
},
"manifest.json": {
"bytes": 1623,
"sha256": "2c58e1513991ea7505ffd8d9dda6e5e8189f8984a7167b051834eb9306e15c72"
}
}
}
@@ -0,0 +1,179 @@
// Offline WordNet 3.0 -> JSON. No network or runtime/editor integration.
// node editor-data/build-thesaurus.mjs [--out DIR] | --measure (with --expose-gc)
import { createHash } from 'node:crypto';
import { readFileSync, writeFileSync, mkdirSync, readdirSync, lstatSync } from 'node:fs';
import { dirname, join, resolve } from 'node:path';
import { fileURLToPath } from 'node:url';
const root = dirname(dirname(fileURLToPath(import.meta.url)));
export const SOURCE = join(root, 'third_party/thesaurus');
export const PROVENANCE_SHA256 = 'e5a799a6693321be71c4e99080b9f89ba12a304c3092d05839bb85355194fe76';
export const EXPECTED = Object.freeze({ synsets: 117659, headwords: 147306, literalLemmas: 149229 });
const POS = { noun: 'n', verb: 'v', adj: 'a', adv: 'r' };
const pointerSymbols = new Set('! @ @i ~ ~i #m #s #p %m %s %p = + ;c -c ;r -r ;u -u * > ^ $ & < \\'.split(' '));
const sha = b => createHash('sha256').update(b).digest('hex');
const json = o => Buffer.from(JSON.stringify(o) + '\n');
const normalize = word => word.replace(/\((?:a|p|ip)\)$/, '').toLowerCase();
function requireThat(ok, message) { if (!ok) throw new Error(message); }
function regular(path) {
requireThat(lstatSync(path).isFile(), `source integrity: regular file required: ${path}`);
return readFileSync(path);
}
export function validateSource(sourceRoot = SOURCE) {
const provenance = regular(join(sourceRoot, 'PROVENANCE.json'));
requireThat(sha(provenance) === PROVENANCE_SHA256, 'provenance integrity mismatch');
const m = JSON.parse(provenance);
const names = Object.keys(m.files).sort();
requireThat(!lstatSync(join(sourceRoot, 'wordnet')).isSymbolicLink(), 'source integrity: symlink directory');
requireThat(JSON.stringify(readdirSync(join(sourceRoot, 'wordnet')).sort()) === JSON.stringify(names), 'source inventory mismatch');
let total = 0, lookup = 0;
for (const name of names) {
const b = regular(join(sourceRoot, 'wordnet', name)), pin = m.files[name];
requireThat(b.length === pin.bytes && sha(b) === pin.sha256, `source integrity mismatch: ${name}`);
total += b.length;
if (/^(?:data\.|index\.)|\.exc$/.test(name)) lookup += b.length;
}
requireThat(total === m.uncompressedBytes && lookup === m.lookupBytes, 'source byte count mismatch');
requireThat(regular(join(sourceRoot, 'LICENSE')).equals(regular(join(sourceRoot, 'wordnet/LICENSE'))), 'LICENSE integrity mismatch');
const notice = regular(join(sourceRoot, 'NOTICE')).toString('utf8');
requireThat(notice.includes('Princeton') && notice.includes('LICENSE'), 'NOTICE missing attribution');
return m;
}
function lines(text, callback) {
requireThat(typeof text === 'string' && /^[\x20-\x7e\n]*$/.test(text) && text.endsWith('\n'), 'malformed ASCII source');
let offset = 0;
for (const line of text.slice(0, -1).split('\n')) {
if (!line.startsWith(' ')) { requireThat(line.length > 0, 'malformed blank record'); callback(line, offset); }
offset += line.length + 1;
}
}
export function parseData(text, part) {
requireThat(Object.hasOwn(POS, part), 'malformed part of speech');
const synsets = Object.create(null), pointers = [];
lines(text, (line, offset) => {
const fail = () => { throw new Error(`malformed data.${part} at byte ${offset}`); };
const bar = line.indexOf('|'); if (bar < 0) fail();
const f = line.slice(0, bar).trim().split(/ +/); let i = 0;
const take = re => { const v = f[i++]; if (!re.test(v ?? '')) fail(); return v; };
const id = take(/^\d{8}$/); if (+id !== offset || Object.hasOwn(synsets, id)) fail();
const lexFile = +take(/^\d{2}$/); if (lexFile > 44) fail();
const pos = take(/^[nvasr]$/); if (pos !== POS[part] && !(part === 'adj' && pos === 's')) fail();
const count = parseInt(take(/^[0-9a-f]{2}$/), 16); if (!count) fail();
const lemmas = [];
for (let n = 0; n < count; n++) { lemmas.push(take(/^\S+$/)); take(/^[0-9a-f]{1,2}$/); }
const pcount = +take(/^\d{3}$/);
for (let n = 0; n < pcount; n++) {
const symbol = take(/^\S+$/); if (!pointerSymbols.has(symbol)) fail();
const target = take(/^\d{8}$/), targetPos = take(/^[nvar]$/), words = take(/^[0-9a-f]{4}$/);
const from = parseInt(words.slice(0, 2), 16), to = parseInt(words.slice(2), 16);
if (from > count || (from === 0) !== (to === 0)) fail();
pointers.push({ target, targetPos, to });
}
if (part === 'verb') {
const frames = +take(/^\d{2}$/);
for (let n = 0; n < frames; n++) {
take(/^\+$/); const frame = +take(/^\d{2}$/), word = parseInt(take(/^[0-9a-f]{2}$/), 16);
if (frame < 1 || frame > 35 || word > count) fail();
}
}
const gloss = line.slice(bar + 1).trim(); if (i !== f.length || !gloss) fail();
synsets[id] = { pos, lemmas, gloss };
});
return { synsets, pointers };
}
export function parseIndex(text, part, synsets) {
const index = Object.create(null);
lines(text, line => {
const f = line.trim().split(/ +/), word = f[0], count = Number(f[2]), pcount = Number(f[3]);
const fail = () => { throw new Error(`malformed index.${part}: ${word}`); };
if (f[1] !== POS[part] || word !== word.toLowerCase() || Object.hasOwn(index, word)
|| !/^\d+$/.test(f[2] ?? '') || !/^\d+$/.test(f[3] ?? '') || count < 1) fail();
if (f.length !== 6 + pcount + count || f.slice(4, 4 + pcount).some(p => !pointerSymbols.has(p) && ![';', '-'].includes(p))) fail();
const senses = f.slice(6 + pcount);
if (+f[4 + pcount] !== count || !/^\d+$/.test(f[5 + pcount]) || +f[5 + pcount] > count || new Set(senses).size !== count) fail();
for (const id of senses) {
if (!/^\d{8}$/.test(id) || !Object.hasOwn(synsets, id) || !synsets[id].lemmas.some(w => normalize(w) === word)) fail();
}
index[word] = senses;
});
// Check the reverse direction too: no lemma/sense silently omitted by the index.
for (const [id, s] of Object.entries(synsets)) for (const w of s.lemmas) {
requireThat(index[normalize(w)]?.includes(id), `malformed index.${part}: missing ${w}/${id}`);
}
return index;
}
function parseExceptions(text, part) {
const exceptions = Object.create(null);
lines(text, line => {
const [word, ...forms] = line.trim().split(/ +/);
requireThat(forms.length > 0, `malformed ${part}.exc: ${word}`);
// Source exception files can repeat an inflection; preserve all listed bases in order.
exceptions[word] = [...new Set([...(exceptions[word] ?? []), ...forms])];
});
return exceptions;
}
export function build({ sourceRoot = SOURCE, outDir = join(root, 'src/public/thesaurus'), buildJson = join(outDir, 'BUILD.json') } = {}) {
const provenance = validateSource(sourceRoot), parts = {}, parsed = {}, literal = new Set(), normalized = new Set(), headwords = new Set();
let synsets = 0;
for (const part of Object.keys(POS)) {
parsed[part] = parseData(readFileSync(join(sourceRoot, 'wordnet', `data.${part}`), 'utf8'), part);
const senses = parsed[part].synsets;
const index = parseIndex(readFileSync(join(sourceRoot, 'wordnet', `index.${part}`), 'utf8'), part, senses);
parts[part] = { schema: 1, part, synsets: senses, index, exceptions: parseExceptions(readFileSync(join(sourceRoot, 'wordnet', `${part}.exc`), 'utf8'), part) };
synsets += Object.keys(senses).length;
for (const s of Object.values(senses)) for (const w of s.lemmas) { literal.add(w); normalized.add(normalize(w)); }
for (const w of Object.keys(index)) headwords.add(w);
}
const byPos = Object.fromEntries(Object.entries(POS).map(([p, code]) => [code, parsed[p].synsets]));
for (const { pointers } of Object.values(parsed)) for (const p of pointers) {
const target = byPos[p.targetPos][p.target];
requireThat(target && p.to <= target.lemmas.length, `malformed pointer target: ${p.targetPos}/${p.target}`);
}
const counts = { synsets, headwords: headwords.size, literalLemmas: literal.size };
requireThat(Object.keys(EXPECTED).every(k => counts[k] === EXPECTED[k]), `unexpected counts: ${JSON.stringify(counts)}`);
requireThat(normalized.size === headwords.size && [...normalized].every(w => headwords.has(w)), 'normalized data/index headword mismatch');
const outputs = {}, bytes = {};
for (const [part, data] of Object.entries(parts)) bytes[`${part}.json`] = json(data);
bytes.LICENSE = regular(join(sourceRoot, 'LICENSE'));
bytes.NOTICE = regular(join(sourceRoot, 'NOTICE'));
const countMethod = 'Union of first-field headwords across four index.* files; cross-checked with lowercased data.* lemmas stripping terminal (a)/(p)/(ip). Literal data lemmas counted without normalization.';
bytes['manifest.json'] = json({ schema: 1, source: 'Princeton WordNet 3.0', archive: provenance.archive, counts, countMethod,
openNote: '28 more union headwords than Princeton statistics page figure 147278; Sage ruling sage-3972 accepts measured 147306 for this archive.',
defaults: { maxSenses: 8, maxSynonyms: 20 },
format: 'POS shards: index maps lowercase underscore headwords to ordered synset offsets; synsets map offsets to {pos,lemmas,gloss}; exceptions map inflections to bases. Offsets are scoped to their POS shard; s is adjective satellite. Lemmas retain case, underscores and adjective markers; glosses are plain untrusted text. Defaults are consumer hints, not build truncation.',
files: Object.fromEntries(Object.entries(bytes).map(([n, b]) => [n, { bytes: b.length, sha256: sha(b) }])) });
for (const [n, b] of Object.entries(bytes)) outputs[n] = { bytes: b.length, sha256: sha(b) };
const info = { schema: 1, sourceManifestSha256: PROVENANCE_SHA256, archive: provenance.archive, counts, countMethod,
openNote: 'Princeton statistics page union 147278 differs by 28; unresolved, accepted in sage-3972.',
tools: { node: process.version, initialImportPython: '3.12.8', converter: 'Node.js >=24, standard library only; JSON UTF-8 LF, no timestamps, no locale sorting', importer: 'Node.js >=24 plus Python 3 stdlib zipfile; local pinned ZIP only' },
inputs: Object.fromEntries(['editor-data/import-wordnet.mjs', 'editor-data/build-thesaurus.mjs'].map(n => [n, sha(readFileSync(join(root, n)))])), outputs };
// No output is touched until all integrity, grammar, references and counts pass.
mkdirSync(outDir, { recursive: true });
for (const [n, b] of Object.entries(bytes)) writeFileSync(join(outDir, n), b);
mkdirSync(dirname(buildJson), { recursive: true });
writeFileSync(buildJson, JSON.stringify(info, null, 2) + '\n');
return info;
}
export function measure() {
requireThat(typeof global.gc === 'function', 'measurement requires --expose-gc');
const files = Object.keys(POS).map(p => `${p}.json`);
global.gc(); const before = process.memoryUsage().heapUsed;
const data = files.map(n => JSON.parse(readFileSync(join(root, 'src/public/thesaurus', n), 'utf8')));
const parsePeak = process.memoryUsage().heapUsed;
global.gc(); const after = process.memoryUsage().heapUsed;
// Keep every parsed graph live across GC and expose a checkable count.
const senses = data.reduce((n, p) => n + Object.keys(p.synsets).length, 0);
return { runtime: process.version, platform: process.platform, arch: process.arch, files,
method: 'Fresh Node --expose-gc process; GC before/after parsing all four JSON shards; heapUsed delta. parseHeapBytes is a sampled post-parse value, not peak instrumentation; not a browser measurement.',
baselineHeapBytes: before, retainedHeapBytes: after - before, parseHeapBytes: parsePeak - before, synsets: senses };
}
if (process.argv[1] && resolve(process.argv[1]) === fileURLToPath(import.meta.url)) {
try {
const args = process.argv.slice(2);
if (args.length === 1 && args[0] === '--measure') console.log(JSON.stringify(measure(), null, 2));
else {
requireThat(args.length === 0 || (args.length === 2 && args[0] === '--out'), 'usage: build-thesaurus.mjs [--out DIR] | --measure');
const info = build(args.length ? { outDir: resolve(args[1]) } : { buildJson: join(root, 'editor-data/BUILD.json') });
console.log(JSON.stringify(info, null, 2));
}
} catch (e) { console.error(e.message); process.exitCode = 1; }
}
@@ -0,0 +1,45 @@
// Offline import only: node editor-data/import-wordnet.mjs /path/to/pinned/wordnet.zip [DEST]
// Default DEST is third_party/thesaurus/wordnet, which must not already exist.
import { createHash } from 'node:crypto';
import { readFileSync, existsSync, mkdirSync, writeFileSync, rmSync } from 'node:fs';
import { join, resolve } from 'node:path';
import { fileURLToPath } from 'node:url';
import { spawnSync } from 'node:child_process';
import { SOURCE, PROVENANCE_SHA256 } from './build-thesaurus.mjs';
export function importWordnet(archive, destination = join(SOURCE, 'wordnet')) {
const bytes = readFileSync(archive);
const hash = b => createHash('sha256').update(b).digest('hex');
if (bytes.length !== 10775600 || hash(bytes) !== 'cbda5ea6eef7f36a97a43d4a75f85e07fccbb4f23657d27b4ccbc93e2646ab59') throw new Error('archive integrity mismatch; stop and report to Sage');
const manifest = readFileSync(join(SOURCE, 'PROVENANCE.json'));
if (hash(manifest) !== PROVENANCE_SHA256) throw new Error('provenance integrity mismatch');
if (existsSync(destination)) throw new Error('destination already exists; refusing overwrite');
// Pass the verified bytes through stdin, avoiding an archive path replacement race.
// Validate every entry and its hash before returning any extracted text to Node.
const script = `import io,zipfile,sys,json,hashlib
m=json.loads(sys.argv[1]); z=zipfile.ZipFile(io.BytesIO(sys.stdin.buffer.read()))
entries=[i for i in z.infolist() if not i.is_dir()]
expected={'wordnet/'+n for n in m['files']}
assert len(entries)==len(expected) and {i.filename for i in entries}==expected, 'archive inventory mismatch'
out={}
for i in entries:
n=i.filename.removeprefix('wordnet/'); pin=m['files'][n]
assert i.file_size==pin['bytes'], 'entry size mismatch'
b=z.read(i)
assert len(b)==pin['bytes'] and hashlib.sha256(b).hexdigest()==pin['sha256'], 'entry hash mismatch'
out[n]=b.decode('ascii')
print(json.dumps(out))`;
const result = spawnSync('python3', ['-c', script, manifest.toString('utf8')], { input: bytes, maxBuffer: 50 * 1024 * 1024 });
if (result.error || result.status !== 0) throw new Error(`archive extraction refused: ${result.error?.message ?? result.stderr.toString('utf8')}`);
const files = JSON.parse(result.stdout.toString('utf8'));
// Exclusive mkdir is the write boundary, also rejecting a concurrent creator.
mkdirSync(destination);
try { for (const [name, text] of Object.entries(files)) writeFileSync(join(destination, name), text, { encoding: 'ascii', flag: 'wx' }); }
catch (e) { rmSync(destination, { recursive: true, force: true }); throw e; }
return { files: Object.keys(files).length, bytes: Object.values(files).reduce((n, s) => n + s.length, 0) };
}
if (process.argv[1] && resolve(process.argv[1]) === fileURLToPath(import.meta.url)) {
try {
if (process.argv.length < 3 || process.argv.length > 4) throw new Error('usage: import-wordnet.mjs ARCHIVE [DEST]');
console.log(JSON.stringify(importWordnet(resolve(process.argv[2]), process.argv[3] ? resolve(process.argv[3]) : undefined)));
} catch (e) { console.error(e.message); process.exitCode = 1; }
}
@@ -0,0 +1,31 @@
WordNet Release 3.0
This software and database is being provided to you, the LICENSEE, by
Princeton University under the following license. By obtaining, using
and/or copying this software and database, you agree that you have
read, understood, and will comply with these terms and conditions.:
Permission to use, copy, modify and distribute this software and
database and its documentation for any purpose and without fee or
royalty is hereby granted, provided that you agree to comply with
the following copyright notice and statements, including the disclaimer,
and that the same appear on ALL copies of the software, database and
documentation, including modifications that you make for internal
use or for distribution.
WordNet 3.0 Copyright 2006 by Princeton University. All rights reserved.
THIS SOFTWARE AND DATABASE IS PROVIDED "AS IS" AND PRINCETON
UNIVERSITY MAKES NO REPRESENTATIONS OR WARRANTIES, EXPRESS OR
IMPLIED. BY WAY OF EXAMPLE, BUT NOT LIMITATION, PRINCETON
UNIVERSITY MAKES NO REPRESENTATIONS OR WARRANTIES OF MERCHANT-
ABILITY OR FITNESS FOR ANY PARTICULAR PURPOSE OR THAT THE USE
OF THE LICENSED SOFTWARE, DATABASE OR DOCUMENTATION WILL NOT
INFRINGE ANY THIRD PARTY PATENTS, COPYRIGHTS, TRADEMARKS OR
OTHER RIGHTS.
The name of Princeton University or Princeton may not be used in
advertising or publicity pertaining to distribution of the software
and/or database. Title to copyright in this software, database and
any associated documentation shall at all times remain with
Princeton University and LICENSEE agrees to preserve same.
@@ -0,0 +1,11 @@
Princeton WordNet 3.0
WordNet 3.0 Copyright 2006 by Princeton University. All rights reserved.
Original database text is retained unmodified in wordnet/.
Derived JSON is produced by editor-data/build-thesaurus.mjs, with underscores
and adjective position markers retained in sense lemmas, and a lowercase index.
This database and derived data remain subject to the Princeton terms and
disclaimer in LICENSE. They are not licensed under MIT or Apache.
Pinned NLTK distribution mirror (not a comparison with a Princeton archive):
https://raw.githubusercontent.com/nltk/nltk_data/96f9b3252457a2b97e52aec64c3dfceeb5c312d5/packages/corpora/wordnet.zip
@@ -0,0 +1 @@
{"schema":1,"part":"adj","synsets":{"00001740":{"pos":"a","lemmas":["able"],"gloss":"(usually followed by `to') having the necessary means or skill or know-how or authority to do something; \"able to swim\"; \"she was able to program her computer\"; \"we were at last able to buy a car\"; \"able to get a grant for the project\""},"00002098":{"pos":"a","lemmas":["unable"],"gloss":"(usually followed by `to') not having the necessary means or skill or know-how; \"unable to get to town without a car\"; \"unable to obtain funds\""},"00002312":{"pos":"a","lemmas":["abaxial","dorsal"],"gloss":"facing away from the axis of an organ or organism; \"the abaxial surface of a leaf is the underside or side facing away from the stem\""},"00002527":{"pos":"a","lemmas":["adaxial","ventral"],"gloss":"nearest to or facing toward the axis of an organ or organism; \"the upper side of a leaf is known as the adaxial surface\""},"00002730":{"pos":"a","lemmas":["acroscopic"],"gloss":"facing or on the side toward the apex"},"00002843":{"pos":"a","lemmas":["basiscopic"],"gloss":"facing or on the side toward the base"},"00002956":{"pos":"a","lemmas":["abducent","abducting"],"gloss":"especially of muscles; drawing away from the midline of the body or from an adjacent part"},"00003131":{"pos":"a","lemmas":["adducent","adductive","adducting"],"gloss":"especially of muscles; bringing together or drawing toward the midline of the body or toward an adjacent part"},"00003356":{"pos":"a","lemmas":["nascent"],"gloss":"being born or beginning; \"the nascent chicks\"; \"a nascent insurgency\""},"00003553":{"pos":"s","lemmas":["emergent","emerging"],"gloss":"coming into existence; \"an emergent republic\""},"00003700":{"pos":"s","lemmas":["dissilient"],"gloss":"bursting open with force, as do some ripe seed vessels"},"00003829":{"pos":"s","lemmas":["parturient"],"gloss":"giving birth; \"a parturient heifer\""},"00003939":{"pos":"a","lemmas":["dying"],"gloss":"in or associated with the process of passing from life or ceasing to be; \"a dying man\"; \"his dying wish\"; \"a dying fire\"; \"a dying civilization\""},"00004171":{"pos":"s","lemmas":["moribund"],"gloss":"being on the point of death; breathing your last; \"a moribund patient\""},"00004296":{"pos":"s","lemmas":["last"],"gloss":"occurring at the time of death; \"his last words\"; \"the last rites\""},"00004413":{"pos":"a","lemmas":["abridged"],"gloss":"(used of texts) shortened by condensing or rewriting; \"an abridged version\""},"00004615":{"pos":"s","lemmas":["cut","shortened"],"gloss":"with parts removed; \"the drastically cut film\""},"00004723":{"pos":"s","lemmas":["half-length"],"gloss":"abridged to half its original length"},"00004817":{"pos":"s","lemmas":["potted"],"gloss":"(British informal) summarized or abridged; \"a potted version of a novel\""},"00004980":{"pos":"a","lemmas":["unabridged"],"gloss":"(used of texts) not shortened; \"an unabridged novel\""},"00005107":{"pos":"s","lemmas":["full-length","uncut"],"gloss":"complete; \"the full-length play\""},"00005205":{"pos":"a","lemmas":["absolute"],"gloss":"perfect or complete or pure; \"absolute loyalty\"; \"absolute silence\"; \"absolute truth\"; \"absolute alcohol\""},"00005473":{"pos":"s","lemmas":["direct"],"gloss":"lacking compromising or mitigating elements; exact; \"the direct opposite\""},"00005599":{"pos":"s","lemmas":["implicit","unquestioning"],"gloss":"being without doubt or reserve; \"implicit trust\""},"00005718":{"pos":"s","lemmas":["infinite"],"gloss":"total and all-embracing; \"God's infinite wisdom\""},"00005839":{"pos":"s","lemmas":["living"],"gloss":"(informal) absolute; \"she is a living doll\"; \"scared the living daylights out of them\"; \"beat the living hell out of him\""},"00006032":{"pos":"a","lemmas":["relative","comparative"],"gloss":"estimated by comparison; not absolute or complete; \"a relative stranger\""},"00006245":{"pos":"s","lemmas":["relational"],"gloss":"having a relation or being related"},"00006336":{"pos":"a","lemmas":["absorbent","absorptive"],"gloss":"having power or capacity or tendency to absorb or soak up something (liquids or energy etc.); \"as absorbent as a sponge\""},"00006777":{"pos":"s","lemmas":["absorbefacient","sorbefacient"],"gloss":"inducing or promoting absorption"},"00006885":{"pos":"s","lemmas":["assimilating","assimilative","assimilatory"],"gloss":"capable of taking (gas, light, or liquids) into a solution; \"an assimilative substance"},"00007096":{"pos":"s","lemmas":["hygroscopic"],"gloss":"absorbing moisture (as from the air)"},"00007208":{"pos":"s","lemmas":["receptive"],"gloss":"able to absorb liquid (not repellent); \"the paper is ink-receptive\""},"00007331":{"pos":"s","lemmas":["shock-absorbent"],"gloss":"having the capacity to absorb the energy of an impact; \"the material absorbs shock and is used for shock-absorbent insoles\""},"00007516":{"pos":"s","lemmas":["spongy","spongelike"],"gloss":"like a sponge in being able to absorb liquids and yield it back wheLine truncated
@@ -0,0 +1 @@
{"schema":1,"part":"adv","synsets":{"00001740":{"pos":"r","lemmas":["a_cappella"],"gloss":"without musical accompaniment; \"they performed a cappella\""},"00001837":{"pos":"r","lemmas":["AD","A.D.","anno_Domini"],"gloss":"in the Christian era; used before dates after the supposed year Christ was born; \"in AD 200\""},"00001981":{"pos":"r","lemmas":["CE","C.E.","Common_Era"],"gloss":"of the period coinciding with the Christian era; preferred by some writers who are not Christians; \"in 200 CE\""},"00002142":{"pos":"r","lemmas":["BC","B.C.","before_Christ"],"gloss":"before the Christian era; used following dates before the supposed year Christ was born; \"in 200 BC\""},"00002296":{"pos":"r","lemmas":["BCE","B.C.E."],"gloss":"of the period before the Common Era; preferred by some writers who are not Christians; \"in 200 BCE\""},"00002436":{"pos":"r","lemmas":["horseback","ahorse","ahorseback"],"gloss":"on the back of a horse; \"he rode horseback to town\"; \"managed to escape ahorse\"; \"policeman patrolled the streets ahorseback\""},"00002621":{"pos":"r","lemmas":["barely","hardly","just","scarcely","scarce"],"gloss":"only a very short time before; \"they could barely hear the speaker\"; \"we hardly knew them\"; \"just missed being hit\"; \"had scarcely rung the bell when the door flew open\"; \"would have scarce arrived before she would have found some excuse to leave\"- W.B.Yeats"},"00002950":{"pos":"r","lemmas":["just"],"gloss":"exactly at this moment or the moment described; \"we've just finished painting the walls, so don't touch them\";"},"00003093":{"pos":"r","lemmas":["hardly","scarcely"],"gloss":"almost not; \"he hardly ever goes fishing\"; \"he was hardly more than sixteen years old\"; \"they scarcely ever used the emergency generator\""},"00003294":{"pos":"r","lemmas":["anisotropically"],"gloss":"in an anisotropic manner"},"00003380":{"pos":"r","lemmas":["annoyingly"],"gloss":"in an annoying manner or to an annoying degree"},"00003483":{"pos":"r","lemmas":["basically","fundamentally","essentially"],"gloss":"in essence; at bottom or by one's (or its) very nature; \"He is basically dishonest\"; \"the argument was essentially a technical one\"; \"for all his bluster he is in essence a shy person\""},"00003771":{"pos":"r","lemmas":["blessedly"],"gloss":"in a blessed manner"},"00003846":{"pos":"r","lemmas":["boiling"],"gloss":"extremely; \"boiling mad\""},"00003925":{"pos":"r","lemmas":["enviably"],"gloss":"in an enviable manner; \"she was enviably fluent in French\""},"00004038":{"pos":"r","lemmas":["pointedly"],"gloss":"in such a manner as to make something clearly evident; \"he pointedly ignored the question\""},"00004184":{"pos":"r","lemmas":["negatively"],"gloss":"in a negative way; \"he was negatively inclined\""},"00004288":{"pos":"r","lemmas":["negatively"],"gloss":"in a harmful manner; \"he was negatively affected\""},"00004394":{"pos":"r","lemmas":["kindly"],"gloss":"in a kind manner or out of kindness; \"He spoke kindly to the boy\"; \"she kindly overlooked the mistake\""},"00004567":{"pos":"r","lemmas":["unkindly"],"gloss":"in an unkind manner or with unkindness; \"The teacher treats the children unkindly\""},"00004722":{"pos":"r","lemmas":["merely","simply","just","only","but"],"gloss":"and nothing more; \"I was merely asking\"; \"it is simply a matter of time\"; \"just a scratch\"; \"he was only a child\"; \"hopes that last but a moment\""},"00004967":{"pos":"r","lemmas":["simply"],"gloss":"absolutely; altogether; really; \"we are simply broke\""},"00005055":{"pos":"r","lemmas":["plainly","simply"],"gloss":"in a simple manner; without extravagance or embellishment; \"she was dressed plainly\"; \"they lived very simply\""},"00005210":{"pos":"r","lemmas":["anciently"],"gloss":"in ancient times; long ago; \"a concern with what may have happened anciently\""},"00005343":{"pos":"r","lemmas":["arguably"],"gloss":"as can be shown by argument; \"she is arguably the best\""},"00005453":{"pos":"r","lemmas":["unabashedly"],"gloss":"in an unabashed manner; \"unabashedly, he asked for more\""},"00005567":{"pos":"r","lemmas":["automatically"],"gloss":"in a reflex manner; \"he answered automatically\""},"00005674":{"pos":"r","lemmas":["alarmingly"],"gloss":"in an alarming manner; \"It grew alarmingly fast\""},"00005779":{"pos":"r","lemmas":["vastly","immensely"],"gloss":"to an exceedingly great extent or degree; \"He had vastly overestimated his resources\"; \"was immensely more important to the project as a scientist than as an administrator\""},"00006034":{"pos":"r","lemmas":["grossly"],"gloss":"in a gross manner"},"00006105":{"pos":"r","lemmas":["largely","mostly","for_the_most_part"],"gloss":"in large part; mainly or chiefly; \"These accounts are largely inactive\""},"00006259":{"pos":"r","lemmas":["significantly"],"gloss":"in a significant manner; \"our budget will be significantly affected by these new cuts\""},"00006423":{"pos":"r","lemmas":["insignificantly"],"gloss":"not to a significant degreeLine truncated
@@ -0,0 +1 @@
{"schema":1,"source":"Princeton WordNet 3.0","archive":{"bytes":10775600,"sha256":"cbda5ea6eef7f36a97a43d4a75f85e07fccbb4f23657d27b4ccbc93e2646ab59"},"counts":{"synsets":117659,"headwords":147306,"literalLemmas":149229},"countMethod":"Union of first-field headwords across four index.* files; cross-checked with lowercased data.* lemmas stripping terminal (a)/(p)/(ip). Literal data lemmas counted without normalization.","openNote":"28 more union headwords than Princeton statistics page figure 147278; Sage ruling sage-3972 accepts measured 147306 for this archive.","defaults":{"maxSenses":8,"maxSynonyms":20},"format":"POS shards: index maps lowercase underscore headwords to ordered synset offsets; synsets map offsets to {pos,lemmas,gloss}; exceptions map inflections to bases. Offsets are scoped to their POS shard; s is adjective satellite. Lemmas retain case, underscores and adjective markers; glosses are plain untrusted text. Defaults are consumer hints, not build truncation.","files":{"noun.json":{"bytes":15617486,"sha256":"5294d3f0e6cd7924f5be97d4d6e64b96a9dd8505f216e5c056c3f5b69c0c2dc9"},"verb.json":{"bytes":2327528,"sha256":"3f99489858d8cbce9996c72135f82325bd2c067a64d2fb8b80dea386b99b6392"},"adj.json":{"bytes":3319398,"sha256":"9965dbfdc35a11b829fedb19e7b22ab3ca8470f45c5532c1f310810012a23023"},"adv.json":{"bytes":648351,"sha256":"c6effb7a1502cd3dcd81341cb296e039d238786712c91c30994f2e50ef1e9fcb"},"LICENSE":{"bytes":1625,"sha256":"7731175a77952e259390b496fab905e57118b8d19ad3a8383c67eee724ff443f"},"NOTICE":{"bytes":649,"sha256":"508e1a5d132e05ec888a79ec959b68d25203fee0aa3692b0610da7500a7c0251"}}}
@@ -0,0 +1 @@
{"schema":1,"part":"noun","synsets":{"10000007":{"pos":"n","lemmas":["defecator","voider","shitter"],"gloss":"a person who defecates"},"10000158":{"pos":"n","lemmas":["defense_attorney","defense_lawyer"],"gloss":"the lawyer representing the defendant"},"10000294":{"pos":"n","lemmas":["defense_contractor"],"gloss":"a contractor concerned with the development and manufacture of systems of defense"},"10000459":{"pos":"n","lemmas":["deist","freethinker"],"gloss":"a person who believes that God created the universe and then abandoned it"},"10000616":{"pos":"n","lemmas":["delayer"],"gloss":"a person who delays; to put off until later or cause to be late"},"10000787":{"pos":"n","lemmas":["delegate"],"gloss":"a person appointed or elected to represent others"},"10000945":{"pos":"n","lemmas":["delinquent","juvenile_delinquent"],"gloss":"a young offender"},"10001058":{"pos":"n","lemmas":["deliverer"],"gloss":"a person who gives up or transfers money or goods"},"10001217":{"pos":"n","lemmas":["deliveryman","delivery_boy","deliverer"],"gloss":"someone employed to make deliveries"},"10001481":{"pos":"n","lemmas":["demagogue","demagog","rabble-rouser"],"gloss":"a political leader who seeks support by appealing to popular passions and prejudices"},"10001647":{"pos":"n","lemmas":["demander"],"gloss":"a person who makes demands"},"10001764":{"pos":"n","lemmas":["demigod","superman","Ubermensch"],"gloss":"a person with great powers and abilities"},"10001882":{"pos":"n","lemmas":["demimondaine"],"gloss":"a woman whose sexual promiscuity places her outside respectable society"},"10002031":{"pos":"n","lemmas":["democrat","populist"],"gloss":"an advocate of democratic principles"},"10002151":{"pos":"n","lemmas":["Democrat"],"gloss":"a member of the Democratic Party"},"10002257":{"pos":"n","lemmas":["demographer","demographist","population_scientist"],"gloss":"a scientist who studies the growth and density of populations and their vital statistics"},"10002477":{"pos":"n","lemmas":["demon"],"gloss":"someone extremely diligent or skillful; \"he worked like a demon to finish the job on time\"; \"she's a demon at math\""},"10002644":{"pos":"n","lemmas":["demoniac"],"gloss":"someone who acts as if possessed by a demon"},"10002760":{"pos":"n","lemmas":["demonstrator","protester"],"gloss":"someone who participates in a public display of group feeling"},"10002982":{"pos":"n","lemmas":["demonstrator","sales_demonstrator"],"gloss":"someone who demonstrates an article to a prospective buyer"},"10003120":{"pos":"n","lemmas":["demonstrator"],"gloss":"a teacher or teacher's assistant who demonstrates the principles that are being taught"},"10003283":{"pos":"n","lemmas":["denier"],"gloss":"one who denies"},"10003476":{"pos":"n","lemmas":["den_mother"],"gloss":"a woman who supervises a den of Cub Scouts"},"10003575":{"pos":"n","lemmas":["den_mother"],"gloss":"someone who plays the role of a den mother; \"he serves as den mother to all the freshmen in this dormitory\"; \"she's the den mother to new secretaries\""},"10003782":{"pos":"n","lemmas":["dental_assistant"],"gloss":"an assistant to a dentist"},"10003870":{"pos":"n","lemmas":["dental_hygienist"],"gloss":"someone trained to provide preventive dental service (cleaning teeth or taking x-rays)"},"10004019":{"pos":"n","lemmas":["dental_technician","denturist"],"gloss":"someone who makes dental appliances (bridges and dentures)"},"10004171":{"pos":"n","lemmas":["dental_surgeon"],"gloss":"a dentist qualified to perform surgical procedures"},"10004282":{"pos":"n","lemmas":["dentist","tooth_doctor","dental_practitioner"],"gloss":"a person qualified to practice dentistry"},"10004539":{"pos":"n","lemmas":["departer","leaver","goer"],"gloss":"someone who leaves"},"10004718":{"pos":"n","lemmas":["department_head"],"gloss":"the head of a department"},"10004804":{"pos":"n","lemmas":["dependant","dependent"],"gloss":"a person who relies on another person for support (especially financial support)"},"10005006":{"pos":"n","lemmas":["depositor"],"gloss":"a person who has deposited money in a bank or similar institution"},"10005163":{"pos":"n","lemmas":["depressive"],"gloss":"someone suffering psychological depression"},"10005280":{"pos":"n","lemmas":["deputy","lieutenant"],"gloss":"an assistant with power to act when his superior is absent"},"10005548":{"pos":"n","lemmas":["deputy","deputy_sheriff"],"gloss":"someone authorized to exercise the powers of sheriff in emergencies"},"10005721":{"pos":"n","lemmas":["deputy","surrogate"],"gloss":"a person appointed to represent or act on behalf of others"},"10005934":{"pos":"n","lemmas":["deputy"],"gloss":"a member of the lower chamber of a legislative assembly (such as in France)"},"10006081":{"pos":"n","lemmas":["derelict"],"gloss":"a person without a home, job, or property"},"10006177":{"pos":"n","lemmas":["dermatologist","skin_doctor"],"gloss":"a doctor who specializes in the physiology and pathology of the skin"},"10006337":{"pos":"n","lemmas":["dervish"],"gloLine truncated
@@ -0,0 +1 @@
{"schema":1,"part":"verb","synsets":{"00001740":{"pos":"v","lemmas":["breathe","take_a_breath","respire","suspire"],"gloss":"draw air into, and expel out of, the lungs; \"I can breathe better when the air is clean\"; \"The patient is respiring\""},"00002325":{"pos":"v","lemmas":["respire"],"gloss":"undergo the biomedical and metabolic processes of respiration by taking up oxygen and producing carbon monoxide"},"00002573":{"pos":"v","lemmas":["respire"],"gloss":"breathe easily again, as after exertion or anxiety"},"00002724":{"pos":"v","lemmas":["choke"],"gloss":"breathe with great difficulty, as when experiencing a strong emotion; \"She choked with emotion when she spoke about her deceased husband\""},"00002942":{"pos":"v","lemmas":["hyperventilate"],"gloss":"breathe excessively hard and fast; \"The mountain climber started to hyperventilate\""},"00003133":{"pos":"v","lemmas":["hyperventilate"],"gloss":"produce hyperventilation in; \"The nurses had to hyperventilate the patient\""},"00003316":{"pos":"v","lemmas":["aspirate"],"gloss":"suck in (air)"},"00003431":{"pos":"v","lemmas":["burp","bubble","belch","eruct"],"gloss":"expel gas from the stomach; \"In China it is polite to burp at the table\""},"00003662":{"pos":"v","lemmas":["force_out"],"gloss":"emit or cause to move with force of effort; \"force out the air\"; \"force out the splinter\""},"00003826":{"pos":"v","lemmas":["hiccup","hiccough"],"gloss":"breathe spasmodically, and make a sound; \"When you have to hiccup, drink a glass of cold water\""},"00004032":{"pos":"v","lemmas":["sigh","suspire"],"gloss":"heave or utter a sigh; breathe deeply and heavily; \"She sighed sadly\""},"00004227":{"pos":"v","lemmas":["exhale","expire","breathe_out"],"gloss":"expel air; \"Exhale when you lift the weight\""},"00004492":{"pos":"v","lemmas":["hold"],"gloss":"keep from exhaling or expelling; \"hold your breath\""},"00004605":{"pos":"v","lemmas":["exhale","give_forth","emanate"],"gloss":"give out (breath or an odor); \"The chimney exhales a thick smoke\""},"00004819":{"pos":"v","lemmas":["sneeze"],"gloss":"exhale spasmodically, as when an irritant entered one's nose; \"Pepper makes me sneeze\""},"00005041":{"pos":"v","lemmas":["inhale","inspire","breathe_in"],"gloss":"draw in (air); \"Inhale deeply\"; \"inhale the fresh mountain air\"; \"The patient has trouble inspiring\"; \"The lung cancer patient cannot inspire air very well\""},"00005526":{"pos":"v","lemmas":["pant","puff","gasp","heave"],"gloss":"breathe noisily, as when one is exhausted; \"The runners reached the finish line, panting heavily\""},"00005815":{"pos":"v","lemmas":["cough"],"gloss":"exhale abruptly, as when one has a chest cold or congestion; \"The smoker coughs all day\""},"00006100":{"pos":"v","lemmas":["hack","whoop"],"gloss":"cough spasmodically; \"The patient with emphysema is hacking all day\""},"00006238":{"pos":"v","lemmas":["expectorate","cough_up","cough_out","spit_up","spit_out"],"gloss":"discharge (phlegm or sputum) from the lungs and out of the mouth"},"00006523":{"pos":"v","lemmas":["snort"],"gloss":"make a snorting sound by exhaling hard; \"The critic snorted contemptuously\""},"00006697":{"pos":"v","lemmas":["wheeze"],"gloss":"breathe with difficulty"},"00006802":{"pos":"v","lemmas":["puff","huff","chuff"],"gloss":"blow hard and loudly; \"he huffed and puffed as he made his way up the mountain\""},"00007012":{"pos":"v","lemmas":["blow"],"gloss":"exhale hard; \"blow on the soup to cool it down\""},"00007193":{"pos":"v","lemmas":["insufflate"],"gloss":"blow or breathe hard on or into"},"00007328":{"pos":"v","lemmas":["yawn"],"gloss":"utter a yawn, as from lack of oxygen or when one is tired; \"The child yawned during the long performance\""},"00007549":{"pos":"v","lemmas":["sniff","sniffle"],"gloss":"inhale audibly through the nose; \"the sick student was sniffling in the back row\""},"00007739":{"pos":"v","lemmas":["blink","wink","nictitate","nictate"],"gloss":"briefly shut the eyes; \"The TV announcer never seems to blink\""},"00008055":{"pos":"v","lemmas":["palpebrate"],"gloss":"wink or blink, especially repeatedly"},"00008195":{"pos":"v","lemmas":["bat","flutter"],"gloss":"wink briefly; \"bat one's eyelids\""},"00008299":{"pos":"v","lemmas":["wink"],"gloss":"signal by winking; \"She winked at him\""},"00008435":{"pos":"v","lemmas":["wink","blink","blink_away"],"gloss":"force to go away by blinking; \"blink away tears\""},"00008602":{"pos":"v","lemmas":["squint","squinch"],"gloss":"cross one's eyes as if in strabismus; \"The children squinted so as to scare each other\""},"00008799":{"pos":"v","lemmas":["squint"],"gloss":"partly close one's eyes, as when hit by direct blinding light; \"The driver squinted as the sun hit his windshield\""},"00008977":{"pos":"v","lemmas":["wince"],"gloss":"make a face indicating disgust or dislike; \"She winced when she heard his pompous speech\""},"00009147":{"pos":"v","lemmas":["shed","molt","exuviate","moult","slough"],"gloss":"cast off hair, skLine truncated
@@ -0,0 +1,98 @@
import test from 'node:test';
import assert from 'node:assert/strict';
import { mkdtempSync, readFileSync, writeFileSync, rmSync, cpSync, readdirSync } from 'node:fs';
import { tmpdir } from 'node:os';
import { join, dirname } from 'node:path';
import { fileURLToPath } from 'node:url';
import { createHash } from 'node:crypto';
import { build, parseData, parseIndex, validateSource, EXPECTED, SOURCE } from '../editor-data/build-thesaurus.mjs';
import { importWordnet } from '../editor-data/import-wordnet.mjs';
const root = dirname(dirname(fileURLToPath(import.meta.url)));
const hash = b => createHash('sha256').update(b).digest('hex');
const scratch = fn => { const d = mkdtempSync(join(tmpdir(), 'thesaurus-')); try { return fn(d); } finally { rmSync(d, { recursive: true, force: true }); } };
test('pinned source keeps all original files and Princeton license bytes', () => {
const m = validateSource();
assert.equal(m.archive.sha256, 'cbda5ea6eef7f36a97a43d4a75f85e07fccbb4f23657d27b4ccbc93e2646ab59');
assert.equal(m.archive.bytes, 10775600);
assert.equal(Object.keys(m.files).length, 18);
assert.equal(m.uncompressedBytes, 36353991);
assert.equal(m.lookupBytes, 35435978);
assert.deepEqual(readFileSync(join(SOURCE, 'LICENSE')), readFileSync(join(SOURCE, 'wordnet/LICENSE')));
assert.match(readFileSync(join(SOURCE, 'LICENSE'), 'utf8'), /WordNet 3.0 Copyright 2006 by Princeton University/);
});
test('two complete conversions match shipped bytes and pinned counts', () => scratch(d => {
const a = build({ outDir: join(d, 'a'), buildJson: join(d, 'a-build.json') });
const b = build({ outDir: join(d, 'b'), buildJson: join(d, 'b-build.json') });
assert.deepEqual(a, b);
assert.equal(a.counts.synsets, 117659);
assert.equal(a.counts.headwords, 147306);
assert.equal(a.counts.literalLemmas, 149229);
assert.deepEqual(a.counts, EXPECTED);
assert.deepEqual(a, JSON.parse(readFileSync(join(root, 'editor-data/BUILD.json'))));
for (const [name, expected] of Object.entries(a.outputs)) {
const bytes = readFileSync(join(d, 'a', name));
assert.deepEqual(bytes, readFileSync(join(d, 'b', name)));
assert.deepEqual(bytes, readFileSync(join(root, 'src/public/thesaurus', name)));
assert.equal(hash(bytes), expected.sha256);
assert.equal(bytes.length, expected.bytes);
}
const noun = JSON.parse(readFileSync(join(d, 'a/noun.json')));
assert.ok(noun.index.dog.length > 1);
assert.ok(noun.index.dog.some(id => noun.synsets[id].lemmas.includes('domestic_dog')));
assert.ok(noun.index.dog.every(id => noun.synsets[id].gloss.length > 0));
assert.ok(noun.exceptions.children.includes('child'));
const adj = JSON.parse(readFileSync(join(d, 'a/adj.json')));
assert.ok(Object.values(adj.synsets).some(s => s.pos === 's'));
assert.ok(Object.values(adj.synsets).some(s => s.lemmas.some(w => /\((a|p|ip)\)$/.test(w))));
}));
test('changed source, missing license, changed provenance and extra files refuse before output', () => scratch(d => {
const sourceRoot = join(d, 'source'); cpSync(SOURCE, sourceRoot, { recursive: true });
const data = join(sourceRoot, 'wordnet/data.noun'), bytes = readFileSync(data);
writeFileSync(data, Buffer.concat([bytes, Buffer.from('\n')]));
assert.throws(() => build({ sourceRoot, outDir: join(d, 'out') }), /integrity/);
assert.ok(!readdirSync(d).includes('out'));
writeFileSync(data, bytes);
rmSync(join(sourceRoot, 'LICENSE'));
assert.throws(() => validateSource(sourceRoot), /LICENSE/);
cpSync(join(SOURCE, 'LICENSE'), join(sourceRoot, 'LICENSE'));
const provenance = join(sourceRoot, 'PROVENANCE.json'), original = readFileSync(provenance);
writeFileSync(provenance, Buffer.concat([original, Buffer.from(' ')]));
assert.throws(() => validateSource(sourceRoot), /provenance integrity/);
writeFileSync(provenance, original);
writeFileSync(join(sourceRoot, 'wordnet/extra'), 'unexpected');
assert.throws(() => validateSource(sourceRoot), /inventory/);
}));
test('data parser refuses malformed words, offsets, pointers, verb frames and trailing fields', () => {
const valid = '00000000 00 n 01 dog 0 000 | a dog\n';
assert.equal(parseData(valid, 'noun').synsets['00000000'].gloss, 'a dog');
for (const bad of [valid.replace('00000000', '00000001'), valid.replace('01 dog', 'zz dog'), valid.replace('dog 0', 'dog z'), valid.replace('000 |', '001 |'), valid.replace('000 |', '000 extra |'), valid.replace(' | a dog', '')]) {
assert.throws(() => parseData(bad, 'noun'), /malformed/);
}
assert.throws(() => parseData('00000000 00 v 01 run 0 000 01 + 99 00 | run\n', 'verb'), /malformed/);
});
test('index parser refuses wrong counts, nonexistent senses and incorrect lemma mapping', () => {
const { synsets } = parseData('00000000 00 n 01 dog 0 000 | a dog\n', 'noun');
assert.deepEqual(parseIndex('dog n 1 0 1 0 00000000\n', 'noun', synsets).dog, ['00000000']);
for (const bad of ['dog n 2 0 2 0 00000000\n', 'dog n 1 0 1 0 99999999\n', 'cat n 1 0 1 0 00000000\n', 'dog v 1 0 1 0 00000000\n']) {
assert.throws(() => parseIndex(bad, 'noun', synsets), /malformed/);
}
});
test('offline importer refuses incorrect archive bytes before extraction', () => scratch(d => {
const archive = join(d, 'bad.zip'); writeFileSync(archive, 'invalid archive');
assert.throws(() => importWordnet(archive, join(d, 'out')), /archive integrity/);
assert.ok(!readdirSync(d).includes('out'));
}));
test('verified pinned ZIP round-trips to all original text files', { skip: !process.env.THESAURUS_ARCHIVE }, () => scratch(d => {
const out = join(d, 'wordnet');
assert.deepEqual(importWordnet(process.env.THESAURUS_ARCHIVE, out), { files: 18, bytes: 36353991 });
const m = validateSource();
for (const name of Object.keys(m.files)) assert.deepEqual(readFileSync(join(out, name)), readFileSync(join(SOURCE, 'wordnet', name)));
assert.throws(() => importWordnet(process.env.THESAURUS_ARCHIVE, out), /already exists/);
}));
+31
View File
@@ -0,0 +1,31 @@
WordNet Release 3.0
This software and database is being provided to you, the LICENSEE, by
Princeton University under the following license. By obtaining, using
and/or copying this software and database, you agree that you have
read, understood, and will comply with these terms and conditions.:
Permission to use, copy, modify and distribute this software and
database and its documentation for any purpose and without fee or
royalty is hereby granted, provided that you agree to comply with
the following copyright notice and statements, including the disclaimer,
and that the same appear on ALL copies of the software, database and
documentation, including modifications that you make for internal
use or for distribution.
WordNet 3.0 Copyright 2006 by Princeton University. All rights reserved.
THIS SOFTWARE AND DATABASE IS PROVIDED "AS IS" AND PRINCETON
UNIVERSITY MAKES NO REPRESENTATIONS OR WARRANTIES, EXPRESS OR
IMPLIED. BY WAY OF EXAMPLE, BUT NOT LIMITATION, PRINCETON
UNIVERSITY MAKES NO REPRESENTATIONS OR WARRANTIES OF MERCHANT-
ABILITY OR FITNESS FOR ANY PARTICULAR PURPOSE OR THAT THE USE
OF THE LICENSED SOFTWARE, DATABASE OR DOCUMENTATION WILL NOT
INFRINGE ANY THIRD PARTY PATENTS, COPYRIGHTS, TRADEMARKS OR
OTHER RIGHTS.
The name of Princeton University or Princeton may not be used in
advertising or publicity pertaining to distribution of the software
and/or database. Title to copyright in this software, database and
any associated documentation shall at all times remain with
Princeton University and LICENSEE agrees to preserve same.
+11
View File
@@ -0,0 +1,11 @@
Princeton WordNet 3.0
WordNet 3.0 Copyright 2006 by Princeton University. All rights reserved.
Original database text is retained unmodified in wordnet/.
Derived JSON is produced by editor-data/build-thesaurus.mjs, with underscores
and adjective position markers retained in sense lemmas, and a lowercase index.
This database and derived data remain subject to the Princeton terms and
disclaimer in LICENSE. They are not licensed under MIT or Apache.
Pinned NLTK distribution mirror (not a comparison with a Princeton archive):
https://raw.githubusercontent.com/nltk/nltk_data/96f9b3252457a2b97e52aec64c3dfceeb5c312d5/packages/corpora/wordnet.zip
+86
View File
@@ -0,0 +1,86 @@
{
"schema": 1,
"name": "Princeton WordNet",
"version": "3.0",
"url": "https://raw.githubusercontent.com/nltk/nltk_data/96f9b3252457a2b97e52aec64c3dfceeb5c312d5/packages/corpora/wordnet.zip",
"archive": {
"bytes": 10775600,
"sha256": "cbda5ea6eef7f36a97a43d4a75f85e07fccbb4f23657d27b4ccbc93e2646ab59"
},
"uncompressedBytes": 36353991,
"lookupBytes": 35435978,
"files": {
"LICENSE": {
"bytes": 1625,
"sha256": "7731175a77952e259390b496fab905e57118b8d19ad3a8383c67eee724ff443f"
},
"README": {
"bytes": 4129,
"sha256": "adad8d28ddea1db05b67ba1ac23506b025d29e0bcbf23bb35dde346089d8808d"
},
"adj.exc": {
"bytes": 23019,
"sha256": "8824cc24bbedd797b9702316b27f07cd4c2b76b629539f0a1276f03926758016"
},
"adv.exc": {
"bytes": 85,
"sha256": "e7291461b629abfe63301bbe1998cee09fd575ed7107abd7ea9763adb05bf0a8"
},
"citation.bib": {
"bytes": 212,
"sha256": "cd931cfe73536463c1decce60005a55d6b0c605fc7c5f89aaff7a38b5aedfa79"
},
"cntlist.rev": {
"bytes": 911244,
"sha256": "a198580b8f705fa02797bba8b13e5cbe4a9f9f40cb1697e774c7fc6a5865b035"
},
"data.adj": {
"bytes": 3155426,
"sha256": "f24b635368be441501c9b8001e9271fd3b30b203f00d91e332979e6f8fe35646"
},
"data.adv": {
"bytes": 516696,
"sha256": "e66dbbda0e0359e41b7f225bff71dd0c263dc7c66c1b61abc9ba334973d92979"
},
"data.noun": {
"bytes": 15300280,
"sha256": "489f145e0f68877c0be5bd0eb4117adaaac52f38f6204eb8d85dbe2158b614cc"
},
"data.verb": {
"bytes": 2772517,
"sha256": "29cc96ed80c9f47d94fe75e332a9df80f4b1c737205f92d2f433d63c6da2ab51"
},
"index.adj": {
"bytes": 824127,
"sha256": "42f58dda2c7cff66eb8fa55ba62e0a873a9b3f43c878e8201108f5dab6dcff28"
},
"index.adv": {
"bytes": 162816,
"sha256": "6f5465ed5758fe9c8a2f7ec17b1300f3aa875756c70ff7cba162f7e71bcf88ea"
},
"index.noun": {
"bytes": 4786655,
"sha256": "a490d99d93d017bf4822fe2f0ffa51fd73911ce271dc7535fade21f8814b5a04"
},
"index.sense": {
"bytes": 7294043,
"sha256": "68b3a468cddfd8e92134b9b0624339a02a1b837159243c297c5f138a3d618392"
},
"index.verb": {
"bytes": 523980,
"sha256": "c7c79b558d787f1e31c6f8b3eeadb8fcbb26a64545ecc1241e21d9b61f95ee8e"
},
"lexnames": {
"bytes": 803,
"sha256": "4767e2a1c6e68c1a93aa6b7c4ef7ebe9a815b50d7d5aac2788696f2cf3633bf1"
},
"noun.exc": {
"bytes": 38301,
"sha256": "2b5d675c380b39ecf595af9fa9d4e7feb1d58c643b0bff08c40ed5bfe41fab7a"
},
"verb.exc": {
"bytes": 38033,
"sha256": "dbbcf9a601b2d77e934e413b91d90e88ec7f933a8b77cfc00602a923b891b42c"
}
}
}
+62
View File
@@ -0,0 +1,62 @@
# Reviewed local WordNet input
This is Princeton WordNet 3.0, distributed under the original Princeton license
in LICENSE, not MIT or Apache. All 18 `wordnet/` files are original text bytes.
PROVENANCE.json pins the distribution archive and every extracted file; the
converter also pins the provenance file's own SHA-256. NOTICE describes the
local transformation. Do not normalize whitespace or line endings in inputs.
The only approved archive is:
https://raw.githubusercontent.com/nltk/nltk_data/96f9b3252457a2b97e52aec64c3dfceeb5c312d5/packages/corpora/wordnet.zip
It has 10,775,600 bytes and SHA-256
`cbda5ea6eef7f36a97a43d4a75f85e07fccbb4f23657d27b4ccbc93e2646ab59`.
Archive acquisition is separate from these tools. The ZIP is not committed.
From the repository root:
```sh
# Offline verification and conversion using retained text; no Python needed.
node packages/webui/editor-data/build-thesaurus.mjs
# Alternative output directory (also gets a BUILD.json):
node packages/webui/editor-data/build-thesaurus.mjs --out /path/to/new/output
# Optional initial import to a nonexistent directory, from the exact local ZIP:
node packages/webui/editor-data/import-wordnet.mjs /path/to/wordnet.zip /path/to/new/wordnet
# Isolated retained-heap measurement, all four JSON shards:
node --expose-gc packages/webui/editor-data/build-thesaurus.mjs --measure
```
Verified build tools: Node v26.8.1, Python 3.12.8 (only initial archive import),
standard libraries only. The Node API baseline is >=24. No package install,
network access or environment-dependent sorting is used by the data build.
BUILD.json records source/converter/output hashes. Generating in two different
directories must produce identical files and manifests. Measurements and
review notes are in `agents/glomgold/work/queue-309/BUILD.md`.
Expected source counts are 117,659 synsets, 147,306 distinct headwords (union
of first fields in all four index files), and 149,229 literal data lemmas.
Lowercasing data lemmas and stripping terminal `(a)`, `(p)`, `(ip)` matches the
index union. The union is 28 larger than the 147,278 cited on Princeton's
statistics page; the four per-POS counts match the page exactly. Case and
underscore checks have not explained that gap. Sage ruling sage-3972 accepts
the measured count for this exact pinned archive. A later count/hash change
requires review, not updating expected values to make a build succeed.
Only `src/public/thesaurus/` ships as runtime data. Each POS shard contains an
ordered lowercase underscore headword index, synsets with plain-text glosses
and original lemmas, and inflection exceptions. IDs are byte-offset strings
scoped to that POS file, never global IDs. Adjective `s` means satellite.
Exceptions can contain bases absent from the main index; this is a documented
WordNet property. Domain pointers in index files use collapsed `;`/`-` symbols.
The converter validates source pointer targets but does not ship the relation
graph, verb frames or lexicographer metadata; original source retains them.
Consumer hints `maxSenses=8` and `maxSynonyms=20` are tunable display defaults,
not data truncation. Future display code must render glosses/lemmas as inert
text, convert underscores for display and remove adjective markers as needed.
This row provides no lookup service, runtime download, UI, frame route, worker,
CSP allowance or agent integration. Preserve the bundled LICENSE and NOTICE
when distributing any derived data.
Format reference: https://wordnet.princeton.edu/documentation/wndb5wn
Statistics: https://wordnet.princeton.edu/documentation/wnstats7wn
+31
View File
@@ -0,0 +1,31 @@
WordNet Release 3.0
This software and database is being provided to you, the LICENSEE, by
Princeton University under the following license. By obtaining, using
and/or copying this software and database, you agree that you have
read, understood, and will comply with these terms and conditions.:
Permission to use, copy, modify and distribute this software and
database and its documentation for any purpose and without fee or
royalty is hereby granted, provided that you agree to comply with
the following copyright notice and statements, including the disclaimer,
and that the same appear on ALL copies of the software, database and
documentation, including modifications that you make for internal
use or for distribution.
WordNet 3.0 Copyright 2006 by Princeton University. All rights reserved.
THIS SOFTWARE AND DATABASE IS PROVIDED "AS IS" AND PRINCETON
UNIVERSITY MAKES NO REPRESENTATIONS OR WARRANTIES, EXPRESS OR
IMPLIED. BY WAY OF EXAMPLE, BUT NOT LIMITATION, PRINCETON
UNIVERSITY MAKES NO REPRESENTATIONS OR WARRANTIES OF MERCHANT-
ABILITY OR FITNESS FOR ANY PARTICULAR PURPOSE OR THAT THE USE
OF THE LICENSED SOFTWARE, DATABASE OR DOCUMENTATION WILL NOT
INFRINGE ANY THIRD PARTY PATENTS, COPYRIGHTS, TRADEMARKS OR
OTHER RIGHTS.
The name of Princeton University or Princeton may not be used in
advertising or publicity pertaining to distribution of the software
and/or database. Title to copyright in this software, database and
any associated documentation shall at all times remain with
Princeton University and LICENSEE agrees to preserve same.
+101
View File
@@ -0,0 +1,101 @@
This is the README file for WordNet 3.0
1. About WordNet
WordNet was developed at Princeton University's Cognitive Science
Laboratory under the direction of George Miller, James S. McDonnell
Distinguished University Professor of Psychology, Emeritus. Over the
years many linguists, lexicographers, students, and software engineers
have contributed to the project.
WordNet is an online lexical reference system. Word forms in WordNet
are represented in their familiar orthography; word meanings are
represented by synonym sets (synsets) - lists of synonymous word forms
that are interchangeable in some context. Two kinds of relations are
recognized: lexical and semantic. Lexical relations hold between word
forms; semantic relations hold between word meanings.
To learn more about WordNet, the book "WordNet: An Electronic Lexical
Database," containing an updated version of "Five Papers on WordNet"
and additional papers by WordNet users, is available from MIT Press:
http://mitpress.mit.edu/book-home.tcl?isbn=026206197X
2. The WordNet Web Site
We maintain a Web site at:
http://wordnet.princeton.edu
Information about WordNet, access to our online interface, and the
various WordNet packages that you can download are available from our
web site. All of the software documentation is available online, as
well as a FAQ. On this site we also have information about other
applications that use WordNet. If you have an application that you
would like included, please send e-mail to the above address.
3. Contacting Us
Ongoing deveopment work and WordNet related projects are done by a
small group of researchers, lexicographers, and systems programmers.
Since our resources are VERY limited, we request that you please
confine correspondence to WordNet topics only. Please check the
documentation, FAQ, and other resources for the answer to your
question or problem before contacting us.
If you have trouble installing or downloading WordNet, have a bug to
report, or any other problem, please refer to the online FAQ file
first. If you can heal thyself, please do so. The FAQ will be
updated over time. And if you do find a previously unreported
problem, please use our Bug Report Form:
http://wordnet.princeton.edu/cgi-bin/bugsubmit.pl
When reporting a problem, please be as specific as possible, stating
the computer platform you are using, which interface you are using,
and the exact error. The more details you can provide, the more
likely it is that you will get an answer.
There is a WordNet user discussion group mailing list that we invite
our users to join. Users use this list to ask questions of one
another, announce extensions to WordNet that they've developed, and
other topics of general usefulness to the user community.
Information on joining the user discussion list, reporting bugs and other
contact information is in found on our website at:
http://wordnet.princeton.edu/contact
4. Current Release
WordNet Version 3.0 is the latest version available for download. Two
basic database packages are available - one for Windows and one for
Unix platforms (including Mac OS X). See the file ChangeLog (Unix) or
CHANGES.txt (Windows) for a list of changes from previous versions.
WordNet packages can either be downloaded from our web site via:
http://wordnet.princeton.edu/obtain
The Windows package is a self-extracting archive that installs itself
when you double-click on it.
Beginning with Version 2.1, we changed the Unix package to a GNU Autotools
package. The WordNet browser makes use of the open source Tcl and Tk
packages. Many systems come with either or both pre-installed. If
your system doesn't (some systems have Tcl installed, but not Tk)
Tcl/Tk can be downloaded from:
http://www.tcl.tk/
Tcl and Tk must be installed BEFORE you compile WordNet. You must also
have a C compiler before installing Tcl/Tk or WordNet. WordNet has
been built and tested with the GNU gcc compiler. This is
pre-installed on most Unix systems, and can be downloaded from:
http://gcc.gnu.org/
See the file INSTALL for detailed WordNet installation instructions.
File diff suppressed because it is too large. Load diff
+7
View File
@@ -0,0 +1,7 @@
best well
better well
deeper deeply
farther far
further far
harder hard
hardest hard
@@ -0,0 +1,9 @@
Citation for PWN
@book{_Fellbaum:1998,
booktitle = "{WordNet}: An Electronic Lexical Database",
address = "Cambridge, MA",
editor = "Fellbaum, Christiane",
publisher = "MIT Press",
year = 1998,
}
File diff suppressed because it is too large. Load diff
File diff suppressed because it is too large. Load diff
File diff suppressed because it is too large. Load diff
File diff suppressed because it is too large. Load diff
File diff suppressed because it is too large. Load diff
File diff suppressed because it is too large. Load diff
File diff suppressed because it is too large. Load diff
File diff suppressed because it is too large. Load diff
File diff suppressed because it is too large. Load diff
File diff suppressed because it is too large. Load diff
+45
View File
@@ -0,0 +1,45 @@
00 adj.all 3
01 adj.pert 3
02 adv.all 4
03 noun.Tops 1
04 noun.act 1
05 noun.animal 1
06 noun.artifact 1
07 noun.attribute 1
08 noun.body 1
09 noun.cognition 1
10 noun.communication 1
11 noun.event 1
12 noun.feeling 1
13 noun.food 1
14 noun.group 1
15 noun.location 1
16 noun.motive 1
17 noun.object 1
18 noun.person 1
19 noun.phenomenon 1
20 noun.plant 1
21 noun.possession 1
22 noun.process 1
23 noun.quantity 1
24 noun.relation 1
25 noun.shape 1
26 noun.state 1
27 noun.substance 1
28 noun.time 1
29 verb.body 2
30 verb.change 2
31 verb.cognition 2
32 verb.communication 2
33 verb.competition 2
34 verb.consumption 2
35 verb.contact 2
36 verb.creation 2
37 verb.emotion 2
38 verb.motion 2
39 verb.perception 2
40 verb.possession 2
41 verb.social 2
42 verb.stative 2
43 verb.weather 2
44 adj.ppl 3
File diff suppressed because it is too large. Load diff
File diff suppressed because it is too large. Load diff