punkshell

1 Tag

192 MiB

Author	SHA1	Message	Date
Julian Noble	5c25d15cc7	G-126 achieved 2026-07-27: flip + archive record + reference sweep Every acceptance clause is met: vendored source green under the pinned zig 0.16 toolchain via the make.tcl tool step (zig optional), upstream extract-to-directory + pinned porcelain listing, punk::zip accelerator with the parity suite (identical names/bytes/mtimes both engines over the G-124 shapes and the file-relative piperepl kit; pure path proven when absent), recorded benchmark (crossover ~15-20 members, material from ~50, x2.3-2.6 native / x3.8-4.9 kit-hosted), and PROVENANCE.md origin/re-vendor/licence records. Index entry moved to GOALS-archive.md; detail Status flipped (the file moves to goals/archive/ in the adjacent pure-rename commit). Reference sweep: G-101's pending-tense accelerator mention rewritten as achieved with the archive path; G-128's Depends-on gains the archive pointer plus the now-existing pattern surface and the zig-0.16 traps its port should read first. Assisted-by: harness=claude; primary-model=claude-fable-5; api-location=anthropic.com	3 days ago
Julian Noble	9b0fe35aa0	G-134 drafted + G-128 amended (user-approved): archive-relative bake pin, consented file-relative stamping Two halves of one file-relative policy decision. G-134 (new, proposed): advisory post-assembly punk::zip::archive_info probe at the G-133 seam pins make.tcl's own kit outputs archive-relative - by-construction property becomes a checked contract; mkzip -offsettype file and modpod stay available for deliberate manual creation. G-128: the straight file-relative refusal becomes default-refuse with a consent-flag preserve (central-directory offset fix-up by the shift delta, zip64/multi-disk still refused), plus Notes recording the rationale, the Authenticode sign-after-stamping rule, and the convention-conversion parking. goals_lint clean (85 active, 49 archived). Assisted-by: harness=opencode; primary-model=openrouter/moonshotai/kimi-k3; api-location=openrouter.ai	4 days ago
Julian Noble	78d9bf238a	G-124 achieved: dependency-free zip reading in punk::zip (punkshell 0.26.0) punk::zip could write a zip and split an executable-prefixed one, but nothing in the tree could READ a zip without zipfs, vfs::zip or tcllib's zipfile::decode - a system package punkshell does not vendor, with exactly one consumer: make.tcl's zipfs-less kit extraction. Measured at drafting: msys2's /usr/bin/tclsh8.6 has no tcllib, so a bake driven from that host could not lift the runtime's own zip (its tcl_library) into the kit and the artifact did not boot. punk::zip 0.1.1 -> 0.2.0 adds three commands, stock Tcl only. archive_info reports where the archive begins inside its host file and which offset convention it uses; members walks the central directory and returns one dict per entry without decompressing anything; unzip extracts all or part of it with every member's crc32 verified, directories materialized, and the writer's 2MB whole-member-vs-streaming threshold mirrored. All three accept a plain .zip or a zip attached to an executable or script prefix, so "what is inside this kit / runtime / modpod" is now answerable on a runtime without zipfs. The offset derivation is stated once and shared: offsetbase = cdiroffset - diroffset. Positive means an external preamble with archive-relative offsets, zero means the offsets are file-relative (or there is no preamble); dataoffset is the split point either way. Because every surface reads the ORIGINAL file at that base, the file-relative shape stops being a special case - the broken split-off intermediate is never produced. tclsh90b4_piperepl.exe is the store's one file-relative artifact: the old split-then-tcllib path still fails on it with exactly "Bad zip file. Bad closure.", and it now extracts all 841 members crc-verified in 735ms. extract_preamble consumes that machinery instead of carrying its own scan, and two defects went with the refactor: it read 28 bytes of a 30-byte local file header, and it derived the file-relative base from the FIRST central directory record only (its own '#todo! loop through all cdr file headers'). The shared walk takes the minimum over ALL records and then validates that a PK\3\4 really sits there. Its five puts stdout debug lines are gone. Refusals are decided for every selected member before any file is opened, so an unsupported archive cannot leave a half-populated directory: encrypted entries, zip64 size/offset fields, unknown compression methods, crc mismatch (partial file removed) and member paths that would escape the target are each named. Store and deflate only, mirroring the writer's own primitives. make.tcl's zipfs-less extraction now calls punk::zip::unzip on the original runtime and no longer creates the extracted_<runtime>.zip intermediate. No punkshell code requires zipfile::decode any more. Two categories of hit remain and are deliberate: tcllib's own zip/decode.tcl shipped as a LIBRARY inside some .vfs payloads, and one guarded optional probe inside the vendored third-party ooxml1.10/ooxml.tcl. First tests punk::zip has ever had (src/tests/modules/punk/zip/), covering the three archive shapes from one source tree, the introspection output, the named refusals, and the mkzip -> read round trip - the first coverage that what punkshell WRITES is readable. Verification, all 2026-07-26. Reference host for the dependency-free claim: msys2 tclsh8.6 8.6.12, probed as zipfs / vfs::zip / zipfile::decode all ABSENT - suite driven there harness-free, 28 passed, 2 skipped (the zipfs-gated cross-checks only), 0 failed. 30/30 under Tcl 9.0.3, 28 + 2 skipped under native 8.6. Full source-tree suite after the change: 1142 tests, 1 failure - core/tcl exec-14.3, the documented baseline. Independent cross-check: 868 members of tclsh905.exe extracted byte-identical against the same archive mounted with tcl zipfs. Bake demonstration: 'bake -confirm 0 punk905' driven by the msys2 tclsh8.6 (host=msys-x86_64, target=win32-x86_64) produced extracted_tclsh905.exe/{tcl_library,lib} with no intermediate .zip, and the deployed kit boots with tcl_library at //zipfs:/app/tcl_library, 95 encodings, msgcat 1.7.1, http 2.10.2 - and reads itself with the new reader. Trap worth keeping: zlib stream inflate's 'get' returns only what the stream has already produced, so one get per put silently truncates a large member to the first few chunks (measured 327680 of 5048890 bytes on both 8.6.12 and 9.0.3). The inner drain loop is load-bearing, and the >2MB streaming test exists to catch its removal. Standing question answered and pinned: zipfs does NOT misidentify punk::zip::mkzip directories. It keys on the trailing slash (which punk::zip::walk always emits), not the stored permission bits, exactly as the current cli-999999.0a1.0.tm wording says - the older, less precise wording survives only in frozen module snapshots under src/vfs/mkzipfix.vfs and src/vfs/project.vfs. The real difference from zipfs mkzip is that zipfs writes no directory entries at all. The achieved flip archives the entry and the detail file, and sweeps the live tier: G-034 (the reader is its extract-rather-than-mount alternative, plus the measured finding that make.tcl on 8.6 cannot mount its own templates modpod), G-101 (the read half of a zipfs-less 8.6 container is solved), G-125 (the gate now has a named failure reason to report), G-126 (the member-dict keys and fixture set its parity suite must reproduce, and a back-pointer to G-128 whose only recorded bridge was this goal), G-128 (archive_info answers "is this artifact safe to move the overlay of?" in one call). One acceptance clause is reported for review rather than claimed silently: "NO zipfile::decode requirement remains anywhere in the shipped tree" is satisfied for punkshell's own code, with the vendored-third-party residue named above. The archived detail file's diff is a rename plus the flip's evidence write-up. Assisted-by: harness=claude; primary-model=claude-opus-5[1m]; api-location=anthropic.com	4 days ago
Julian Noble	78b6f47805	G-127/G-128 drafted + G-057 amended (user-approved): cross-target vfs bake, portable PE stamping, icon sidecar and mechanism seam Follow-on goals from the G-122 host/target split, each drafted with its overlap survey and approved before writing. The G-057 contract edit (title, Scope, Goal, Acceptance) was shown clause-by-clause and approved per the proposal-first rule. G-057 amended - the goal was drafted before G-122 separated host from target, so its skip condition read as one host-shaped test ("non-Windows platform skips") while its Notes used target language. Split in two: a target with no PE resources is NOT APPLICABLE, a windows target on a host that cannot run twapi is a distinct shortcoming. Both still emit a text sidecar, now produced for every kit on every target and defined so the parked RT_VERSION follow-on extends the same file rather than adding a second. Embedding sits behind a single mechanism seam, and the twapi arm is explicitly PERMANENT - the seam selects between mechanisms, it does not replace one: twapi is vendored and git-tracked (src/vendorlib_tcl8\|9/win32-x86_64/twapi-5.0b1) and reachable from make.tcl's auto_path, so a fresh windows checkout that fetches a runtime and bakes gets icons with no build toolchain (probed under a stock tclsh 9.0.3 and a fetched plain family runtime). The per-vfs override is settled as shared across a kit definition's targets with no target dimension. G-127 - cross-target bake of a custom .vfs. G-122 made the build READ the right runtime for a target; this makes it WRITE the right kit for one. Three measured gaps: output is flat, so two POSIX targets of one kit collide (within a run the duplicate guard renames by RUNTIME not platform; across selective runs exe_names_seen resets and the second overwrites the first); the payload model is one hand-curated folder per target (punk9linux.vfs, not a vfslibs participant, with vendorlib_vfs.toml hardcoding the platform into its source path - a shape inherited from G-037 when there was one target); and nothing verifies payload against target. Non-native kits go to bin/kits/<platform>/ with native staying at bin/<name>; /bin/* already ignores it so no dual-track ignore work. Records that G-114 and G-115 overlap yet never reference each other - the platform axis and the payload axis have never been connected. G-128 - portable PE resource stamping via a vendored zig tool, plugging into G-057's seam without retiring its twapi arm. Feasibility measured: zig rc (resinator, bundled in the 0.16 toolchain) is a resource COMPILER supplying the RT_GROUP_ICON/RT_ICON structure reference, not a patcher - we never link these runtimes, so patching an existing PE is the work. In our runtimes .rsrc is not the last section (.reloc follows), so the implementation appends a section and repoints the resource data directory, which shifts the overlay: safe for an archive-relative zip, not for a file-relative one, so the unsafe case is refused rather than corrupted. The payoff beyond portability is post-hoc stamping of a finished kit, which removes G-057's icon-before-append ordering constraint. Its distribution is settled as buildable from vendored source AND publishable as a punkbin artifact, so the no-toolchain route need not depend on the committed twapi (the G-004 tension). Also adds non-contract Related back-pointers in G-057 to G-122/G-127/G-128. Assisted-by: harness=claude; primary-model=claude-opus-5[1m]; api-location=anthropic.com	4 days ago

4 Commits (72807392043102d8084fa04d9d0147c6668eccaa)