Repository navigation

Catalogue and download private data from SSH, HTTPS, WebDAV and S3 servers - #62

Merged

denniswu28 merged 55 commits into

codex/function-atomic-replay-20260928from

feat/private-data-backend

Oct 21, 2026

Merged

Catalogue and download private data from SSH, HTTPS, WebDAV and S3 servers#62
denniswu28 merged 55 commits into
codex/function-atomic-replay-20260928from
feat/private-data-backend

Commits on Oct 12, 2026
- Keep credentials out of remote catalogue URLs
  
  denniswu28
  and
  claude
  committed
  20a2083
- Keep the previous catalogue when remote scans fail or match nothing
  
  denniswu28
  and
  claude
  committed
  e66d963
- Support OpenSSH eight and configure connection keepalives
  
  denniswu28
  and
  claude
  committed
  59f8af7
- Record checksum provenance and centralize remote catalogue detection
  
  denniswu28
  and
  claude
  committed
  b10d8d9
- Model named sources and migrate legacy catalogue selections
  
  denniswu28
  and
  claude
  committed
  cf3b594
- Catalogue multiple sources and route downloads to their remotes
  
  denniswu28
  and
  claude
  committed
  073b845
- Hash files in one pass and publish without replacing existing paths
  
  denniswu28
  and
  claude
  committed
  11bba16
- Stage catalogue version records in one Git process
  
  denniswu28
  and
  claude
  committed
  3d60357
- Add a shared content-addressed download cache
  
  denniswu28
  and
  claude
  committed
  1606f48
- Verify download sizes and both published and recorded digests
  
  denniswu28
  and
  claude
  committed
  599059d
- Complete downloads through the cache and stage their content hashes
  
  denniswu28
  and
  claude
  committed
  b631367
- Resolve redacted secrets from environment keyrings and commands
  
  denniswu28
  and
  claude
  committed
  60ad75e
- Resolve typed local authentication profiles for each backend
  
  denniswu28
  and
  claude
  committed
  72a8572
- Authenticate HTTP requests with host-bound basic and bearer profiles
  
  denniswu28
  and
  claude
  committed
  a2323db
- Discover WebDAV collections and download their files over HTTP
  
  denniswu28
  and
  claude
  committed
  3fea79d
- Catalogue and download S3 objects with optional boto3 support
  
  denniswu28
  and
  claude
  committed
  15b22ab
- Request server-side SSH checksums for selected catalogue files
  
  denniswu28
  and
  claude
  committed
  ec4ad4a
- Demonstrate private data sources and caching in a self-contained Python notebook
  
  denniswu28
  and
  claude
  committed
  4ab807d
Commits on Oct 13, 2026
- Keep downloaded files in the object store
  
  denniswu28
  and
  claude
  committed
  8c36764
- Name placements from the object store in plans and reports
  
  denniswu28
  and
  claude
  committed
  d379345
- Trust stored objects only while their recorded stat matches
  
  denniswu28
  and
  claude
  committed
  da52929
- Save catalogue rows in one normalized form
  
  denniswu28
  and
  claude
  committed
  ea2685b
- Keep the catalogue in data.tsv alone
  
  denniswu28
  and
  claude
  committed
  b55ccf7
- Record a catalogue's kind in its config rather than guess it from columns
  
  denniswu28
  and
  claude
  committed
  4376d10
- Check repository metadata and URL secrets with one rule each
  
  denniswu28
  and
  claude
  committed
  966d37b
- Save long-running changes over the current state, never a stale copy
  
  denniswu28
  and
  claude
  committed
  0ad0f4b
- Name checksum algorithms and unnamed remotes the same way everywhere
  
  denniswu28
  and
  claude
  committed
  24beff0
- Explain how to clear the hallmark state that blocks a checkout
  
  denniswu28
  and
  claude
  committed
  3f2fcca
- Download files over HTTP as the server stores them
  
  denniswu28
  and
  claude
  committed
  e2c1e61
- Decode remote metadata strictly, as UTF-8 unless the server says otherwise
  
  denniswu28
  and
  claude
  committed
  4a650bf
- Let listings and catalogue tables outgrow the small-document limit
  
  denniswu28
  and
  claude
  committed
  010eaae
- Ask S3 for checksums of selected objects only, several at a time
  
  denniswu28
  and
  claude
  committed
  596c912
- Report user errors without tracebacks and clone only approved downloads
  
  denniswu28
  and
  claude
  committed
  54eb17b
- Remove helpers nothing calls and notes about removed code
  
  denniswu28
  and
  claude
  committed
  977fe48
Commits on Oct 15, 2026
- Clean private data backend branch
  denniswu28
  committed
  46a67b7
Commits on Oct 19, 2026
- Merge branch 'codex/function-atomic-replay-20260928' into feat/private-data-backend
  denniswu28
  authored
  ae911d6
Commits on Oct 20, 2026
- Accept Click's unknown-option message in every version
  
  denniswu28
  and
  claude
  committed
  577152a
- Let the Rocky Linux SSH jobs log in as root and show sshd's log on failure
  
  denniswu28
  and
  claude
  committed
  c5e36f0
- Stage every transfer that finished before a download was interrupted
  
  denniswu28
  and
  claude
  committed
  171c64c
- Stage a download's SHA-1 only while its row is as planned
  
  denniswu28
  and
  claude
  committed
  afec0a3
- Replace downloads whose catalogue row changed, keeping old versions in .hm/objects
  
  denniswu28
  and
  claude
  committed
  7e905bd
- List files that changed on the server when a source is added again
  
  denniswu28
  and
  claude
  committed
  4208d27
- Describe paths another source already catalogs by their content
  
  denniswu28
  and
  claude
  committed
  eeaa4e2
- Let hm add skip or prefix paths another source already catalogs
  
  denniswu28
  and
  claude
  committed
  e3301ed
- Warn when catalogue paths differ only in letter case
  
  denniswu28
  and
  claude
  committed
  7173185
- Test the rarer paths of replacing downloads and comparing clashes
  
  denniswu28
  and
  claude
  committed
  4bde60c
- Install xargs on Rocky Linux and skip the unreadable-file test as root
  
  denniswu28
  and
  claude
  committed
  d0bd7e6
Commits on Oct 21, 2026
- Merge Sam's filename formats into the private data backend
  
  denniswu28
  and
  claude
  committed
  27a0dfb
- Ask before re-adding a source drops files, and let a new format re-sort every source
  
  denniswu28
  and
  claude
  committed
  acc5e6b
- Accept . and ./ as a source's root folder
  
  denniswu28
  and
  claude
  committed
  80ab480
- Unstage everything on a branch with no commits
  
  denniswu28
  and
  claude
  committed
  02f7a03
- Keep the repository's folder literal when globbing a pattern
  
  denniswu28
  and
  claude
  committed
  311e6cf
- Remove an unused download helper
  
  denniswu28
  and
  claude
  committed
  bb73c5f
- Test edge cases of downloads, transports, the CLI and format detection
  
  denniswu28
  and
  claude
  committed
  4c9dffc
- Count the S3 job's coverage in the combined report
  
  denniswu28
  and
  claude
  committed
  eeee884

Commits

Commits on Oct 12, 2026

Commits on Oct 13, 2026

Commits on Oct 15, 2026

Commits on Oct 19, 2026

Commits on Oct 20, 2026

Commits on Oct 21, 2026