[content] Life Sciences guide: scheduled Globus transfers to Data Depot - #285
Conversation
First draft of a Life Sciences guide on scheduling recurring scratch-to-Depot Globus transfers, for researchers whose projects outlast the scratch purge window. Nothing on the site covered Globus timers; a repo-wide search for "globus timer", "timer create" and "recurring transfer" returned no hits. Optimised for review rather than publication: carries a draft banner and five [NEEDS CLARIFICATION] markers for the Globus owner, covering collection names, GCSv5 consent persistence, Purdue-specific web-app flow, and a conflict between the brief and the Depot user guide over whether Depot is "backed up". Reuses existing coverage by linking rather than restating: Globus basics from the Depot transfer guide, purge policy and paths consistent with the scratch_purge / scratch_space snippets, purchasing from the Depot overview. Nav entry added and breadcrumbs.json regenerated.
…n for mtime modification sync level
|
Hi Arun,
For the I updated the |
|
After a discussion with Globus Support, the only way to truly automate a Timer is to use a Globus service account. That would require setting up guest collections, the confidential client, the timer. It gets a little tricky because if anything goes wrong with the timers, the email notification will go to {client_ID}@clients.auth.globus.org rather than their Purdue email, so there's danger of a silent failure. I think having their Purdue account create the timer with notifications on for inactive/failed transfers is a better solution since this is more short-term. They'll get notified if it's inactive and they can go in and authenticate. Do you have any thoughts, Arun? |
|
@aseetharam I added a few images that show the I left a few [Needs Clarification] that will need to be cleared before publishing. Let me know if there's anything else you'd like me to add! |
|
Thanks @rwilfong, this covers everything! Agreed on the personal account with notifications. From what I've heard service accounts are headache, so I'll leave that out entirely rather than mention it as an option. Your point on persistent consent changes that section. I had re-authentication under Troubleshooting as though it were expected. If consent only breaks when someone explicitly revokes it, that's an edge case, so I'm rewriting it that way. Two small fixes on your commits: the new image paths are relative and Life Sciences moved to absolute (/assets/images/lifesciences/...) under invariant 5, and I'm expanding the alt text to describe what each screenshot shows for the WCAG mandate. Pushing now and taking it out of draft. The lab session is tomorrow. If Globus comes back with anything different on long-running GCS-to-GCS timers we can amend the page after. |
Draft for review — not ready to merge.
New Life Sciences guide on scheduling recurring Globus transfers from cluster scratch to Data Depot, so long-running projects survive the scratch purge. Written for the DeWoody lab consultation but applies generally; this question comes up repeatedly.
Review request
@rwilfong — this is your area. Four things I could not resolve on my own, marked
[NEEDS CLARIFICATION]in the page:docs/snippets/globus.mdanddocs/userguides/depot/storage/transfer.mddisagree. What is the correct scratch collection name per cluster, and is the Depot name current?Please look hardest at the
!!! dangerbox on delete-on-destination. If a reader enables that option on a scratch-to-Depot timer, the next run after a purge deletes their Depot backup while every task reports success. It is the one place on the page where wrong guidance destroys data. I want your eyes on the wording and on whether the option label matches what Purdue users actually see.Optional: screenshots
Archetype D calls for screenshots, and this page has none. If you are taking screenshots for Tuesday's session anyway, three would help most:
No pressure if you would rather not. Every screenshot needs meaningful alt text under the WCAG mandate and goes stale when Globus changes its UI, so I would rather have three good ones than a dozen.
Verification
mkdocs build --strictpasses with no new warnings against the baseline.Not ready to merge until