yj#tdZddlmZddlZddlZddlZddlZddlZddlmZm Z ddl m Z ddl m Z mZmZmZmZmZddlmZddlmZdd lmZejeZd Zd d hZejd ZdBdZ dBdZ!dBdZ"dZ#dCdZ$dDdEdZ%dFdZ&dGdZ'dHdZ(dId!Z) dDdJd(Z*dKdd*dLd.Z+dDdMd2Z,dNd4Z-dOd6Z.dPd9Z/dQd;Z0dRd>Z1dDdSd@Z2dTdAZ3dS)UuCurator snapshot + rollback. A pre-run snapshot of ``~/.hermes/skills/`` (excluding ``.curator_backups/`` itself) is taken before any mutating curator pass. Snapshots are tar.gz files under ``~/.hermes/skills/.curator_backups//`` with a companion ``manifest.json`` describing the snapshot (reason, time, size, counted skill files). Rollback picks a snapshot, moves the current ``skills/`` tree aside into another snapshot so even the rollback itself is undoable, then extracts the chosen snapshot into place. The snapshot does NOT include: - ``.curator_backups/`` (would recurse) - ``.hub/`` (hub-installed skills — managed by the hub, not us) It DOES include: - all SKILL.md files + their directories (``scripts/``, ``references/``, ``templates/``, ``assets/``) - ``.usage.json`` (usage telemetry — needed to rehydrate state cleanly) - ``.archive/`` (so rollback restores previously-archived skills too) - ``.curator_state`` (so rolling back also restores the last-run-at pointer — otherwise the curator would immediately re-fire on the next tick) - ``.bundled_manifest`` (so protection markers stay consistent) - ``.curator_suppressed`` (so rollback restores the set of pruned built-ins the re-seeder must leave archived) Alongside the skills tarball, each snapshot also captures a copy of ``~/.hermes/cron/jobs.json`` as ``cron-jobs.json`` when it exists. Cron jobs reference skills by name in their ``skills``/``skill`` fields; the curator's consolidation pass rewrites those in place via ``cron.jobs.rewrite_skill_refs()``. Without capturing the pre-run state, rolling back the skills tree would leave cron jobs pointing at the umbrella skills even though the narrow skills they were originally configured with have been restored. We store the whole jobs.json for fidelity but rollback only touches the ``skills``/``skill`` fields — the rest (schedule, next_run_at, enabled, prompt, etc.) is live state and we leave it alone. ) annotationsN)datetimetimezone)Path)AnyDictListOptionalSetTupleget_hermes_homeis_excluded_skill_path) format_bytes.curator_backupsz.hubz/^\d{4}-\d{2}-\d{2}T\d{2}-\d{2}-\d{2}Z(-\d{2})?$returnrc*tdz dz S)Nskillsrr :/home/ragecks/.hermes/hermes-agent/agent/curator_backup.py _backups_dirrGs   x '*< <z%_count_skill_files..sD  5KA5N5N       rzSKILL.mdr)sumrglobr.)rhs r_count_skill_filesrpse  zz*--       qqs +. <<r& archive_pathskills_counted cron_infoOptional[Dict[str, Any]]Nonec`|j|tjtj|j|j|d}|t| ddt| ddd|d<| ds| dd |dd<| d r|d |dd <|d z tj |d d ddS)N)idr& created_atarchive archive_bytes skill_filesr$Fr%rr# cron_jobsr&z not capturedr* manifest.jsonT)indent sort_keysr+r')namerrCrrKrMstatst_sizer[r5r_r;r1dumps)r r&rqrrrsmanifests r_write_manifestrs8il8<00::<<$%**,,4% HimmK??@@immL!<<==! ! }}[)) V.7mmHn.U.UH[ !( + == ) ) P5>5OH[ !/ 2 O'' 8A666(rmanual) protect_idsrOptional[Set[str]]Optional[Path]ctstddSt}|stddSt } |ddn4#t$r'}td||Yd}~dSd}~wwxYwt}|}d}||z r$|d|d }|dz }||z $||z } |dd n4#t$r'}td ||Yd}~dSd}~wwxYw|d z } tj | d d5} t| D];} | j tvr| t!| | j d< dddn #1swxYwYt#|} t%||| t'|| ni#ttjf$rP}td|d t+j|dn#t$rYnwxYwYd}~dSd}~wwxYwt/t1|td|||S)u.Create a tar.gz snapshot of ``~/.hermes/skills/`` and prune old ones. Returns the snapshot directory path, or ``None`` if the snapshot was skipped (backup disabled, skills dir missing, or an IO error occurred — in which case we log at debug and return None so the curator never aborts a pass because of a backup failure). ``protect_ids`` is forwarded to the prune step so callers can guarantee specific snapshot ids survive even when they fall outside the keep window (rollback passes the id it is about to restore from). z4Curator backup disabled by config; skipping snapshotNu5No ~/.hermes/skills/ directory — nothing to back upTparentsexist_okz#Failed to create backups dir %s: %srbrI02dFz$Failed to create snapshot dir %s: %s skills.tar.gzzw:gz) compresslevel)arcname recursive)rszCurator snapshot failed: %sexc_info ignore_errors)raprotectz!Curator snapshot created: %s (%s))r^r/r0rr,rmkdirr.rPtarfileopensortediterdirr_EXCLUDE_TOP_LEVELaddrErBrrpTarErrorshutilrmtree _prune_oldrgr=) r&rrbackupsr?base_idsnap_idcounterr rytfentryrss rsnapshot_skillsrs << KLLLt ]]F ==?? LMMMtnnG dT 2222  :GQGGGtttttiiGGG W  $ $ & &,,w,,,1  W  $ $ & & W D 4% 0000  ;T1EEEttttt_$G \'6 ; ; ; Gr 0 011 G G:!333s5zz5:FFFF  G G G G G G G G G G G G G G G G+400 fg*622"+ - - - - - W% & 2A EEE  M$d 3 3 3 3 3    D tttttHJJ 4444 KK3WfEEE Ks8B CB<<CD// E 9EE )H'AG+ H'+G//H'2G/33H''J =JI21J2 I?<J>I??JJ rar List[str]cj|p t}t}|sgSg}g}|D]}|s|jdr||Gt |jr||j|f| ddg}||dD]q\}}|j|vr tj |||j?#t$r&} td|| Yd} ~ jd} ~ wwxYw|D]J} tj |#t$r&} td|| Yd} ~ Cd} ~ wwxYw|S)uDelete regular snapshots beyond the newest *keep*. Returns deleted ids. Snapshot ids in *protect* are never deleted even when they fall outside the keep window — rollback() uses this so the mandatory pre-rollback safety snapshot can never evict the very snapshot being restored. Staging dirs (``.rollback-staging-*``) are implementation detail and pruned independently on every call..rollback-staging-c|dS)Nrr)ts rz_prune_old..?s qtrT)keyreverseNzFailed to prune %s: %sz(Failed to clean stale staging dir %s: %s)setrr,ris_dirr startswithappend_ID_REmatchsortrrr.r/r0) rarrentries stale_stagingchilddeleted_pathr?s rrr&sGnnG >>   &(G "M"" 0 0||~~   : !5 6 6    ' ' '  << # # 0 NNEJ. / / / LL^^TL222G455><<4 9    < M$    NN49 % % % % < < < LL14 ; ; ; ; ; ; ; ; <NN N M$     N N N LLCT1 M M M M M M M M N Ns0.D33 E#=EE#+F F0 F++F0snap_dirc|dz }|siS tj|dS#ttjf$ricYSwxYw)Nr}r+r')r,r1r2r-r.r8)rmfs r_read_manifestrUsp O #B 99;; z",,,88999 T) * s'AA A List[Dict[str, Any]]ctt}|sgSg}t|dD]}|st |js7|dz sOt|}| d|j| dt|d|vr8|dz } | j |d<n#t$rd|d<YnwxYw|||S)uReturn all restorable snapshots, newest first. Only entries with a real ``skills.tar.gz`` tarball are listed — transient ``.rollback-staging-*`` directories created mid-rollback are implementation detail and not shown.Trrrwrrzr)rr,rrrrrrr setdefaultrErrr.r)routrrarcs r list_backupsr_sG nnG >>   "C))4888||~~  ||EJ''  '//11   E " " dEJ''' fc%jj))) " $ $/)C (&)hhjj&8?## ( ( (&'?### ( 2 Js0D  DD backup_id Optional[str]c\t}|sdS|rN||z }|r3t|r|dz r|SdSdt |dD}|r|dndS)zpReturn the path of the requested backup, or the newest one if *backup_id* is None. Returns None if no match.Nrcg|]N}|t|j5|dz L|OS)r)rrrrr,)rkcs r z#_resolve_backup..se 88:: ,,qv..454G3O3O3Q3Q rTrr)rr,rrrrr)rrtarget candidatess r_resolve_backupr|snnG >>  t9$ MMOO  Y'' /)1133  Mt'//++T:::J' 0:a==D0r snapshot_dirc dggddd}|tz }|sdt|d<|S |d}tj|}n-#t tjf$r}d ||d<|cYd}~Sd}~wwxYwt|tr| d }nt|tr|}nd}t|tsd |d<|Si}|D]}t|ts| d } t| tr| sE| d | d| dp| d|| <|sd|d<|S ddl m } m} m} n!#t $r}d||d<|cYd}~Sd}~wwxYwd|d< | 5| } d}t#}| D]]}t|ts| d } t| tr| sF|| | | }|s| d }| d}| d }| d}||kr||kr|dxxdz cc<||d dn||d <||ddn||d<|d| | dp| ||d||ddd}_|D]<\} }| |vr3|d| | dp| d=|r | | dddn #1swxYwYn<#t,$r/}t.d|dd||d<Yd}~nd}~wwxYw|S)u]Reconcile backed-up cron skill links into the live ``cron/jobs.json``. We do NOT overwrite the whole cron file. Only the ``skills`` and ``skill`` fields are restored, and only on jobs that still exist in the current file (matched by ``id``). Everything else about the job — schedule, next_run_at, last_run_at, enabled, prompt, workdir, hooks — is live state that the user/scheduler has modified since the snapshot; overwriting it would regress unrelated cron activity. Rules: - Jobs present in backup AND live, with differing skills → skills restored. - Jobs present in backup AND live, with matching skills → no-op. - Jobs present in backup but gone from live (user deleted the job after the snapshot) → skipped, noted in the return report. - Jobs present in live but not in backup (user created a new cron job after the snapshot) → left untouched. Never raises; failures are captured in the return dict. Writes through ``cron.jobs`` to pick up the same lock + atomic-write path that tick() uses, so we don't race the scheduler. FrN) attemptedrestoredskipped_missing unchangederrorzsnapshot has no rr+r'zfailed to load backed-up jobs: r)z)backed-up cron-jobs.json has no jobs listrwrskillr)rrrTr) load_jobs save_jobs _jobs_lockzcron module unavailable: rrbr)rr)job_idjob_namefromtor)rrz"Cron skill-link restore failed: %srzrestore failed mid-flight: )r:r,r-r1r2r.r8r3r4r5r6rE cron.jobsrrr ImportErrorrrpopritemsrVr/r0)rreport backup_file backup_text backup_parsedr? backup_jobs backup_by_idjobjidrrr live_jobschangedlive_idsliverT cur_skills cur_skill bkp_skills bkp_skills r_restore_cron_skill_linksrsX. F!33K     A-?AAw !++W+==  ;// T) *?A??w  -&&#''// M4 ( (#  k4 ( (Ew /1L   #t$$  ggdmm#s## 3  ggh''WWW%%GGFOO*s  S "{ >>>>>>>>>>> 9a99w F;:< Z\\6 %6 %! IGuuH!& & !$--hhtnn!#s++3 S!!!%))#..>!XXh//  HHW-- #ZZ11 "JJw// ++ Y0F0F;'''1,'''%HHXt,,,,%/DN$HHWd++++$-DMz"))! & 6 2 2 9c'1IFF%/)DD ++  ,1133   Vh&&,-44"%$*JJv$6$6$=#66  % )$$$m6 %6 %6 %6 %6 %6 %6 %6 %6 %6 %6 %6 %6 %6 %6 %n <<< 91t LLL;;;w< Msx*A""B 8 BB B  F F1 F,&F1,F1: N6GN* N6*N..N61N.2N66 O/%O**O/movedList[Tuple[Path, Path]]cg}|D]\}} |r)|stj|n<|s|r|tjt|t|#t$r| |j YwxYw|S)aMove staged entries back to their original paths. ``shutil.move`` moves *into* an existing destination directory rather than replacing it, so a partially-completed extract leaves debris that would otherwise bury the user's real skill one level deeper (``skills/foo/foo/``) while the tree still looks populated. Clear whatever the failed extract created at each original path first. The staged copy is authoritative, and the pre-rollback safety snapshot is the undo handle for the extract's own output. Returns the names that could not be restored, so the caller can report an incomplete recovery instead of claiming the state was restored. ) r is_symlinkrrr,unlinkmoverEr.rr)rfailedorigr s r_unstager!sF%% d %{{}} T__%6%6  d#### $//"3"3  KD 3t99 - - - - % % % MM$) $ $ $ $ $ % MsB(B44$CC Tuple[bool, str, Optional[Path]]c  t|}|dd|rd|dndzdzdfS|dz }|sdd |jd dfSt}|d d t }|d d  t d |j|jhn#t$r}dd|dfcYd}~Sd}~wwxYw|dtz } |d d n#t$r}dd|dfcYd}~Sd}~wwxYwg} t| D]a}|jtvr||jz } tjt|t| ||| fbnV#t$rI}t#| tj|d n#t$rYnwxYwdd|dfcYd}~Sd}~wwxYw t'j|d5} | D]K} | j} | dsdt/| jvrt'jd| L | t|dn2#t6$r%| t|YnwxYwdddn #1swxYwYnB#tt&jf$r(}d|D} t| D]|}|jtvs |j| vr |r)|stj|n|m#t$rYywxYwt#|}|r3dd|ddtA|d|dfcYd}~S tj|d n#t$rYnwxYwdd|dfcYd}~Sd}~wwxYw tj|d n#t$rYnwxYwtC|}d |jg}|"d!r7tG|"d"pg}tG|"d#pg}|"d$r|d%|d$n|d&kr!|d&kr|"d'd&d&krng}|r||d(|r||d)|"d'r||d'd*|d+d|ztH%d,|j|d d-||fS).aoRestore ``~/.hermes/skills/`` from a snapshot. Strategy: 1. Resolve the target snapshot (explicit id or newest regular). 2. Take a safety snapshot of the CURRENT skills tree under ``.curator_backups/pre-rollback-/`` so the rollback itself is undoable. 3. Move all current top-level entries (except ``.curator_backups`` and ``.hub``) into a tempdir. 4. Extract the chosen snapshot into ``~/.hermes/skills/``. 5. On failure during 4, move the tempdir contents back (best-effort) and return failure. Returns ``(ok, message, snapshot_path)``. NFzno matching backup foundz for id ''zB (use `hermes curator rollback --list` to see available snapshots)rz snapshot u$ has no skills.tar.gz — corrupted?Trzpre-rollback to )r&rz%pre-rollback safety snapshot failed: rzfailed to create staging dir: rz failed to stage current skills: zr:gz/z..z!refusing to extract unsafe path: data)filterc"h|] \}}|j Sr)r)rkrrs r zrollback..s777gdA 777rzsnapshot extract failed: z - could not restore z, z; staged copies kept at z*snapshot extract failed (state restored): zrestored from snapshot rrrrucron links: error — rrz job(s) had skill links restoredz+ backed-up job(s) no longer exist (skipped)z already matchedz cron links: z3Curator rollback: restored from %s (cron_report=%s)z; )&rr,rrrrrrVrPr.r6rrrrrErrrrr getmembersrrpartsr extractallr9rrrjoinrrr5r7r/r=)rrryrrr?stagedrrr rmemberr staged_names unrestored cron_report summary_bits restored_n skipped_nr s rrollbackr<s Y ' 'F ~  &+4<'9''''" >R S    &G >>  \T6;TTTVZ[[ ]]F LLL---nnG MM$M... J 3fk33       JJJBqBBDIIIIIIIJ7GII77 7FC TE 2222 CCC;;;TBBBBBBBC&(EE&..**++ ( (Ez///EJ&D KE CII . . . LL% ' ' ' '  ( EEE  M& 5 5 5 5 5    D =!==tDDDDDDDE-O \'6 * * +b--//  {??3''44::3C+C+C!*DDDD,D + c&kk& 9999 + + + c&kk***** + + + + + + + + + + + + + + + + W% &OOO87777 &..**++  Ez///5:3M3M <<>>#%*:*:*<*<#M%((((LLNNN    e__  SASS99VJ//00SSJPSS          M& 5 5 5 5 5    D GAGGNNNNNNN;OB  fD11111      ,F33K;fk;;AP!ANP! N%"P!$N%%AP!&P&-PP! PP!P P!P&!P&*Q Q Qct}|sdSdddddddddd d g}|d t|d z|D]}||dd dd|dd pd dddd|dd ddt t |dd d d|S)NzNo curator snapshots yet.rwz<24z r&z<40rz>6sizez>8u─r?(r{rz )rrr7r5rr_r)rowslinesrs rsummarize_backupsr sH >>D +** F F FH F F FH F F F6 F F F GE LLU1X&'''    uuT# & A Ahs##*sCRC0 8 A Auu]A&& - A ACoq 9 9::;; @ A A    99U  r)rr)r rrr!)N)rCrDrrE)rr!)rr[)rr_)rhrrr_) r rr&rErqrrrr_rsrtrru)r)r&rErrrr)rar_rrrr)rrrr!)rr)rrrr)rrrr!)rrrr)rrrr)rrE)4__doc__ __future__rr1loggingrerrrrpathlibrtypingrrr r r r hermes_constantsragent.skill_utilsrhermes_cli.sizefmtr getLogger__name__r/rcrcompilerrrrr:rBrPrZr^rgrprrrrrrrrrr rrrr-s%%N#"""""  ''''''''8888888888888888,,,,,,444444++++++  8 $ $ )&1 F G G====((((4444 &0000f%%%%% . . . . 5555 ;?2JQUJJJJJJZ(((((^:1111,KKKK^6^3^3^3^3^3L      r