Skip to content

Improve filesystem repo caching - #1101

Open
isc-dchui wants to merge 8 commits into
mainfrom
fix-536
Open

Improve filesystem repo caching#1101
isc-dchui wants to merge 8 commits into
mainfrom
fix-536

Conversation

@isc-dchui

Copy link
Copy Markdown
Collaborator

Fixes #536

Improves the filesystem repo caching by proactively rebuilding cache and improving cache building performance by about an order of magnitude. Specifically:

  • Lazy load the actual manifest of the module by deferring until install.
  • Use mtime of the module.xml as a proxy for whether a module has been modified and perform smarter cache building based on that.
  • Drastically speed up filesystem scanning using Python.
  • Installing from a filesystem repo will trigger a quick cache rebuild to pick up any additions, modifications, and deletions.
  • Add -rebuild-cache flag to repo command to manually fully rebuild (with purge) cache.

@isc-jili isc-jili left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@isc-dchui This looks really good! I made a pass and few small comments

Comment thread src/cls/IPM/Repo/Filesystem/Cache.cls Outdated
Comment thread src/cls/IPM/Repo/Filesystem/Cache.cls Outdated
Comment thread src/cls/IPM/Main.cls Outdated
@isc-dchui
isc-dchui requested a review from isc-jili March 16, 2026 14:00
@isc-dchui isc-dchui added this to the v0.10.x milestone Apr 22, 2026
@isc-dchui isc-dchui modified the milestones: v0.10.9, v0.10.10 Aug 3, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Package Manager needs updated cache of repos before installation

2 participants