Uploaded image for project: 'CernVM'
  1. CernVM
  2. CVM-1030

Reduce CernVM-FS Propagation Delay

    XMLWordPrintable

Details

    • Epic
    • Status: Open
    • Medium
    • Resolution: Unresolved
    • None
    • None
    • CVMFS
    • Reduce Propagation Delay
    • x86_64-slc6-gcc48-opt

    Description

      New file system snapshots should be visible on the clients faster than currently. We aim for a ~5 mn delay from the point when the publishing finishes. Several points along the distribution chain should be tackled

      • Speedup of the publishing process itself. This is largely completed by RenĂ©'s recent work.
      • Notification service to start replication as part of the publish process (CVM-717).
      • Caching and reuse of "object packs" developed as part of the distributed backend. This will drastically reduce the replication of small files.
      • Stream change sets concurrently to authoritative storage and stratum 1s.
      • Reduction (including validation) of the .cvmfspublished TTL. It can probably be reduced to values as low as 30 seconds.
      • An interface to change the catalog default TTL. Possibly adjusting the default TTL from 15 minutes to 5 minutes.
      • Investigate if the fuse-maintained kernel cache on clients can be actively purged to avoid the 1 minute delay to drain the caches.

      Attachments

        Issue Links

          Activity

            People

              jblomer Jakob Blomer
              jblomer Jakob Blomer
              Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: