Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Implement snapshot compaction #12

Open
Tracked by #1
shreyas-s-rao opened this issue Nov 6, 2023 · 0 comments
Open
Tracked by #1

[Feature] Implement snapshot compaction #12

shreyas-s-rao opened this issue Nov 6, 2023 · 0 comments
Labels
kind/enhancement Enhancement, improvement, extension lifecycle/stale Nobody worked on this for 6 months (will further age)

Comments

@shreyas-s-rao
Copy link
Collaborator

How to categorize this issue?

/kind enhancement

What would you like to be added:
Steward should provide the ability to compact a set of snapshots, comprising of one full snapshot and multiple delta snapshot, into one single full snapshot, so that it allows for faster restoration upon any DB corruptions. It is achieved by first restoring a snapshot set to a local embedded etcd, then performing an etcd compaction to remove old revisions, then defragmenting the etcd DB to minimize the size of the etcd (and the size of the snapshot to be uploaded), and then upload a full snapshot of this etcd to the same object storage container. Compaction can be run as a separate sub-command, so that it does not affect the regular functioning of steward backing the main etcd.

While the functionality of compaction remains similar to snapshot compaction provided by etcd-backup-restore, steward should re-use code from other packages to the maximum extent possible, in order to keep the compactor code as lean as possible.

Why is this needed:
Part of #1

@shreyas-s-rao shreyas-s-rao added the kind/enhancement Enhancement, improvement, extension label Nov 6, 2023
@gardener-robot gardener-robot added the lifecycle/stale Nobody worked on this for 6 months (will further age) label Jul 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/enhancement Enhancement, improvement, extension lifecycle/stale Nobody worked on this for 6 months (will further age)
Projects
None yet
Development

No branches or pull requests

2 participants