Skip to content

Add custom retention procedure - #45

Open
s0me0ne-unkn0wn wants to merge 1 commit into
mainfrom
s0me0ne/overload-fix
Open

Add custom retention procedure#45
s0me0ne-unkn0wn wants to merge 1 commit into
mainfrom
s0me0ne/overload-fix

Conversation

@s0me0ne-unkn0wn

Copy link
Copy Markdown
Contributor

Partially fixes #29.

Add a custom retention procedure devoid of drawbacks of the stock one:

  • It doesn't rollback the entire retention job if the time budget expires, and commits chunk-by-chunk;
  • It accounts for its own time budget, not relying on the scheduler to kill the worker, and thus avoids triggering, during normal function, the backoff logic that indeed makes things worse;

The migration also removes the compression policy we don't use, which contributed to the DB stall during the event storm.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Database overload after event storm does not self-heal

1 participant