-
Notifications
You must be signed in to change notification settings - Fork 4.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Adding aws-s3 metric for delayed time #34306
Conversation
This pull request does not have a backport label.
To fixup this pull request, you need to add the backport labels for the needed
|
This pull request is now in conflicts. Could you fix it? 🙏
|
Co-authored-by: Andrew Kroh <[email protected]>
Pinging @elastic/security-external-integrations (Team:Security-External Integrations) |
What does this PR do?
Adding the metric to answer how delayed are the SQS messages being received
For messages that are being received the first time (ApproximateReceiveCount==0) what is the moving average delta between the message's SentTimestamp and now. This can indicate it the input is falling behind without needed to capture queue metrics.
Why is it important?
This will let us observe how much lag there is in receiving SQS events by measuring delta between the time the SQS message was written to the queue to the time Filebeat receives it.
Checklist
I have made corresponding change to the default configuration filesCHANGELOG.next.asciidoc
orCHANGELOG-developer.next.asciidoc
.Author's Checklist
How to test this PR locally
http://localhost:5066/dataset?pretty
now includes the followingRelated issues
Relates https://github.com/elastic/security-team/issues/5526