Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow to set timeout for finishing a remote bundle in Samza portable runner #25031

Merged
merged 5 commits into from
Jan 20, 2023

Conversation

alnzng
Copy link
Contributor

@alnzng alnzng commented Jan 17, 2023

addresses #25030

We have observed that some UDFs(with bugs or imported some bad third-party libs) could hang the runner and SDK harness processes in Samza portable mode. Both runner and SDK harness processes are in a zombie state and have no data processing in this case, however, the processes are not able to be shut down although Samza runner provides some built-in timeout functionality.

This change will allow the users to set a timeout for closing a remote bundle in Samza portable runner. Once the timeout occurred, the runner and SDK processes will be shut down properly by Samza's built-in task timeout functionality if enabled.


Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

  • Mention the appropriate issue in your description (for example: addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment fixes #<ISSUE NUMBER> instead.
  • Update CHANGES.md with noteworthy changes.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md

GitHub Actions Tests Status (on master branch)

Build python source distribution and wheels
Python tests
Java tests
Go tests

See CI.md for more information about GitHub Actions CI.

@alnzng
Copy link
Contributor Author

alnzng commented Jan 17, 2023

@xinyuiscool please help take a look, thanks.

Copy link
Contributor

@mynameborat mynameborat left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we add unit tests?

@alnzng
Copy link
Contributor Author

alnzng commented Jan 17, 2023

Can we add unit tests?

I didn't do that because there is no test cases created for this SamzaDoFnRunners. But I can do it for this newly added method only.

@alnzng
Copy link
Contributor Author

alnzng commented Jan 17, 2023

@mynameborat Thanks for helping review. I addressed your comments, let me know if you have other questions.

@alnzng alnzng force-pushed the remote-bundle-processing-timeout branch from 7023b18 to d59a775 Compare January 18, 2023 06:54
@alnzng alnzng force-pushed the remote-bundle-processing-timeout branch from d59a775 to b058574 Compare January 19, 2023 23:25
Copy link
Contributor

@xinyuiscool xinyuiscool left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@alnzng alnzng force-pushed the remote-bundle-processing-timeout branch from b058574 to a677df5 Compare January 20, 2023 01:49
@alnzng alnzng force-pushed the remote-bundle-processing-timeout branch from a677df5 to db7073d Compare January 20, 2023 05:01
@xinyuiscool xinyuiscool merged commit 5e1ebee into apache:master Jan 20, 2023
@alnzng alnzng deleted the remote-bundle-processing-timeout branch January 20, 2023 18:24
alnzng added a commit to alnzng/beam that referenced this pull request Jan 20, 2023
xinyuiscool pushed a commit to linkedin/beam that referenced this pull request Jan 21, 2023
alnzng added a commit to alnzng/beam that referenced this pull request Jan 25, 2023
xinyuiscool pushed a commit to linkedin/beam that referenced this pull request Jan 25, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants