Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix error #60

Open
ngulamai opened this issue Nov 22, 2018 · 4 comments
Open

fix error #60

ngulamai opened this issue Nov 22, 2018 · 4 comments

Comments

@ngulamai
Copy link
Contributor

can you please these error?
screenshot 2018-11-22 at 20 57 50
@dchubiryaev
Copy link
Contributor

Thanks, I fixed this. Will you plan increase the amount of data? And how many times?

@ngulamai
Copy link
Contributor Author

What is the problem and how is that you fix it?
It is related to Google cloud resources allocated to the project?
Please let us know

@dchubiryaev
Copy link
Contributor

The problem was the amount of memory for the pipeline. When a lot of data comes they overflow memory. I increased the memory in 2 times. In the next days I will do optimization on the side of the code. This will reduce the load on the system, but in any case we will need to look the required number of dataflow resources for the amount of incoming data.

@ngulamai
Copy link
Contributor Author

Besides the code automatization, Is there any way that this can be automatically handled?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@dchubiryaev @ngulamai @SNikitinI