-
Notifications
You must be signed in to change notification settings - Fork 0
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[BEAM-4294] Join operator translator #2
Conversation
…pplication of windowing in JoinTranslator fixed.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
the beginning of processElement
for specific Joins is the same. I could be moved to JoinFn
which is their parent
c.output(Pair.of(key, outCollector.get())); | ||
} | ||
} | ||
} else if (leftHasValues && !rightHasValues) { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
!rightHasValues
is always true, you can delete it
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Fixed in seznam@013b078 This pull request will be closed.
joiner.apply(leftValue, null, outCollector); | ||
c.output(Pair.of(key, outCollector.get())); | ||
} | ||
} else if (!leftHasValues && rightHasValues) { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
!leftHasValues is always true, you can delete it
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Fixed in seznam@013b078 This pull request will be closed.
K key = element.getKey(); | ||
|
||
Iterable<LeftT> leftSideIter = value.getAll(leftTag); | ||
Iterable<RightT> rightSIdeIter = value.getAll(rightTag); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
variable typo. lowercase i
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Fixed in seznam@013b078 This pull request will be closed.
This pull request is replaced by #seznam#1 |
Translation of Euphoria Join suite operators (Inner, Left, Right, Full) into beam transformations. Implementation is centered around
JoinTranslator
which defines all the translation steps. And implementations ofJoinFn
which do the actual join on co-gruped elements, inspiration was drawn fromorg.apache.beam.sdk.extensions.joinlibrary.Join
.Follow this checklist to help us incorporate your contribution quickly and easily:
[BEAM-XXX] Fixes bug in ApproximateQuantiles
, where you replaceBEAM-XXX
with the appropriate JIRA issue../gradlew build
to make sure basic checks pass. A more thorough check will be performed on your pull request automatically.