Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Join operator API improvements. #206

Merged
merged 5 commits into from
Dec 5, 2017
Merged

Join operator API improvements. #206

merged 5 commits into from
Dec 5, 2017

Conversation

dmvk
Copy link
Contributor

@dmvk dmvk commented Dec 1, 2017

No description provided.

@dmvk dmvk requested a review from je-ik December 1, 2017 22:09
@dmvk dmvk force-pushed the join_api branch 2 times, most recently from 617b289 to d9aa9ee Compare December 2, 2017 15:33
@dmvk
Copy link
Contributor Author

dmvk commented Dec 2, 2017

Related to #143

Copy link
Contributor

@je-ik je-ik left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This seems very nice, I have some minor concerns about the InnerJoin, that is not name that would be generally used, generally just Join implies InnerJoin, I'd suggest we stick to that. I also don't see much added value in RightJoin (although it might make sense when it comes to optimizations like broadcast joins, but we could solve this on the hint instead).

import java.util.Objects;

@Audience(Audience.Type.CLIENT)
public class InnerJoin {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This operator should remain just Join.

import java.util.Optional;

@Audience(Audience.Type.CLIENT)
public class RightJoin {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How is this implementation different from LeftJoin? Isn't this just quite expensive syntactic sugar around the same implementation with swapped arguments?

});
}

@Processing(Processing.Type.BOUNDED)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why do we run these tests only for bounded datasets?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK, I see, the reason is probably that unbounded dataset cannot be join using global windowing. There are separate tests for windowing.

Copy link
Contributor

@je-ik je-ik left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@dmvk dmvk merged commit 5a18aa1 into master Dec 5, 2017
@je-ik je-ik deleted the join_api branch December 19, 2017 10:40
mareksimunek pushed a commit that referenced this pull request May 4, 2018
Join operator API improvements.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants