Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

move aggregate_statistics, enforce_sorting, limited_distinct_aggregtion and replace_with_order_preserving_variants to datafusion-physical-optimizer crate #11793

Conversation

Weijun-H
Copy link
Member

@Weijun-H Weijun-H commented Aug 3, 2024

Which issue does this PR close?

Parts #11502

Rationale for this change

What changes are included in this PR?

move the following functions to datafusion-physical-optimizer crate

  • aggregate_statistics
  • enforce_sorting
  • sort_pushdown
  • limited_distinct_aggregtion
  • replace_with_order_preserving_variants

Additionally, leave the tests in the core module because they have too many dependencies with the core. They were all renamed with '_test'.

Are these changes tested?

Are there any user-facing changes?

@github-actions github-actions bot added the core Core DataFusion crate label Aug 3, 2024
@alamb
Copy link
Contributor

alamb commented Aug 3, 2024

Thank you @Weijun-H 🙏 I have been thinking it was time to try and help move the physical optimizer porting project along -- #11502

I was getting myself psyched up to write a bunch of 🎫 s. 😆

…ion and replace_with_order_preserving_variants to datafusion-physical-optimizer crate
@Weijun-H Weijun-H force-pushed the move-to-datafusion-physical-optimizer-crate branch from 70a2c1b to 5b5c8d8 Compare August 3, 2024 12:34
@Weijun-H
Copy link
Member Author

Weijun-H commented Aug 3, 2024

it would be better to split this pr into small pieces since it is too large

@Weijun-H Weijun-H closed this Aug 4, 2024
@alamb
Copy link
Contributor

alamb commented Aug 5, 2024

Thank you @Weijun-H

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
core Core DataFusion crate
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants