Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Docs] RayDP Documentation #14018

Merged
merged 8 commits into from
Feb 10, 2021
Merged

[Docs] RayDP Documentation #14018

merged 8 commits into from
Feb 10, 2021

Conversation

wuisawesome
Copy link
Contributor

Why are these changes needed?

This PR introduces some example documentation for how to use RayDP and points to the RayDP docs page.

Here's an image of what the documentation looks like.

image

Related issue number

Checks

  • I've run scripts/format.sh to lint the changes in this PR.
  • I've included any doc changes needed for https://docs.ray.io/en/master/.
  • I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/
  • Testing Strategy
    • Unit tests
    • Release tests
    • This PR is not tested :(

@rkooo567
Copy link
Contributor

cc @ carsonwang

Can you review it?

Installing RayDP
=======================

RayDP can be installed from PyPI and supports PySpark 3.0 and 3.1.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Mention ray >= 1.2.0


==========
Conclusion
==========
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Remove conclusion

Conclusion
==========

RayDP combines your Spark and Ray clusters, making it easy to do large scale
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's push to intro.

@@ -0,0 +1,112 @@
*********************
RayDP (Spark on Ray)
*********************
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Make sure the legnth of line and characters are the same

@rkooo567
Copy link
Contributor

cc @carsonwang

@rkooo567
Copy link
Contributor

I will merge the PR first, but please let us know if you'd like to add more contents here. (and feel free to create correction PR)!

@rkooo567 rkooo567 merged commit ce80ef5 into ray-project:master Feb 10, 2021
wuisawesome pushed a commit that referenced this pull request Feb 11, 2021
* .

* done?

* Docs

* Docs

* Update raydp.rst

* Update raydp.rst

Co-authored-by: Alex Wu <[email protected]>
@carsonwang
Copy link

Thanks for adding this! Sorry for delayed response due to Chinese new year vacation.

fishbone pushed a commit to fishbone/ray that referenced this pull request Feb 16, 2021
* .

* done?

* Docs

* Docs

* Update raydp.rst

* Update raydp.rst

Co-authored-by: Alex Wu <[email protected]>
fishbone added a commit to fishbone/ray that referenced this pull request Feb 16, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants