Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DOC/CI: Failing documentation build on warnings #26852

Merged
merged 8 commits into from
Jun 17, 2019
Merged

DOC/CI: Failing documentation build on warnings #26852

merged 8 commits into from
Jun 17, 2019

Conversation

datapythonista
Copy link
Member

@datapythonista datapythonista added Docs CI Continuous Integration labels Jun 14, 2019
@codecov
Copy link

codecov bot commented Jun 14, 2019

Codecov Report

Merging #26852 into master will decrease coverage by <.01%.
The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff             @@
##           master   #26852      +/-   ##
==========================================
- Coverage   91.88%   91.87%   -0.01%     
==========================================
  Files         179      179              
  Lines       50696    50696              
==========================================
- Hits        46581    46576       -5     
- Misses       4115     4120       +5
Flag Coverage Δ
#multiple 90.46% <ø> (ø) ⬆️
#single 41.09% <ø> (-0.08%) ⬇️
Impacted Files Coverage Δ
pandas/io/gbq.py 88.88% <0%> (-11.12%) ⬇️
pandas/core/frame.py 96.88% <0%> (-0.12%) ⬇️
pandas/util/testing.py 90.84% <0%> (-0.11%) ⬇️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 430f0fd...f1fb939. Read the comment docs.

@codecov
Copy link

codecov bot commented Jun 14, 2019

Codecov Report

Merging #26852 into master will decrease coverage by <.01%.
The diff coverage is 100%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master   #26852      +/-   ##
==========================================
- Coverage   91.87%   91.86%   -0.01%     
==========================================
  Files         180      180              
  Lines       50710    50712       +2     
==========================================
- Hits        46588    46585       -3     
- Misses       4122     4127       +5
Flag Coverage Δ
#multiple 90.45% <100%> (ø) ⬆️
#single 41.1% <75%> (-0.08%) ⬇️
Impacted Files Coverage Δ
pandas/core/dtypes/base.py 100% <100%> (ø) ⬆️
pandas/core/indexes/base.py 96.71% <100%> (ø) ⬆️
pandas/io/gbq.py 88.88% <0%> (-11.12%) ⬇️
pandas/core/frame.py 96.88% <0%> (-0.12%) ⬇️
pandas/util/testing.py 90.84% <0%> (-0.11%) ⬇️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update adc6564...708dbb7. Read the comment docs.

@jorisvandenbossche
Copy link
Member

It's failing! So it is working :)

@datapythonista
Copy link
Member Author

Yes, first test passed. Also, it's failing with return code 2, both sphinx and the ipython hack are failing (I test that well locally anyway, but good to see the CI red) :)

pushing some fixes soon, will get the remaining warnings fixed here, so when this is green, we're done :)

@property
def asi8(self):
"""
Integer representation of the values.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Only for the datetime-like indexes (we should probably rather remove it, but that's another issue)

@datapythonista
Copy link
Member Author

Not sure about the clipboard problem, it's not immediate to fix.

I'd merge this PR with the fix proposed in #26700. Or if anyone else wants to give a try to set up xsel...

CC: @jreback @jorisvandenbossche

@jorisvandenbossche
Copy link
Member

I am fine with that. We know now that clipboard doesn't work on Azure and so no clipboard tests are running there, so we can open an issue about that instead of keeping a failing example in the docs.

@datapythonista
Copy link
Member Author

@jreback are you ok with fixing the clipboard problem in the docs by not running the code for now? i.e. adding the changes in #26700 to this PR?

This way we can start validating for warnings in the doc, before new are introduced.

@jreback
Copy link
Contributor

jreback commented Jun 16, 2019

i think we should get them running first

@datapythonista
Copy link
Member Author

I created #26852/ for the issue.

Will close this then, but I don't think we're being smart here. By the time the issue is fixed we'll probably have introduced several new warnings as it happened last time we spent several days addressing them. Quite demotivating besides the extra work...

@jreback
Copy link
Contributor

jreback commented Jun 16, 2019

broken tests are much worse
we claim to do something but the the tests are not even being run properly

@jorisvandenbossche
Copy link
Member

The tests not being run are not related to the documentation build. It's thanks to the docs that we now know they are not run. But now we know it, an open issue is just as good a reminder to fix it as a failing example in the docs.

Marc and I put a lot of effort in getting to this point of a warning-free doc build. The clipboard example is only one left. I think it is important to finally actually check the doc build in CI to prevent we constantly introduce new warnings.

@datapythonista
Copy link
Member Author

I think we all agree that we need to fix the tests. But the tests will remain skipped whether we validate the warnings in the docs or not. I don't see the gain in blocking here. But anyway, it's just some doc warnings, not a big deal anyway.

@jorisvandenbossche
Copy link
Member

Marc, don't dismiss your own work, a correct sphinx build is relevant.

@jreback
Copy link
Contributor

jreback commented Jun 16, 2019

@datapythonista i am actually ok merging this
but the next thing that needs to be fixed are these tests
they keep getting deferred

having a healthy CI is he most important thing

@datapythonista
Copy link
Member Author

Thanks Jeff. Agree with prioritizing the CI, will do more tests in a separate PR, but I already spent few hours with the clipboard, and it's not trivial. It'll probably take a while, no idea what's the problem. That's why I think doesn't make sense to block this which is unrelated and I'd say urgent (really don't want to start getting new warnings added again after all the work).

This is passing the CI now, validating that no sphinx or ipython directive warnings are raised during the doc build.

@datapythonista
Copy link
Member Author

@pandas-dev/pandas-core be aware that once this is merged, warnings in the documentation will leave the CI red.

@TomAugspurger
Copy link
Contributor

TomAugspurger commented Jun 16, 2019 via email

@jorisvandenbossche jorisvandenbossche changed the title WIP/DOC/CI: Failing documentation build on warnings DOC/CI: Failing documentation build on warnings Jun 17, 2019

df = pd.DataFrame(np.random.randn(5, 3))
df
df.to_clipboard()
pd.read_clipboard()
>>> df = pd.DataFrame({'A': [1, 2, 3],
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The lines above needed to be removed I think?

@jorisvandenbossche
Copy link
Member

Let's give this a go!

@jorisvandenbossche jorisvandenbossche merged commit a890caf into pandas-dev:master Jun 17, 2019
@jorisvandenbossche
Copy link
Member

@pandas-dev/pandas-core be aware that once this is merged, warnings in the documentation will leave the CI red.

It might also be advisable to be extra careful to merge master in PRs before merging the coming days, certainly for PRs that touch the documentation.

@datapythonista
Copy link
Member Author

Thanks for the fixup Joris. This failed in master, looks like the scipy documentation is down (we fetch https://docs.scipy.org/doc/numpy/objects.inv for the cross references).

@rgommers not sure if you're aware?

@jorisvandenbossche
Copy link
Member

looks like the scipy documentation is down

Yes, noticing this locally as well.

@rgommers
Copy link
Contributor

Thanks for the ping. No I didn't notice that yet. Will follow up on that now.

@datapythonista
Copy link
Member Author

scipy docs are now working, and the doc build is green again.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CI Continuous Integration Docs
Projects
None yet
Development

Successfully merging this pull request may close these issues.

DOC: Make errors and warnings of the doc build more visible
5 participants