Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Re-enable tests that were disabled due to flakes #106

Open
ash211 opened this issue Feb 17, 2017 · 0 comments
Open

Re-enable tests that were disabled due to flakes #106

ash211 opened this issue Feb 17, 2017 · 0 comments

Comments

@ash211
Copy link

ash211 commented Feb 17, 2017 •
edited
Loading

See https://github.com/palantir/spark/pull/100/files for the tests that were disabled.

  • all Python tests
  • all R tests
  • 1 network timeout test
  • 2 flume tests
  • 17 mllib tests
  • ~30 hive window query tests
  • 2 hive spark submit tests
  • 1 date cast test (!)
  • 1 parquet datasource summary file test (!) -- correctly enable metadata writing #101
robert3005 pushed a commit that referenced this issue Mar 7, 2017
@foxish @ash211
Filter nodes to only try and send files to external IPs (#106)
94c1a11 
* Filter node addresses

* Added comment
mccheah pushed a commit that referenced this issue Apr 27, 2017
@foxish @ash211
Filter nodes to only try and send files to external IPs (#106)
a34a114 
* Filter node addresses

* Added comment
mccheah pushed a commit that referenced this issue May 1, 2018
@liutang123 @cloud-fan
[SPARK-24012][SQL] Union of map and other compatible column
64e8408 
## What changes were proposed in this pull request?
Union of map and other compatible column result in unresolved operator 'Union; exception

Reproduction
`spark-sql>select map(1,2), 'str' union all select map(1,2,3,null), 1`
Output:
```
Error in query: unresolved operator 'Union;;
'Union
:- Project [map(1, 2) AS map(1, 2)#106, str AS str#107]
:  +- OneRowRelation$
+- Project [map(1, cast(2 as int), 3, cast(null as int)) AS map(1, CAST(2 AS INT), 3, CAST(NULL AS INT))#109, 1 AS 1#108]
   +- OneRowRelation$
```
So, we should cast part of columns to be compatible when appropriate.

## How was this patch tested?
Added a test (query union of map and other columns) to SQLQueryTestSuite's union.sql.

Author: liutang123 <[email protected]>

Closes apache#21100 from liutang123/SPARK-24012.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@ash211