Add infix operators for relational algebra #8036

jiahao · 2014-08-17T18:24:28Z

This PR includes yet moar Unicode; this time, primarily to support relational algebra.

Allows all Unicode characters in the geometric shapes block as valid characters.
Defines joins (⨝ ⟕ ⟖ ⟗) and antijoin (▷) as valid infix operators. (Note that ▷ is semantically a shape, but I couldn't find a separate antijoin character.)

johnmyleswhite · 2014-08-17T18:27:05Z

I admire your steadfast commitment to exploring the final frontiers of Unicode, @jiahao.

jiahao · 2014-08-17T18:32:38Z

These are the voyages of the flagship Julia. Its five-year mission: to explore strange new symbols, to seek out new codepoints and new characters, to boldly go where no language has gone before.

StefanKarpinski · 2014-08-17T22:51:46Z

I'm loling on a bus over this exchange. I do like all these Unicode symbols.

elextr · 2014-08-18T00:12:37Z

The Julia language boldly exploring new frontiers of untypeability ;)

StefanKarpinski · 2014-08-18T00:13:38Z

Except that we've simultaneously expanded the frontiers of typeability.

jiahao · 2014-08-18T01:28:39Z

That's actually a good point. How do people feel about \join, \leftjoin, \rightjoin, \leftrightjoin and \whitetriangleright as LaTeX-like tab-completion sequences?

(Note that \bowtie tab-completes to ⋈, the bowtie character (U+22C8); not to be confused with the aforementioned join operator (U+2A1D), ⨝. The former is still left as an invalid identifier character in Julia. It's amusing that it is possible to tab-complete an invalid character... @stevengj)

stevengj · 2014-08-18T13:42:19Z

Shouldn't join have the same precedence as union, i.e. have + precedence?

The standard LaTeX name seems to be \Join, but probably it is just uppercase because \join is used for something else in TeX? I'd rather have \antijoin than \whitetriangleright if we are going to use \join.

Since the tab completion is mostly autogenerated from unicode.xml, it's inevitable that it won't overlap exactly with the set of allowed identifier chars; I don't see this as a problem.

stevengj · 2014-08-18T20:33:34Z

Aren't the unimath names for these symbols \Join, \leftouterjoin, \rightouterjoin, \fullouterjoin, \triangleleft, \triangleright, etcetera? I'd prefer to stick with these names rather than choosing our own.

In general, we might think about importing unicode-math-table.tex. See #8044.

StefanKarpinski · 2014-08-18T22:12:27Z

+1 for using unimath names. Except why is \Join the only one capitalized?

jiahao · 2014-08-21T02:18:33Z

I wasn't aware of unimath; that makes things easy.

I've updated this PR with a better choice of precedence class (multiplication; table joins are essentially equivalent to matrix products)

stevengj · 2014-08-21T12:03:16Z

Can you also update the LaTeX table by re-running the unimath script in base/latex_symbols.jl?

stevengj · 2014-08-21T16:49:40Z

src/flisp/julia_extensions.c

@@ -72,6 +71,7 @@ static int is_wc_cat_id_start(uint32_t wc, utf8proc_propval_t cat)
                (wc >= 0x2a00 && wc <= 0x2a06) ||  // ⨀, ⨁, ⨂, ⨃, ⨄, ⨅, ⨆
                (wc >= 0x2a09 && wc <= 0x2a16) ||  // ⨉, ⨊, ⨋, ⨌, ⨍, ⨎, ⨏, ⨐, ⨑, ⨒, ⨓, ⨔, ⨕, ⨖
                wc == 0x2a1b || wc == 0x2a1c)))) || // ⨛, ⨜
+		wc == 0x2a1d || (wc >= 0x27d5 && wc <= 0x27d7) || //joins: ⨝ ⟕ ⟖ ⟗


If joins are infix operators, then they don't also need to go in is_cat_id_start. Normally we put them in one place or the other.

Bump @jiahao.

Will remove this change.

bump. spaces, not tabs too

jiahao · 2014-09-21T23:46:56Z

Rebased and updated with all comments.

I combined and partially rewrote the scripts in the comment block of latex_symbols.jl so that only a single script needed to be run.

nolta · 2014-09-22T02:36:32Z

Is the travis failure related?

stevengj · 2014-09-22T12:28:12Z

Are some symbols gone? e.g. I can't find \alpha in this list; I think it got replaced with \upalpha, which seems non-ideal.

JeffBezanson · 2015-04-21T21:39:19Z

Bump. I think we need \alpha!!

jiahao · 2015-10-20T19:16:05Z

Rebased and updated.

stevengj · 2015-10-20T19:22:01Z

src/flisp/julia_extensions.c

@@ -99,6 +99,9 @@ static int is_wc_cat_id_start(uint32_t wc, utf8proc_propval_t cat)
            (wc >= 0x2220 && wc <= 0x2222) || // ∠, ∡, ∢
            (wc >= 0x299b && wc <= 0x29af) || // ⦛, ⦜, ⦝, ⦞, ⦟, ⦠, ⦡, ⦢, ⦣, ⦤, ⦥, ⦦, ⦧, ⦨, ⦩, ⦪, ⦫, ⦬, ⦭, ⦮, ⦯

+	    // geometric shapes
+	    (wc >= 0x25a0 && wc <= 0x25ff) ||
+


Aren't many of these already covered by the cat == UTF8PROC_CATEGORY_SO check? It seems like the only ones in category Sm (which have to be special-cased) are U+25F8 to U+25FF.

(It's useful to do the minimal amount of special-casing here for people in other contexts trying to write Julia lexers with regexes etc., e.g. for syntax highlighting in editors.)

Yes, you are right. I just tried some simple function definitions without this commit and it works. I'll take it out.

Ah yes, you don't need it at all, because there is already wc >= 0x25F8 && wc <= 0x25ff above in addition to UTF8PROC_CATEGORY_SO.

stevengj · 2015-10-20T20:33:20Z

base/latex_symbols.jl

+    "\\rightouterjoin" => "⟖",  # right outer join
+    "\\fullouterjoin" => "⟗",  # full outer join
+    "\\Join" => "⨝",  # join
+    "\\mathunderbar" => "̲",  # combining low line


Maybe just \underbar? math is kind of redundant here.

math is kind of redundant here.

True; that was the name in unicode-math-table.tex. I can change it manually.

jiahao · 2015-10-21T20:24:58Z

I've modified the latex symbol parsing script to strip math- out of character names in unicode-math-table.tex.

Note: ▷ is semantically a geometric shape, but I could not find a separate character for antijoin

stevengj · 2015-10-21T21:09:32Z

LGTM once commits are squashed and tests are green.

- Minor clean up of latex_symbols generator script - Update list of latex symbols

Add infix operators for relational algebra

AzamatB · 2016-01-15T08:56:23Z

A bit confused, does it mean that these symbols are now defined as relational algebra operators and can be used to perform joins in Julia (since relational algebra was brought up), or we are only talking about including these symbols into set of valid Julia characters?

tkelman · 2016-01-15T09:13:24Z

These are recognized by the parser as valid infix operators, but no default implementation of them is given in base. Packages and user code are free to do so. (Though some coordination is called for if packages are defining methods for them on Base types.)

jiahao added unicode and removed unicode labels Aug 17, 2014

stevengj mentioned this pull request Aug 18, 2014

add 1607 new LaTeX tab completions from the unicode-math package #8044

Merged

jiahao force-pushed the cjh/relational-algebra branch from 298cf34 to 14c55d7 Compare August 21, 2014 02:17

stevengj reviewed Aug 21, 2014
View reviewed changes

jiahao force-pushed the cjh/relational-algebra branch from 14c55d7 to 3f35762 Compare September 21, 2014 23:43

jiahao force-pushed the master branch 3 times, most recently from 6c7c7e3 to 1a4c02f Compare October 11, 2014 22:06

jiahao force-pushed the master branch from cdde4df to 7fdc860 Compare October 28, 2014 04:20

MikeInnes force-pushed the master branch from 5c60996 to b1c3df3 Compare November 14, 2014 17:07

jiahao force-pushed the cjh/relational-algebra branch from 3f35762 to f1e884d Compare October 20, 2015 19:05

stevengj reviewed Oct 20, 2015
View reviewed changes

jiahao force-pushed the cjh/relational-algebra branch from f1e884d to f326c25 Compare October 20, 2015 20:10

stevengj reviewed Oct 20, 2015
View reviewed changes

jiahao force-pushed the cjh/relational-algebra branch from 2d09759 to ead4141 Compare October 21, 2015 18:07

jiahao force-pushed the cjh/relational-algebra branch from ead4141 to ec96896 Compare October 21, 2015 20:55

Defines joins (⨝ ⟕ ⟖ ⟗) and antijoin (▷) as valid infix operators

0dd5b9c

Note: ▷ is semantically a geometric shape, but I could not find a separate character for antijoin

Update latex_symbols

6341f7d

- Minor clean up of latex_symbols generator script - Update list of latex symbols

jiahao force-pushed the cjh/relational-algebra branch from ec96896 to 93668d1 Compare October 21, 2015 21:11

Update NEWS

93668d1

jiahao added a commit that referenced this pull request Oct 22, 2015

Merge pull request #8036 from JuliaLang/cjh/relational-algebra

e372b06

Add infix operators for relational algebra

jiahao merged commit e372b06 into master Oct 22, 2015

jiahao deleted the cjh/relational-algebra branch October 22, 2015 02:57

JeffBezanson mentioned this pull request Jul 28, 2016

Add relational algebra unicode characters #17677

Closed

stevengj mentioned this pull request Sep 22, 2017

Bowtie symbol isn't a valid character. #23820

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add infix operators for relational algebra #8036

Add infix operators for relational algebra #8036

jiahao commented Aug 17, 2014

johnmyleswhite commented Aug 17, 2014

jiahao commented Aug 17, 2014

StefanKarpinski commented Aug 17, 2014

elextr commented Aug 18, 2014

StefanKarpinski commented Aug 18, 2014

jiahao commented Aug 18, 2014

stevengj commented Aug 18, 2014

stevengj commented Aug 18, 2014

StefanKarpinski commented Aug 18, 2014

jiahao commented Aug 21, 2014

stevengj commented Aug 21, 2014

stevengj Aug 21, 2014

stevengj Oct 20, 2015

jiahao Oct 20, 2015

tkelman Oct 21, 2015

jiahao commented Sep 21, 2014

nolta commented Sep 22, 2014

stevengj commented Sep 22, 2014

JeffBezanson commented Apr 21, 2015

jiahao commented Oct 20, 2015

stevengj Oct 20, 2015

stevengj Oct 20, 2015

jiahao Oct 20, 2015

stevengj Oct 20, 2015

stevengj Oct 20, 2015

jiahao Oct 20, 2015

jiahao commented Oct 21, 2015

stevengj commented Oct 21, 2015

AzamatB commented Jan 15, 2016

tkelman commented Jan 15, 2016

Add infix operators for relational algebra #8036

Add infix operators for relational algebra #8036

Conversation

jiahao commented Aug 17, 2014

johnmyleswhite commented Aug 17, 2014

jiahao commented Aug 17, 2014

StefanKarpinski commented Aug 17, 2014

elextr commented Aug 18, 2014

StefanKarpinski commented Aug 18, 2014

jiahao commented Aug 18, 2014

stevengj commented Aug 18, 2014

stevengj commented Aug 18, 2014

StefanKarpinski commented Aug 18, 2014

jiahao commented Aug 21, 2014

stevengj commented Aug 21, 2014

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

jiahao commented Sep 21, 2014

nolta commented Sep 22, 2014

stevengj commented Sep 22, 2014

JeffBezanson commented Apr 21, 2015

jiahao commented Oct 20, 2015

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

jiahao commented Oct 21, 2015

stevengj commented Oct 21, 2015

AzamatB commented Jan 15, 2016

tkelman commented Jan 15, 2016