What is the parity between c#.net and python

[dbeavon]

I noticed that c#.net is able to piggyback on some of the underlying infrastructure that was built for the python language. To what extend does c# provide the same spark capabilities as python? Does it have 50% of the functionality that exists in python?

I have been searching for a way to execute operations on the data in my remote partitions but I cannot seem to find a technique for that yet. For example I'm missing some critical functionality that we use on dataframe in scala/python, like mappartitions and flatmapgroups. These don't appear to be available in .net for spark. Maybe I'm missing something.

I found the dataframe methods for GroupBy/Apply and these may allow me to accomplish some portion of the work but they aren't a perfect fit. Ideally there would be a way to send mapping operations out to the existing partitions, as they sit.