Experimental Swift SDK Implementation#28062

Closed

byronellis wants to merge 36 commits intoapache:masterfrom byronellis:swift-sdk

+35,280

Commits on Aug 10, 2023

Moving experimental Swift SDK code into Beam repo structure. Cleaning up and adding tests and Apache License labels where needed.
Byron Ellis
committed
Merge branch 'apache:master' into swift-sdk
byronellis
authored
Adding more of the Swift SDK implementation
Byron Ellis
committed

Commits on Aug 14, 2023

Refactor Unary and Tuple SerializableFn into a single ClosureFn since one is just a special case of the other. Add the wordcount integration test to verify the refactoring does indeed work and star…
Byron Ellis
committed
Merge remote-tracking branch 'origin/swift-sdk' into swift-sdk
Byron Ellis
committed
Merge branch 'apache:master' into swift-sdk
byronellis
authored

Commits on Aug 15, 2023

Moving some stuff around to make the proto construction code easier to read
Byron Ellis
committed
Add missing file
Byron Ellis
committed
Merge remote-tracking branch 'origin/swift-sdk' into swift-sdk
Byron Ellis
committed
Merge branch 'apache:master' into swift-sdk
byronellis
authored

Commits on Aug 17, 2023

Add the rest of the code. Basic word count integration test now completes successfully with the Python Portable Runner.
Byron Ellis
committed
Merge remote-tracking branch 'origin/swift-sdk' into swift-sdk
Byron Ellis
committed
Add licenses everywhere
Byron Ellis
committed
Add the generated proto files so other people don't have to do it along with the typealias data
Byron Ellis
committed
Use a single advance in varint implementation
Byron Ellis
committed
Small change to try to stop crashing on Linux
Byron Ellis
committed
Trying to stop advanced(by:) crashes on non-macOS platforms
Byron Ellis
committed
safeAdvance to try to address issues with zero-length data elements on non-mac platforms.
Byron Ellis
committed
Move typealiases for model protos to make it easier to find and less likely to be ignored by .gitignore
Byron Ellis
committed
Turns out String interpolation breaks the #file and #line macros. Try a new approach with optional "real" names to get more stable transform names. Start adding "ObjectFn" for more complicated DoFn…
Byron Ellis
committed
Second attempt and fixing the line values.
Byron Ellis
committed

Commits on Aug 18, 2023

Remove random output file
Byron Ellis
committed

Commits on Aug 21, 2023

Start stubbing out more of the composite transform implementation. Start stubbing out External Transforms and Schema support. Improve automatic naming of pardos and make explicit name implementatio…
Byron Ellis
committed

Commits on Aug 22, 2023

Added backwards links in PCollections to support Composite transforms. Added a very basic composite version of WordCount to the test suite. Still need to hook up the graph generation, which require…
Byron Ellis
committed

Commits on Aug 24, 2023

Added the primitives for a FileIO implementation with Google Storage support to start. Doesn't do anything fancy, but does implement a true version of wordcount with the classic Shakespeare input.
Byron Ellis
committed

Commits on Aug 25, 2023

Commits on Aug 28, 2023

Added support for bounded and unbounded PCollections. Fixes to bundle processing discovered during Prism Runner integration.
Byron Ellis
committed

Commits on Aug 29, 2023

Update .gitignore
lostluck
authored

Commits on Sep 1, 2023

Support for Schema and Row. Fixed up a couple of areas are endianess support so things should be more portable across chipsets now.
Byron Ellis
committed

Commits on Sep 5, 2023

More work on Schema support to allow for external transforms
Byron Ellis
committed
Merge remote-tracking branch 'origin/swift-sdk' into swift-sdk
Byron Ellis
committed

Commits on Sep 15, 2023

WIP Schemas
Byron Ellis
committed
Integrate and apply swiftformat to code and put license headers everywhere
Byron Ellis
committed

Commits on Sep 20, 2023

Some more WIP on composite transforms
Byron Ellis
committed

Commits on Sep 29, 2023

More WIP on Composite Transforms
Byron Ellis
committed