S3 CSV Foreign Data Wrapper for PostgreSQL

This data wrapper adds the ability to perform 'select *' queries on CSV files stored on the Amazon S3 file system. This is meant to replace s3_fdw which is not supported on PostgreSQL version 9.2+.

Install multicorn

First you need to install it (last command might need a sudo).

Then activate multicorn extension in your pg database

Create Foreign Data Wrapper

Just paste this code to create server

Create Foreign Table

Replace the example fields with your info...

Example:

Add user credentials

Store your aws credentials into a PostgreSQL user mapping.

Example:

Perform queries

You have a PostgreSQL table now, for now, only read queries are working.

Credits

Christian Toivola (dev360) wrote the code and submitted it as Multicorn request here (Segfault-Inc/Multicorn#49). I just packaged it up.