How do I use @node-rs with esbuild, and how do I deploy it on a different architecture than my dev machine?

[JL102]

Hi,

I'm writing a Sveltekit app and using lucia for user authentication, which depends on oslo, which in turn depends on @node-rs/argon2.

When attempting to deploy the app with SST, I get this error:

Error: There was a problem bundling the SSR function for the "ServerFunction" Site.
No loader is configured for ".node" files: node_modules/@node-rs/argon2-win32-x64-msvc/argon2.win32-x64-msvc.node
node_modules/@node-rs/argon2/index.js
104 │             nativeBinding = require('@node-rs/argon2-win32-x64-msvc')
No loader is configured for ".node" files: node_modules/@node-rs/bcrypt-win32-x64-msvc/bcrypt.win32-x64-msvc.node
node_modules/@node-rs/bcrypt/binding.js
102 │             nativeBinding = require('@node-rs/bcrypt-win32-x64-msvc')

Trace: Error: There was a problem bundling the SSR function for the "ServerFunction" Site.
No loader is configured for ".node" files: node_modules/@node-rs/argon2-win32-x64-msvc/argon2.win32-x64-msvc.node
node_modules/@node-rs/argon2/index.js
104 │             nativeBinding = require('@node-rs/argon2-win32-x64-msvc')
No loader is configured for ".node" files: node_modules/@node-rs/bcrypt-win32-x64-msvc/bcrypt.win32-x64-msvc.node
node_modules/@node-rs/bcrypt/binding.js
102 │             nativeBinding = require('@node-rs/bcrypt-win32-x64-msvc')
    at SsrFunction.buildAssetFromHandler (file:///E:/NextCloud/Projects/Programming/ScoringApp-Serverless/voyager/node_modules/sst/constructs/SsrFunction.js:226:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async file:///E:/NextCloud/Projects/Programming/ScoringApp-Serverless/voyager/node_modules/sst/constructs/SsrFunction.js:64:19
    at process.<anonymous> (file:///E:/NextCloud/Projects/Programming/ScoringApp-Serverless/voyager/node_modules/sst/cli/sst.js:58:21)
    at process.emit (node:events:525:35)
    at process.emit (node:domain:489:12)
    at process._fatalException (node:internal/process/execution:149:25)
    at processPromiseRejections (node:internal/process/promises:288:13)
    at process.processTicksAndRejections (node:internal/process/task_queues:96:32)

At first I tried getting help from SST, and had a long conversation with a GPT plugin that has access to the docs, and got nowhere.

There are two problems here that I see:

1. esbuild doesn't know what to do with the .node files, and I'm not really sure how to configure it to fix that; and
2. Since I'm deploying this app on AWS Lambda, which uses arm64, I'll need it to pick a different .node file when bundling and uploading to the server. I checked @node-rs/argon2/index.js and see that it pulls process.platform and process.arch and picks what binary to pull from at runtime. I tried overwriting process.platform and process.arch in my vite.config.ts like this, but it didn't make any change in the .node file that argon2 was attempting to load.

   export default defineConfig({
      plugins: [sveltekit()],
      define: {
          'process.platform': 'linux',
          'process.arch': 'arm64',
      },
   });

Any idea how to remedy either of these two issues? Thanks!

[Brooooooklyn]

esbuild app.js --bundle --loader:.node=copy

[JL102]

Thank you - Sadly I don't know if there's a way for me to adjust the flags sent to esbuild directly, since it's being called from SST. So I will ask the SST devs/community to see if that's possible.

[JL102]

@Brooooooklyn With some help, I was able to update SST's configuration to use esbuild to set .node files to copy instead of attempting to bundle them.

I am now stuck on my second issue: I'm running on an x86-64 system, but I am deploying to AWS Lambda wherein they are using arm64. In the bundling process, NPM flat-out refuses to allow @node-rs/argon2-linux-arm64-gnu to be installed.

To start with, in my project, when installing with yarn, I ran yarn --ignore-platform to install all binaries of @node-rs/argon2 and @node-rs/bcrypt.

When deploying with sst, here's what I see:

Trace: Error: There was a problem bundling the SSR function for the "ServerFunction" Site.
Error: Command failed: npm install --platform=linux --omit=dev --no-optional --arch=arm64
npm WARN config optional Use `--omit=optional` to exclude optional dependencies, or
npm WARN config `--include=optional` to include them.
npm WARN config
npm WARN config     Default value does install optional deps unless otherwise omitted.
npm ERR! code EBADPLATFORM
npm ERR! notsup Unsupported platform for @node-rs/[email protected]: wanted {"os":"linux","arch":"arm64"} (current: {"os":"win32","arch":"x64"})
npm ERR! notsup Valid OS:    linux
npm ERR! notsup Valid Arch:  arm64
npm ERR! notsup Actual OS:   win32
npm ERR! notsup Actual Arch: x64

npm ERR! A complete log of this run can be found in:
npm ERR!     C:\Users\draki\AppData\Local\npm-cache\_logs\2024-02-15T20_50_54_938Z-debug-0.log

    at SsrFunction.buildAssetFromHandler (file:///E:/NextCloud/Projects/Programming/ScoringApp-Serverless/voyager/node_modules/sst/constructs/SsrFunction.js:228:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async file:///E:/NextCloud/Projects/Programming/ScoringApp-Serverless/voyager/node_modules/sst/constructs/SsrFunction.js:65:19
    at process.<anonymous> (file:///E:/NextCloud/Projects/Programming/ScoringApp-Serverless/voyager/node_modules/sst/cli/sst.js:58:21)
    at process.emit (node:events:525:35)
    at process.emit (node:domain:489:12)
    at process._fatalException (node:internal/process/execution:149:25)
    at processPromiseRejections (node:internal/process/promises:288:13)
    at process.processTicksAndRejections (node:internal/process/task_queues:96:32)

I even went into node_modules, found the code responsible for runing the npm command, and replaced --no-optional with --include-optional but then it still refuses to install with the requested platform because I'm running on win32 x64.

Trace: Error: There was a problem bundling the SSR function for the "ServerFunction" Site.
Error: Command failed: npm install --platform=linux --omit=dev --include-optional --arch=arm64
npm ERR! code EBADPLATFORM
npm ERR! notsup Unsupported platform for @node-rs/[email protected]: wanted {"os":"linux","arch":"arm64"} (current: {"os":"win32","arch":"x64"})
npm ERR! notsup Valid OS:    linux
npm ERR! notsup Valid Arch:  arm64
npm ERR! notsup Actual OS:   win32
npm ERR! notsup Actual Arch: x64

npm ERR! A complete log of this run can be found in:
npm ERR!     C:\Users\draki\AppData\Local\npm-cache\_logs\2024-02-15T20_49_35_605Z-debug-0.log

    at SsrFunction.buildAssetFromHandler (file:///E:/NextCloud/Projects/Programming/ScoringApp-Serverless/voyager/node_modules/sst/constructs/SsrFunction.js:228:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async file:///E:/NextCloud/Projects/Programming/ScoringApp-Serverless/voyager/node_modules/sst/constructs/SsrFunction.js:65:19
    at process.<anonymous> (file:///E:/NextCloud/Projects/Programming/ScoringApp-Serverless/voyager/node_modules/sst/cli/sst.js:58:21)
    at process.emit (node:events:525:35)
    at process.emit (node:domain:489:12)
    at process._fatalException (node:internal/process/execution:149:25)
    at processPromiseRejections (node:internal/process/promises:288:13)
    at process.processTicksAndRejections (node:internal/process/task_queues:96:32)

I am completely stuck. I even tried setting up a Docker devcontainer on arm64 but that didn't work either. I have no idea what to do now. Do you know how to help?