Error installing on Docker Desktop

[jldec]

There appear to be 2 problems with installing onto k8s in Docker Desktop

1. The node name for recent Docker Desktop builds should be docker-desktop (see add check for docker-desktop node name #37)
2. localhost:6443 endpoint for talking to k8s API from inside the invocation-image container does not appear to work.

$ duffle install myriff riff --credentials myk8s
Executing install action...
time="2019-05-31T17:15:53Z" level=fatal msg="Get https://localhost:6443/api/v1/nodes/minikube: dial tcp 127.0.0.1:6443: connect: connection refused"
Error: Install step failed: container exit code: 1

[scothis]

Is kubectl config current-context set to minikube instead of docker-desktop?

[jldec]

No, i think the error message above (running a build of the PR #37 branch) is coming from the first detection probe check which happens to be minikube here.

[sbawaska]

The problem here is that docker-for-desktop uses localhost as the server address. snippet from ~/.kube/config:

clusters:
- cluster:
    insecure-skip-tls-verify: true
    server: https://localhost:6443
  name: docker-for-desktop-cluster

Since, duffle mounts this kube config inside a container when it runs the install command, our binary is unable to find a cluster at localhost.
minikube works because it assigns an IP address to the VM and uses that in kube config.

[sbawaska]

replacing localhost with host.docker.internal in ~/.kube/config fixes the issue, but that breaks kubectl on the host.

clusters:
- cluster:
    insecure-skip-tls-verify: true
    server: https://host.docker.internal:6443
  name: docker-desktop

[jldec]

Adding @glyn because this looks like a generic duffle issue

How should duffle installers target the kubernetes running in docker-desktop if the k8s api-server endpoint in .kube/config doesn't resolve from inside the invocation image?

[glyn]

I'm not sure this is an issue with duffle per se, since duffle has no direct relationship to, or support for, k8s.

A solution would be to copy ~/.kube/config and modify it (to use host.docker.internal instead of localhost, as above) and then use the copy to create the duffle credential.

[jldec]

Per this duffle doc, kubeconfig credentials appear to be the canonical example for duffle. IMO k8s should be a first-class, batteries-included, no-additional-config-required, target for cnab bundles and tools like duffle.

I'd be very surprised if this problem of how to target the kubernetes running in docker-desktop from a duffle invocation image container has not been encountered (and a solution or workaround suggested).

[glyn]

Raised cnabio/duffle#762