Local Datasource No Data files found

[aascedu]

Hello.

I am using Netbox 4.1.1 deployed with netbox-docker.
I want to add a local datasource as a way to load router config files through a volume.
The files I want to import to my Netbox instance are where they are supposed to be ( in /opt/netbox/netbox/datasource) but the local datasource cannot find the files when syncing...

Here is /opt/netbox/netbox folder, we can see datasource and some other folder which are part of netbox :

The folder is populated with my files :

Here is the files I get when I use /opt/netbox/netbox as a URL (we can see files from some folder) :

However when I set the URL to /opt/netbox/netbox/datasource, NOTHING :

I don't understand why it doesn't work... I tried creating my own folder inside the docker container of netbox, in /opt/netbox/netbox called test and same as with datasource, it didn't work. I tried changing the folder properties with chown but nothing works.

Note : I tried to add /etc/netbox as a Local datasource, which worked :

but here is what's inside /etc/netbox :

It just doesn't make any sense since my config folder is a Docker volume as well... even if I try to create a folder inside the container at /etc/netbox/test, put a file in there, the Datasource doesn't detect it...

Update : it is not about folder but rather about files. I copied one of the files that were in the datasource into a folder I could manage to get synced correctly, and it doesn't show... They have the same group and owner, same rwx properties but my file originating from my docker volume just doesn't show which is SUPER WEIRD since when trying with another Docker Volume (in Read-Only mode), the files appears...

Am I missing something or is there something I could do to make that work ?
Thank you.

[an-ky]

I was searching around for a solution the better part of the day and it looks like I got one. The syncing process is done by a rqworker running in the netbox-worker container so it needs to see the volume, too.

With the following docker-compose.override.yaml I'm able to set an arbitrary directory as data source:

version: '4.1.7'
services:
  netbox: 
    ports:
    - 8000:8080
    environment:
      [...]
    volumes:
      - ./templates:/datasource:rw
  netbox-worker:
    volumes:
      - ./templates:/datasource:rw

This uses a host directory which needs to have the proper access right set.

With a named volume I had to apply a hack workaround using an init container to set proper permission. Without the init container the volume will be mounted as root:root 755 which isn't sufficient for netbox which runs as unit. I haven't found how the netbox compose file or container init scripts change the permissions for /opt/netbox/netbox/scripts and reports respectively, which are also mounted named volumes (according to docker-compose.yaml).

version: '4.1.7'
services:
  init-volume:
    image: ubuntu
    user: root
    volumes:
      - templates:/tmp/templates
    command: ["/bin/bash", "-c", "chown 999:0 /tmp/templates && chmod 775 /tmp/templates"]
  netbox: 
    user: "unit:root"
    ports:
    - 8000:8080
    environment:
      [...]
    volumes:
      - templates:/datasource:rw
    depends_on: &dep-init
      init-volume:
        condition: service_completed_successfully
  netbox-worker:
    user: "unit:root"
    volumes:
      - templates:/datasource:rw
    depends_on:
      <<: *dep-init
 
volumes:
  templates:
    driver: local

Hope that helps

[aascedu]

Hey man, I got to make it work a will ago.

I think the problem was coming from a wrong path, I had a type or something like that. Or the fact that I set the volume for netbox container and not netboxworker container. I did change the docker-compose.override.yml file and I'll update you with my solution so we can both learn !
Have a good day!