Netbox does not connect to DB, no indication what is wrong

[papanito]

Deployment Type

Self-hosted

Triage priority

N/A

NetBox Version

v4.1.4

Python Version

3.12

Steps to Reproduce

I deploy netbox on kubernetes using the community helm chart 5.0.0-beta.128. It does not start and stuck in ⏳ Waiting on DB... (21s / 30s).

Enabled debugging, which shows the detailed stack.

We are using an external redis and postgresdb but the stack does not indicate whether it's an issue with the connection or authentication or whatever...

Expected Behavior

No Error

Observed Behavior

⏳ Waiting on DB... (21s / 30s)
🧬 loaded config '/etc/netbox/config/configuration.py'
🧬 loaded config '/etc/netbox/config/extra.py'
🧬 loaded config '/etc/netbox/config/logging.py'
🧬 loaded config '/etc/netbox/config/plugins.py'
Traceback (most recent call last):
  File "/opt/netbox/netbox/./manage.py", line 10, in <module>
    execute_from_command_line(sys.argv)
  File "/opt/netbox/venv/lib/python3.12/site-packages/django/core/management/__init__.py", line 442, in execute_from_command_line
    utility.execute()
  File "/opt/netbox/venv/lib/python3.12/site-packages/django/core/management/__init__.py", line 382, in execute
    settings.INSTALLED_APPS
  File "/opt/netbox/venv/lib/python3.12/site-packages/django/conf/__init__.py", line 89, in __getattr__
    self._setup(name)
  File "/opt/netbox/venv/lib/python3.12/site-packages/django/conf/__init__.py", line 76, in _setup
    self._wrapped = Settings(settings_module)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/netbox/venv/lib/python3.12/site-packages/django/conf/__init__.py", line 190, in __init__
    mod = importlib.import_module(self.SETTINGS_MODULE)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/importlib/__init__.py", line 90, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen importlib._bootstrap>", line 1387, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1360, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1331, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 935, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 995, in exec_module
  File "<frozen importlib._bootstrap>", line 488, in _call_with_frames_removed
  File "/opt/netbox/netbox/netbox/settings.py", line 599, in <module>
    requests.get(f'{CENSUS_URL}?{urlencode(CENSUS_PARAMS)}', timeout=3, proxies=HTTP_PROXIES)
  File "/opt/netbox/venv/lib/python3.12/site-packages/requests/api.py", line 73, in get
    return request("get", url, params=params, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/netbox/venv/lib/python3.12/site-packages/requests/api.py", line 59, in request
    return session.request(method=method, url=url, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/netbox/venv/lib/python3.12/site-packages/requests/sessions.py", line 579, in request
    settings = self.merge_environment_settings(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/netbox/venv/lib/python3.12/site-packages/requests/sessions.py", line 759, in merge_environment_settings
    no_proxy = proxies.get("no_proxy") if proxies is not None else None
               ^^^^^^^^^^^
AttributeError: 'str' object has no attribute 'get'

[marsteel]

what plugins are you using? disable them one by one in requirement.txt and you can see which plugin caused the issue.

[candlerb]

It looks like you have truncated the traceback, so you haven't shown the actual exception at the end.

However, given these lines:

    requests.get(f'{CENSUS_URL}?{urlencode(CENSUS_PARAMS)}', timeout=3, proxies=HTTP_PROXIES)
...
    no_proxy = proxies.get("no_proxy") if proxies is not None else None

I would guess that the problem is down to how you've set HTTP_PROXIES in your configuration.py.

This is a docker deployment so configuration.py is heavily customized - see here. There was a pull request in that area a few months ago.

[papanito]

It looks like you have truncated the traceback, so you haven't shown the actual exception at the end.

I added the line above, it's actually 'str' object has no attribute 'get'

But thanks for the hint, in the chart this has to be configured like

httpProxies:
  http: http://10.10.1.10:3128
  https: http://10.10.1.10:1080

Rather than

httpProxies: http://10.10.1.10:3128

as I had

[papanito]

Related to that: How would I set no_proxy

[candlerb]

[EDIT to replace what I wrote before]

It looks like netbox-chart completely replaces the configuration.py that netbox-docker provides, and injects settings like HTTP_PROXIES into a YAML file that it picks up.

So you should be able to use

httpProxies:
  http: foo
  https: bar
  no_proxy: baz