Use Configuration of rearch

[waynehamadi]

Background

We can start integrating some of the elements of the rearch in master. Thanks @collijk !

Changes

• Add the new Configuration class along with other methods and classes coming straight from the rearch
• integrated the config with these new objects.
• clearly separate default values from the rest of the logic.
• clearly separate what comes from the env from the rest of the logic (so that we can build a config without an env file.
• Code cleanup

Documentation

Test Plan

PR Quality Checklist

• My pull request is atomic and focuses on a single change.
• I have thoroughly tested my changes with multiple different prompts.
• I have considered potential risks and mitigations for my changes.
• I have documented my changes clearly and comprehensively.
• I have not snuck in any "extra" small tweaks changes.
• I have run the following commands against my code to ensure it passes our linters:

  black .
  isort .
  mypy
  autoflake --remove-all-unused-imports --recursive --ignore-init-module-imports --ignore-pass-after-docstring autogpt tests --in-place

[github-actions]

This PR exceeds the recommended size of 500 lines. Please make sure you are NOT addressing multiple issues with one PR.

[netlify]

✅ Deploy Preview for auto-gpt-docs canceled.

Name	Link
🔨 Latest commit	068dcfd
🔍 Latest deploy log	https://app.netlify.com/sites/auto-gpt-docs/deploys/649a089e6698ca000844b985

[codecov]

Codecov Report

Patch coverage: 75.41% and project coverage change: +0.14 🎉

Comparison is base (b157054) 70.78% compared to head (fcff3cb) 70.92%.

❗ Current head fcff3cb differs from pull request most recent head 068dcfd. Consider uploading reports for the commit 068dcfd to get more accurate results

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #4803      +/-   ##
==========================================
+ Coverage   70.78%   70.92%   +0.14%     
==========================================
  Files          68       69       +1     
  Lines        3327     3347      +20     
  Branches      532      542      +10     
==========================================
+ Hits         2355     2374      +19     
  Misses        795      795              
- Partials      177      178       +1     

Impacted Files	Coverage Δ
autogpt/main.py	23.52% <33.33%> (ø)
autogpt/core/configuration/schema.py	64.58% <64.58%> (ø)
autogpt/configurator.py	30.37% <69.23%> (ø)
autogpt/config/config.py	73.94% <81.57%> (+5.30%)	⬆️
autogpt/plugins/__init__.py	73.54% <100.00%> (ø)

... and 1 file with indirect coverage changes

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

[github-actions]

This PR exceeds the recommended size of 500 lines. Please make sure you are NOT addressing multiple issues with one PR.

[github-actions]

This PR exceeds the recommended size of 500 lines. Please make sure you are NOT addressing multiple issues with one PR.

[github-actions]

This PR exceeds the recommended size of 500 lines. Please make sure you are NOT addressing multiple issues with one PR.

[Pwuts]

This has caused type-checking errors everywhere:

main.py:

agent.py:

This pretty much breaks my development workflow because it floods the static code analysis with errors, drowning out any actual problems.