Integrate Auto-GPT with Auto-GPT-Benchmarks

[waynehamadi]

Background

We want the master branch to be compatible with Auto-GPT-Benchmarks, so we always have the most up to date score in the benchmark.

Changes

- regression_tests.json stores the regression tests - benchmarks.py connects Auto-GPT to the benchmark's interface. - config.json defines the entry_path, the workspace location and the time a challenge should run.

Documentation

Test Plan

PR Quality Checklist

• My pull request is atomic and focuses on a single change.
• I have thoroughly tested my changes with multiple different prompts.
• I have considered potential risks and mitigations for my changes.
• I have documented my changes clearly and comprehensively.
• I have not snuck in any "extra" small tweaks changes.
• I have run the following commands against my code to ensure it passes our linters:

  black .
  isort .
  mypy
  autoflake --remove-all-unused-imports --recursive --ignore-init-module-imports --ignore-pass-after-docstring autogpt tests --in-place

[netlify]

✅ Deploy Preview for auto-gpt-docs canceled.

Name	Link
🔨 Latest commit	e75b9d5
🔍 Latest deploy log	https://app.netlify.com/sites/auto-gpt-docs/deploys/64bc3bd396545d000805389a

[codecov]

Codecov Report

Patch and project coverage have no change.

Comparison is base (e0bcde1) 51.00% compared to head (e75b9d5) 51.00%.

Additional details and impacted files

@@           Coverage Diff           @@
##           master    #4987   +/-   ##
=======================================
  Coverage   51.00%   51.00%           
=======================================
  Files         119      119           
  Lines        4968     4968           
  Branches      662      662           
=======================================
  Hits         2534     2534           
  Misses       2239     2239           
  Partials      195      195           

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

[github-actions]

This pull request has conflicts with the base branch, please resolve those so we can evaluate the pull request.

[github-actions]

Conflicts have been resolved! 🎉 A maintainer will review the pull request shortly.