Skip to content

Commit

Permalink
Update
Browse files Browse the repository at this point in the history
  • Loading branch information
OE-Heart committed Jun 27, 2024
1 parent c866187 commit 7b0b3c8
Show file tree
Hide file tree
Showing 3 changed files with 37 additions and 10 deletions.
26 changes: 21 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,8 +4,8 @@
## <p align="center">Agents 2.0: Symbolic Learning Enables Self-Evolving Agents</p>

<p align="center">
<a href="https://oe-heart.github.io/Agents2.0/">[🤖Project]</a>
<a href="">[📄Paper]</a>
<a href="https://aiwaves-cn.github.io/agents/">[🤖Project]</a>
<a href="https://arxiv.org/abs/2406.18532">[📄Paper]</a>
<a href="https://agentsv2.readthedocs.io/">[📝Docs]</a>
<a href="#overview">[🌟Overview]</a>
<a href="#installation">[🔧Installation]</a>
Expand All @@ -23,7 +23,7 @@


## 🔔News
- [2024-06-25] We release Agents 2.0, a major update to the original library, adding support for agent learning and evaluation.
- [2024-06-25] We release new agents2.0, supporting for agent evaluation and optimazation.
---

## 🌟Overview
Expand All @@ -34,8 +34,13 @@ Agent symbolic learning is a systematic framework for training language agents,

We implement loss function, back-propagation, and weight optimizer in the context of agent training with carefully designed prompt pipelines. For a training example, our framework first conducts the "forward pass" (agent execution) and stores the input, output, prompts, and tool usage in each node in a "trajectory". We then use a prompt-based loss function to evaluate the outcome, resulting in a "language loss". Afterward, we back-propagate the language loss from the last to the first node along the trajectory, resulting in textual analyses and reflections for the symbolic components within each node, we call them language gradients. Finally, we update all symbolic components in each node, as well as the computational graph consisting of the nodes and their connections, according to the language gradients with another carefully designed prompt. Our approach also naturally supports optimizing multi-agent systems by considering nodes as different agents or allowing multiple agents to take actions in one node.

### Workflow Illustration

<img src='./assets/workflow.gif'>

---


## 🔧Installation

**Installation from git repo branch:**
Expand All @@ -61,12 +66,23 @@ pip install -e .

If you find our repository useful in your research, please kindly consider cite:
```bibtex
@article{zhou2024agents2,
title={Symbolic Learning Enables Self-Evolving Agents},
author={Wangchunshu Zhou and Yixin Ou and Shengwei Ding and Long Li and Jialong Wu and Tiannan Wang and Jiamin Chen and Shuai Wang and Xiaohua Xu and Ningyu Zhang and Huajun Chen and Yuchen Eleanor Jiang},
year={2024},
eprint={2406.18532},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2406.18532},
}
@article{zhou2023agents,
title={Agents: An Open-source Framework for Autonomous Language Agents},
author={Wangchunshu Zhou and Yuchen Eleanor Jiang and Long Li and Jialong Wu and Tiannan Wang and Shi Qiu and Jintian Zhang and Jing Chen and Ruipu Wu and Shuai Wang and Shiding Zhu and Jiyu Chen and Wentao Zhang and Ningyu Zhang and Huajun Chen and Peng Cui and Mrinmaya Sachan},
author={Wangchunshu Zhou and Yuchen Eleanor Jiang and Long Li and Jialong Wu and Tiannan Wang and Shi Qiu and Jintian Zhang and Jing Chen and Ruipu Wu and Shuai Wang and Shiding Zhu and Jiyu Chen and Wentao Zhang and Xiangru Tang and Ningyu Zhang and Huajun Chen and Peng Cui and Mrinmaya Sachan},
year={2023},
eprint={2309.07870},
archivePrefix={arXiv},
primaryClass={cs.CL}
primaryClass={cs.CL},
url={https://arxiv.org/abs/2309.07870},
}
```
Binary file added assets/workflow.gif
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
21 changes: 16 additions & 5 deletions index.html
Original file line number Diff line number Diff line change
Expand Up @@ -81,7 +81,7 @@ <h1 class="title is-2 publication-title">Symbolic Learning Enables Self-Evolving
<div class="publication-links">
<!-- ArXiv abstract Link -->
<span class="link-block">
<a href="https://arxiv.org/abs/<ARXIV PAPER ID>" target="_blank"
<a href="https://arxiv.org/abs/2406.18532" target="_blank"
class="external-link button is-normal is-rounded is-dark">
<span class="icon">
<i class="ai ai-arxiv"></i>
Expand All @@ -92,7 +92,7 @@ <h1 class="title is-2 publication-title">Symbolic Learning Enables Self-Evolving

<!-- Arxiv PDF link -->
<span class="link-block">
<a href="https://arxiv.org/pdf/<ARXIV PAPER ID>.pdf" target="_blank"
<a href="https://arxiv.org/pdf/2406.18532.pdf" target="_blank"
class="external-link button is-normal is-rounded is-dark">
<span class="icon">
<i class="fas fa-file-pdf"></i>
Expand Down Expand Up @@ -345,13 +345,24 @@ <h2 class="title is-3">📊Experiments</h2>
<section class="section" id="BibTeX">
<div class="container is-max-desktop content">
<h2 class="title">🚩Citation</h2>
<pre><code>@misc{zhou2023agents,
<pre><code>@article{zhou2024agents2,
title={Symbolic Learning Enables Self-Evolving Agents},
author={Wangchunshu Zhou and Yixin Ou and Shengwei Ding and Long Li and Jialong Wu and Tiannan Wang and Jiamin Chen and Shuai Wang and Xiaohua Xu and Ningyu Zhang and Huajun Chen and Yuchen Eleanor Jiang},
year={2024},
eprint={2406.18532},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2406.18532},
}

@article{zhou2023agents,
title={Agents: An Open-source Framework for Autonomous Language Agents},
author={Wangchunshu Zhou and Yuchen Eleanor Jiang and Long Li and Jialong Wu and Tiannan Wang and Shi Qiu and Jintian Zhang and Jing Chen and Ruipu Wu and Shuai Wang and Shiding Zhu and Jiyu Chen and Wentao Zhang and Ningyu Zhang and Huajun Chen and Peng Cui and Mrinmaya Sachan},
author={Wangchunshu Zhou and Yuchen Eleanor Jiang and Long Li and Jialong Wu and Tiannan Wang and Shi Qiu and Jintian Zhang and Jing Chen and Ruipu Wu and Shuai Wang and Shiding Zhu and Jiyu Chen and Wentao Zhang and Xiangru Tang and Ningyu Zhang and Huajun Chen and Peng Cui and Mrinmaya Sachan},
year={2023},
eprint={2309.07870},
archivePrefix={arXiv},
primaryClass={cs.CL}
primaryClass={cs.CL},
url={https://arxiv.org/abs/2309.07870},
}</code></pre>
</div>
</section>
Expand Down

0 comments on commit 7b0b3c8

Please sign in to comment.