Sync Words, a fun benchmark for LLMs!
The wordssynchchallenge project addresses the challenge of synchronizing word choices between AI models and users in a game-like setting. It offers seamless AI integration, multilingual support, and engaging user interactions. Ideal for AI enthusiasts and developers, it enhances understanding of AI model interactions and natural language processing through interactive gameplay.
Subproject | Summary | |
---|---|---|
⚙️ | Website |
|
🔌 | Data Analysis |
|
- Word Synchronization Challenge: A Benchmark for Word Association Responses for Large Language Models
Tanguy Cazalets, Joni Dambre
Accepted for presentation at HCII 2025 Conference
To be published in Springer’s HCII 2025 Proceedings.
This paper introduces the Word Synchronization Challenge, a novel benchmark to evaluate word association responses in Large Language Models (LLMs). It discusses implementation insights, highlights human-LLM interaction mechanisms, and addresses ethical considerations, such as participant consent and data privacy, in studies involving human subjects.
This project is protected under the MIT License License.
- Thanks to Qiao Qiao Ren and Tony Belpaeme for their help on the project.
- This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 860949