Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

item超过2万后报错 #778

Open
Junesui opened this issue Sep 17, 2023 · 4 comments
Open

item超过2万后报错 #778

Junesui opened this issue Sep 17, 2023 · 4 comments

Comments

@Junesui
Copy link

Junesui commented Sep 17, 2023

不知道是item还是整体数量的问题。

测试条件:不报错
用户数量 | 5000
物品数量 | 10000
反馈数量 | 20000

测试条件:不报错
用户数量 | 10000
物品数量 | 20000
反馈数量 | 40000

测试条件: 此时控制台报如下截图错误

用户数量 | 50000
物品数量 | 50000
反馈数量 | 40000

image

查看master的日志

{"level":"error","ts":1694944835.8019342,"msg":"failed to searching neighbors of items","error":"redis: can't parse int reply: \"*0\"","errorVerbose":"redis: can't parse int reply: \"*0\"\ngithub.com/zhenghaoz/gorse/master.(*Master).findItemNeighborsIVF.func4:505: \ngithub.com/zhenghaoz/gorse/base/parallel.DynamicParallel:124: \ngithub.com/zhenghaoz/gorse/master.(*Master).findItemNeighborsIVF:519: "}
{"level":"error","ts":1694945873.25644,"msg":"failed to load item categories","error":"redis: can't parse array/set/push reply: \"$1\""}
@linguanyuanA
Copy link

@Junesui 你可以把配置贴出来吗?

@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


@Junesui can you post the configuration?

@linguanyuanA
Copy link

@Junesui 你这个可能是redis cpu 跑不过来。导致数据没取到。 gorse 大量使用zset , redis很耗cpu
我在量级和你接近的时候, 发现了redis cpu 一直接近百分百

@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


@Junesui Your redis CPU may not be able to run this. As a result, the data was not retrieved. Gorse uses zset extensively, and redis consumes a lot of CPU.
When I was close to yours in magnitude, I discovered that redis cpu was always close to 100%.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants