Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

problem about the urban30.bag dataset result #48

Open
aidadgy opened this issue Nov 22, 2024 · 6 comments
Open

problem about the urban30.bag dataset result #48

aidadgy opened this issue Nov 22, 2024 · 6 comments

Comments

@aidadgy
Copy link

aidadgy commented Nov 22, 2024

Hello author, I conducted experiments using the publicly available dataset urban30.txt and recorded the results of the true and estimated values, which are path_data.txt path_data2.txt. I evaluated them using evo_ape tum path_data.txt path_data2.txt - a-p - s. The results are as follows:
2024-11-21 17-12-52 的屏幕截图
But I found that the RMSE index is 9.25, which cannot achieve the accuracy mentioned in your paper,Do you know what the reason is,thanks
2024-11-10 14-10-26屏幕截图

@aidadgy aidadgy closed this as completed Nov 22, 2024
@aidadgy aidadgy changed the title problem about 他和 problem about Nov 22, 2024
@aidadgy aidadgy changed the title problem about problem about the urban30.bag dataset result Nov 22, 2024
@aidadgy aidadgy reopened this Nov 22, 2024
@Happy-ZZX
Copy link

Hi, I think you have misunderstood the meaning. The author said in the paper the ATE is per 1km, not entire trajectory. Hope this can help you.

@aidadgy
Copy link
Author

aidadgy commented Nov 30, 2024

Hi, I think you have misunderstood the meaning. The author said in the paper the ATE is per 1km, not entire trajectory. Hope this can help you.
Yes, I have also noticed that, and I would like to ask how you record the estimated result and the truth result. I used to record the corresponding topic data before, but I don't know whether it is appropriate, because the data in the truth topic seems to be constantly updated and changed, thank you

@Happy-ZZX
Copy link

Hi, I think you have misunderstood the meaning. The author said in the paper the ATE is per 1km, not entire trajectory. Hope this can help you.
Yes, I have also noticed that, and I would like to ask how you record the estimated result and the truth result. I used to record the corresponding topic data before, but I don't know whether it is appropriate, because the data in the truth topic seems to be constantly updated and changed, thank you

Yes, I also notice that the Ground Truth is keep changing in Rviz. But if you draw the estimated result and ground truth, it is right. To draw the trajectory result, there are plenty of toolboxes you can use, like Openvins tools, EVO evaluate toolboxes.

@aidadgy
Copy link
Author

aidadgy commented Dec 8, 2024

Yes, I also notice that the Ground Truth is keep changing in Rviz. But if you draw the estimated result and ground truth, it is right. To draw the trajectory result, there are plenty of toolboxes you can use, like Openvins tools, EVO evaluate toolboxes.

I'm sorry, I can't understand what you said: "But if you draw the estimated result and ground truth, it is right." What does it mean? Do you mean that you do not need to care about this phenomenon, and still record their corresponding topic data for comparison? I am curious why the truth value is changing, is it some provisions made in the source code, thank you

@Happy-ZZX
Copy link

Yes, I also notice that the Ground Truth is keep changing in Rviz. But if you draw the estimated result and ground truth, it is right. To draw the trajectory result, there are plenty of toolboxes you can use, like Openvins tools, EVO evaluate toolboxes.

I'm sorry, I can't understand what you said: "But if you draw the estimated result and ground truth, it is right." What does it mean? Do you mean that you do not need to care about this phenomenon, and still record their corresponding topic data for comparison? I am curious why the truth value is changing, is it some provisions made in the source code, thank you

Sorry for the confusion. Yes, you can ignore this issue as it’s just a display bug. I suspect the root cause is a third-party library in Ov_eva. Recently, I’ve been working on resolving this problem. However, since I’ve been busy with other tasks, I’m not sure when I’ll be able to identify and fix the bug.

@aidadgy
Copy link
Author

aidadgy commented Dec 11, 2024

Yes, I also notice that the Ground Truth is keep changing in Rviz. But if you draw the estimated result and ground truth, it is right. To draw the trajectory result, there are plenty of toolboxes you can use, like Openvins tools, EVO evaluate toolboxes.

I'm sorry, I can't understand what you said: "But if you draw the estimated result and ground truth, it is right." What does it mean? Do you mean that you do not need to care about this phenomenon, and still record their corresponding topic data for comparison? I am curious why the truth value is changing, is it some provisions made in the source code, thank you

Sorry for the confusion. Yes, you can ignore this issue as it’s just a display bug. I suspect the root cause is a third-party library in Ov_eva. Recently, I’ve been working on resolving this problem. However, since I’ve been busy with other tasks, I’m not sure when I’ll be able to identify and fix the bug.

Thank you for your answer. As you record the content of the truth topic, you will find that the previous position results are constantly updated. Have you noticed this phenomenon? The result of truth value is constantly updated and changed, so can we still use the truth value recorded by this topic to evaluate, or are you directly using the truth value file provided by the author

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants