[Bug]: CI/multi cn e2e run bvt load data LOCAL infile got FileNotFoundException

[xzxiong]

Is there an existing issue for the same bug?

• I have checked the existing issues.

Branch Name

main

Commit ID

212f82a

Other Environment Information

- Hardware parameters:
- OS type:
- Others:

Actual Behavior

Matrixone Compose CI / multi cn e2e bvt test docker compose(Optimistic/PUSH)
看起来 参数应该协程 $GITHUB_WORKSPACE/test/distributed/resources 才对？

• Standlone CI 是OK的

https://github.com/matrixorigin/matrixone/actions/runs/9208910754/job/25332186175

2024-05-23 15:48:59 ERROR Executor:267 - [/home/runner/work/matrixone/matrixone/test/distributed/cases/log/query_tcp.sql][row:76][load data local infile '$resources/external_table_file/rawlog_withnull.csv' into table rawlog_withnull fields terminated by ',' enclosed by '\"' lines terminated by '\n';] was executed failed, con[id=1, user=bvt_query_tcp:admin:accountadmin, ***
2024-05-23 15:48:59 ERROR Executor:269 - [EXPECT RESULT]:
null
2024-05-23 15:48:59 ERROR Executor:270 - [ACTUAL RESULT]:
Unable to open file '/test/distributed/resources/external_table_file/rawlog_withnull.csv'for 'LOAD DATA LOCAL INFILE' command.Due to underlying IOException: 

** BEGIN NESTED EXCEPTION ** 

java.io.FileNotFoundException
MESSAGE: /test/distributed/resources/external_table_file/rawlog_withnull.csv (No such file or directory)

STACKTRACE:

java.io.FileNotFoundException: /test/distributed/resources/external_table_file/rawlog_withnull.csv (No such file or directory)
	at java.io.FileInputStream.open0(Native Method)
	at java.io.FileInputStream.open(FileInputStream.java:195)
	at java.io.FileInputStream.<init>(FileInputStream.java:138)
	at java.io.FileInputStream.<init>(FileInputStream.java:93)
	at com.mysql.cj.protocol.a.NativeProtocol.sendFileToServer(NativeProtocol.java:1865)
	at com.mysql.cj.protocol.a.TextResultsetReader.read(TextResultsetReader.java:107)
	at com.mysql.cj.protocol.a.TextResultsetReader.read(TextResultsetReader.java:48)
	at com.mysql.cj.protocol.a.NativeProtocol.read(NativeProtocol.java:1698)
	at com.mysql.cj.protocol.a.NativeProtocol.readAllResults(NativeProtocol.java:1752)
	at com.mysql.cj.protocol.a.NativeProtocol.sendQueryPacket(NativeProtocol.java:1041)
	at com.mysql.cj.protocol.a.NativeProtocol.sendQueryString(NativeProtocol.java:921)
	at com.mysql.cj.NativeSession.execSQL(NativeSession.java:1154)
	at com.mysql.cj.jdbc.StatementImpl.executeInternal(StatementImpl.java:742)
	at com.mysql.cj.jdbc.StatementImpl.execute(StatementImpl.java:666)
	at io.mo.db.Executor.run(Executor.java:144)
	at io.mo.Tester.run(Tester.java:206)
	at io.mo.Tester.run(Tester.java:215)
	at io.mo.Tester.run(Tester.java:215)
	at io.mo.Tester.main(Tester.java:153)


** END NESTED EXCEPTION **

Expected Behavior

No response

Steps to Reproduce

https://github.com/matrixorigin/matrixone/actions/runs/9208910754/job/25332186175

Additional information

No response

[xzxiong]

贾节杰 5-24 11:56
是这样子的，这个是把相应的目录挂载到容器的这个目录下

谢泽雄 5-24 11:57
那我懂了。

谢泽雄 5-24 11:58
这样的话，我还不能执行 load data LOCAL infile

谢泽雄 5-24 11:58
我去问问动哥。

贾节杰 5-24 11:58
挂载到容器的/test这个目录

贾节杰 5-24 11:58
好的，这个就得用服务端本地load了

谢泽雄 5-24 11:59
是的，为了执行 load data infile。

谢泽雄 5-24 12:00
但我现在想跑 load data LOCAL infile

[xzxiong]

root cause:

1. multi cn 需要通过 docker-compose 启动多个 cn 进行测试
2. 为了执行 load data infile, 需要将 test/distributed/resources 挂载到 容器里

所以，这里有两个 resources 目录

1. in 容器, 目录 /test/distributed/resources
2. out 容器，目录 $workspace...../test/distributed/resources

[xzxiong]

提议：
获取 mo-tester 可以支持一个 $resources_local 的变量，解决load data LOCAL infile 的需求。

• 这个变量用于指定 与mo-tester 同机的目录
• 当指定 -p $workspace/test/distributed/cases 时，resources_local 的值为 $workspace/test/distributed/resources

[xzxiong]

提议： 获取 mo-tester 可以支持一个 $resources_local 的变量，解决load data LOCAL infile 的需求。

• 这个变量用于指定 与mo-tester 同机的目录
• 当指定 -p $workspace/test/distributed/cases 时，resources_local 的值为 $workspace/test/distributed/resources

@aressu1985 已对齐，同意该方案。

[xzxiong]

wait mo-tester pr matrixorigin/mo-tester#165 merged

[aressu1985]

已经解决了

[matrix-meow]

Hello @xzxiong. The bug issue in the BVT test code has not been removed,issues automatically open.

[xzxiong]

done.