High memory allocation in pendulum 3.0

[cody-scott]

• [x ] I am on the latest Pendulum version.

• [x ] I have searched the issues of this repo and believe that this is not a duplicate.

• OS version and name: Debian GNU/Linux 12 (bookworm)

• Pendulum version: 3.0.0

Issue

In pendulum 3.0.0 it is allocating a large amount of memory for the library (up to 1gb). In prior versions, memory allocation was usually less than 2 mb for the same import. Possibly due to rust re-write?

tested/validated using memray with both pendulum==3.0.0 and pendulum==2.1.2

flame_graphs.zip

[Secrus]

That is troubling. I don't know too much about Rust, but I am open to accepting PRs that implement improvements on that front.

[cody-scott]

I think one first step would be to see if anyone else sees the same results I get when profiling. I tested in windows/linux and saw similar results, but would be great to confirm its not just a "me" issue.

[protoss-player]

I think one first step would be to see if anyone else sees the same results I get when profiling

Actually, I got the exactly same memory consumption issue with memray and ended up here.

[s-rigaud]

I'm getting segfault inside a docker container as fastapi_cache is based over pendulum and memory consumption is way higher than before.

[Secrus]

@cody-scott any chance you could test the latest master branch? I have merged some changes to the Rust-Python code and I suspect it might be the answer to this issue (at least partially)