Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

squid maximum_object_size lower than allowable cvmfs chunk sizes #20

Closed
jflandry opened this issue Jan 24, 2020 · 2 comments
Closed

squid maximum_object_size lower than allowable cvmfs chunk sizes #20

jflandry opened this issue Jan 24, 2020 · 2 comments
Assignees
Labels
enhancement New feature or request

Comments

@jflandry
Copy link

site/profile/templates/squid/squid.conf.epp Line 28:
maximum_object_size 4096 KB

This limit is lower than the (default) allowable cvmfs chunk size, which is not optimal.

From Ryan P. Taylor:

$ grep "DEFAULT.*CHUNK_SIZE="  /usr/bin/cvmfs_server 
CVMFS_DEFAULT_MIN_CHUNK_SIZE=4194304
CVMFS_DEFAULT_AVG_CHUNK_SIZE=8388608
CVMFS_DEFAULT_MAX_CHUNK_SIZE=16777216

Reference data repositories such as bioinformatics tend to use larger chunks (32-128 megabytes), a more reasonable squid maximum_object_size might be 131072 KB instead.

@jflandry
Copy link
Author

Ryan P. Taylor confirms that CC data repos use CVMFS_MAX_CHUNK_SIZE=67108864

@cmd-ntrf cmd-ntrf self-assigned this Jan 28, 2020
@cmd-ntrf cmd-ntrf added the enhancement New feature or request label Jan 28, 2020
cmd-ntrf added a commit that referenced this issue Feb 3, 2020
@cmd-ntrf
Copy link
Member

cmd-ntrf commented Feb 3, 2020

Thanks!

I bumped the limit in commit fd44045.

@cmd-ntrf cmd-ntrf closed this as completed Feb 3, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants