Support paginated job listings

[soxofaan]

Pagination of job listings is becoming an important requirement to avoid performance issues due to users with hundreds/thousands of jobs. As noted in Open-EO/openeo-api#550, paginated is client-driven, so this needs handling in python client too.

related issues

• Enforce pagination of resource listings from the server-side openeo-api#550
• Request lists of resources with pagination openeo-web-editor#331
• Support paging in job listings openeo-python-driver#332
• Support paging in job listings openeo-geopyspark-driver#959
• Support job listing pagination openeo-aggregator#164

[m-mohr]

Here's a list of things that can be paginated for your convenience:

• GET /collections
• GET /processes
• GET /jobs
• GET /process_grapg
• GET /files
• GET /services
• Logs (Services and Jobs)
• Collection Items (if implemented)

As the approach is similar for all endpoints except logs (and somewhat collection items), I directly implemented it for all endpoints in the JS client for example.
Note: In Python (and R) this might have implications on the Vue Components that get rendered in Jupyter...

[soxofaan]

with 76bac3b I already added the limit argument to connection.list_jobs() to have very minimal support for paging (just to get first page)

[m-mohr]

I see you decided to default to null, too. I thought it would be better so set a specific value, but it would be somewhat breaking so had to go for null before the JS client will go toward 3.0.0...

[soxofaan]

yes, I just went for default null to keep the existing behavior for now (and to have tests that document the existing behavior).
But next step will probably be to change the default to something like 100.