Foundation update

[Martin-Molinero]

Description

• Updating C# & Py libraries
• Installing net9 see related Net 9 Migration #7612, keeping net6 until fully transitioned
• Adding new libraries

New amd64 image size
PR 28.8GB
MASTER 26.3GB

Related Issue

Closes #8407
Closes #8380
Closes #8342
Closes #8339
Closes #8333
Closes #8225
Closes #8216
Closes #8202
Closes #8134
Closes #8109
Closes #7389
Closes #7869
Closes #7973

Closes #8318, cloud only

Does not install #8314
Requires pandas <2
- #8233
- #8133
Very specific requirements #8319 hudson-and-thames/arbitragelab#121

Pin pyvinecopulib to 0.6.5, newer versions are causing indeterministic explosions

Motivation and Context

N/A

Requires Documentation Change

N/A

How Has This Been Tested?

Existing and new tests

Types of changes

• Bug fix (non-breaking change which fixes an issue)
• Refactor (non-breaking change which improves implementation)
• Performance (non-breaking change which improves performance. Please add associated performance test and results)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to change)
• Non-functional change (xml comments/documentation/etc)

Checklist:

• My code follows the code style of this project.
• I have read the CONTRIBUTING document.
• I have added tests to cover my changes.
• All new and existing tests passed.
• My branch follows the naming convention bug-<issue#>-<description> or feature-<issue#>-<description>