fix(delta-lake): Bump delta-lake dependency

[pedro93]

The original delta-rs dependency error error has been fixed since 0.18.1.
Bumping to latest release to get up-to-date fixes. Use CI to check integration works.

Checklist

• The PR conforms to DataHub's Contributing Guideline (particularly Commit Message Format)
• Links to related issues (if applicable)
• Tests for the changes have been added/updated (if applicable)
• Docs related to the changes have been added/updated (if applicable). If a new feature has been added a Usage Guide has been added for the same.
• For any breaking change/potential downtime/deprecation/big changes an entry has been made in Updating DataHub

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

✅ All tests successful. No failed tests found.

see 60 files with indirect coverage changes

---

Continue to review full report in Codecov by Sentry.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 653f9ef...616dd0a. Read the comment docs.

🚀 New features to boost your workflow:

• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[sgomezvillamor]

LGTM

[sgomezvillamor]

CI fails with

  ╰─▶ Because the current Python version (3.8.18) does not satisfy Python>=3.9
      and deltalake==0.25.4 depends on Python>=3.9, we can conclude that
      deltalake==0.25.4 cannot be used.

According to delta-io/delta-rs#2577, the issue is exclusive for 0.18.0 and fixed already in 0.18.1, so maybe we can remove the upper bound and just exclude that version

    # Version 0.18.0 broken on ARM Macs: https://github.com/delta-io/delta-rs/issues/2577
    "deltalake>=0.6.3, != 0.6.4, != 0.18.0; platform_system == 'Darwin' and platform_machine == 'arm64'",
    "deltalake>=0.6.3, != 0.6.4; platform_system != 'Darwin' or platform_machine != 'arm64'",