Skip to content

Releases: exasol/databricks-virtual-schema

1.0.0 First Public Release

09 Oct 10:57
@github-actions github-actions
1.0.0
63acb72
This commit was created on github.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
1.0.0 First Public Release Latest
Latest

This is the first public release of the Databricks virtual schema. See the readme for known limitations.

Documentation

  • #44: Prepare release 1.0.0

Dependency Updates

Test Dependency Updates

  • Updated com.databricks:databricks-sdk-java:0.32.1 to 0.32.2
  • Updated org.junit-pioneer:junit-pioneer:2.2.0 to 2.3.0
Assets 6
Loading

0.3.0 Convert names to upper case, M2M auth

09 Oct 09:36
@github-actions github-actions
0.3.0
67f9f75
This commit was created on github.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
0.3.0 Convert names to upper case, M2M auth

This release converts the names of Databricks tables and columns to upper case in Exasol to improve usability of the virtual schema. Quoting table and column names with double quotes " is no longer required as Exasol converts all names to upper case by default.

The release also implement OAuth M2M (machine-to-machine) authentication, see the user guide for details.

Security

Features

  • #18: Convert table and column names to upper case
  • #3: Implemented OAuth M2M authentication

Documentation

  • #32: Updated JDBC driver installation instructions in user guide

Dependency Updates

Test Dependency Updates

  • Updated com.databricks:databricks-sdk-java:0.32.0 to 0.32.1
  • Added commons-io:commons-io:2.17.0
  • Updated org.junit.jupiter:junit-jupiter:5.11.1 to 5.11.2
Loading

0.2.0 Map unsupported data types to VARCHAR

01 Oct 14:27
@github-actions github-actions
0.2.0
0f022b8
This commit was created on github.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
0.2.0 Map unsupported data types to VARCHAR

This release maps unsupported Databricks data types BINARY, ARRAY, MAP, STRUCT and VARIANT to Exasol type VARCHAR. Creating a virtual schema no longer fails when the source schema contains columns of these types. Please note that type BINARY is still not supported and creating a virtual schema with a BINARY column fails, see issue #34 for details.

The release also stores the original Databricks metadata for each table and column as JSON format in field databricks_metadata of the adapter notes for table and column. This helps with debugging the virtual schema.

Features

  • #15: Mapped unsupported data types to VARCHAR
  • #33: Store Databricks metadata in adapter notes

Dependency Updates

Test Dependency Updates

  • Updated com.databricks:databricks-sdk-java:0.31.1 to 0.32.0
  • Updated com.exasol:test-db-builder-java:3.5.4 to 3.6.0
  • Updated org.junit.jupiter:junit-jupiter:5.11.0 to 5.11.1
Loading

0.1.0 Initial implementation

23 Sep 08:32
@github-actions github-actions
0.1.0
86b3830
This commit was created on github.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
0.1.0 Initial implementation

The Databricks Virtual Schema provides an abstraction layer that makes an external Databricks database accessible from an Exasol database through regular SQL commands. The contents of the external Databricks database are mapped to virtual tables which look like and can be queried as any regular Exasol table.

Important: This project is work in progress. Some features are not yet implemented. See known limitations for details.

Features

  • #11: Added query pushdown
  • #21: Added support for most important pushdown capabilities
  • #10: Added support for ALTER VIRTUAL SCHEMA <vs> REFRESH
  • #12: Added support for ALTER VIRTUAL SCHEMA <vs> SET ...

Refactoring

  • #16: Added shellcheck to CI build

Documentation

  • #22: Added user guide

Dependency Updates

Test Dependency Updates

  • Added com.databricks:databricks-jdbc:2.6.40-patch-1
  • Added com.databricks:databricks-sdk-java:0.31.1
  • Added com.exasol:exasol-testcontainers:7.1.1
  • Added com.exasol:hamcrest-resultset-matcher:1.7.0
  • Added com.exasol:maven-project-version-getter:1.2.0
  • Added com.exasol:test-db-builder-java:3.5.4
  • Added com.exasol:virtual-schema-shared-integration-tests:3.0.0
  • Added org.hamcrest:hamcrest:3.0
  • Added org.itsallcode:hamcrest-auto-matcher:0.8.1
  • Added org.junit-pioneer:junit-pioneer:2.2.0
  • Added org.junit.jupiter:junit-jupiter:5.11.0
  • Added org.slf4j:slf4j-jdk14:2.0.16

Plugin Dependency Updates

  • Added com.exasol:error-code-crawler-maven-plugin:2.0.3
  • Added com.exasol:project-keeper-maven-plugin:4.3.3
  • Added io.github.zlika:reproducible-build-maven-plugin:0.16
  • Added org.apache.maven.plugins:maven-clean-plugin:2.5
  • Added org.apache.maven.plugins:maven-compiler-plugin:3.13.0
  • Added org.apache.maven.plugins:maven-dependency-plugin:2.8
  • Added org.apache.maven.plugins:maven-deploy-plugin:2.7
  • Added org.apache.maven.plugins:maven-enforcer-plugin:3.5.0
  • Added org.apache.maven.plugins:maven-failsafe-plugin:3.2.5
  • Added org.apache.maven.plugins:maven-install-plugin:2.4
  • Added org.apache.maven.plugins:maven-jar-plugin:2.4
  • Added org.apache.maven.plugins:maven-resources-plugin:2.6
  • Added org.apache.maven.plugins:maven-site-plugin:3.3
  • Added org.apache.maven.plugins:maven-surefire-plugin:3.2.5
  • Added org.apache.maven.plugins:maven-toolchains-plugin:3.2.0
  • Added org.basepom.maven:duplicate-finder-maven-plugin:2.0.1
  • Added org.codehaus.mojo:exec-maven-plugin:3.4.1
  • Added org.codehaus.mojo:flatten-maven-plugin:1.6.0
  • Added org.codehaus.mojo:versions-maven-plugin:2.16.2
  • Added org.jacoco:jacoco-maven-plugin:0.8.12
  • Added org.sonarsource.scanner.maven:sonar-maven-plugin:4.0.0.4121
  • Added org.sonatype.ossindex.maven:ossindex-maven-plugin:3.2.0
Loading