Skip to content

return RelationType.Table when file_format == 's3tables'#621

Open
dbeachnau-allcloud wants to merge 1 commit into
aws-samples:mainfrom
dbeachnau-allcloud:fix_returned_type_for_s3tables
Open

return RelationType.Table when file_format == 's3tables'#621
dbeachnau-allcloud wants to merge 1 commit into
aws-samples:mainfrom
dbeachnau-allcloud:fix_returned_type_for_s3tables

Conversation

@dbeachnau-allcloud

Copy link
Copy Markdown

The latest version 1.10.11 does not work when using s3 tables as the returned typer from adapter.get_table_type is not one of the allowed enums in RelationType.

Description

Instead of returning "s3_tables" returns RelationType.Table which in my testing resolved the error I was getting when running models:

Field "type" of type Optional[RelationType] in SparkRelation has invalid value 's3_table'

Checklist

  • I have signed the CLA
  • I have run this code in development and it appears to resolve the stated issue
  • This PR includes tests, or tests are not required/relevant for this PR
  • I have updated the CHANGELOG.md and added information about my change to the "dbt-glue next" section.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

@moomindani

Copy link
Copy Markdown
Contributor

Thanks for your contribution. I am working on broader comprehensive fixes to enable S3 tables workload. Will update here.

@moomindani moomindani added the enable-functional-tests This label enable functional tests label Sep 24, 2025
@moomindani

Copy link
Copy Markdown
Contributor

The PR I am working on: #626

I tried to test this commit with the comprehensive S3 tables test, but it failed. We will need to visit when it fails.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

beginning-contributor enable-functional-tests This label enable functional tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants