From 2359d6b75f88aa696bc4cad9dd01668457c5f591 Mon Sep 17 00:00:00 2001 From: Nayan Joshi Date: Tue, 11 Aug 2026 14:11:42 +0530 Subject: [PATCH 1/3] update query engine compatibility --- docs/understanding/compatibility-engines.mdx | 40 ++++++++++---------- 1 file changed, 20 insertions(+), 20 deletions(-) diff --git a/docs/understanding/compatibility-engines.mdx b/docs/understanding/compatibility-engines.mdx index 361afe62..67a02e31 100644 --- a/docs/understanding/compatibility-engines.mdx +++ b/docs/understanding/compatibility-engines.mdx @@ -8,26 +8,26 @@ sidebar_label: Compatibility with Query Engines You can query OLake Go Iceberg tables from multiple engines. The table below shows catalog compatibility at a glance, with links to setup guides. -| Query Tool | AWS Glue | Hive Metastore | JDBC | REST Generic | Lakekeeper | Unity | Polaris | S3 Tables | Nessie | Docs | -|-----------------------|--------|--------|--------|--------|------------|-------|---------|-----------|--------|-------------------------------------------------------------------------------------------| -| Amazon Athena | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ✅ | ❌ | [AWS Docs](https://docs.aws.amazon.com/athena/latest/ug/querying-iceberg.html) | -| Apache Spark (v3.3+) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [Spark Docs](https://iceberg.apache.org/docs/latest/spark-configuration/) | -| Apache Flink (v1.18+) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [Flink Docs](https://iceberg.apache.org/docs/latest/flink-configuration/) | -| Trino (v475 +) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [Trino Docs](https://trino.io/docs/current/object-storage/metastores.html) | -| Starburst Enterprise | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [Starburst Docs](https://docs.starburst.io/latest/object-storage/metastores.html) | -| [Presto](/blog/building-open-data-lakehouse-with-olake-presto) (v0.288 +) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | [Presto Guide](https://ibm.github.io/presto-iceberg-lab/lab-1/) | -| Apache Hive (v4.2.0) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | [Hive Docs](https://iceberg.apache.org/docs/latest/hive/) | -| Apache Impala (v5.0) | ❌ | ✅ | ❌ | ✅ | ✅ | ❌ | ✅ | ❌ | ✅ | [Impala Docs](https://impala.apache.org/docs/build/html/topics/impala_iceberg.html) | -| Dremio (v25/26) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [Dremio Docs](https://docs.dremio.com/dremio-cloud/bring-data/connect/catalogs/) | -| DuckDB (v1.2.1) | ✅ | ❌ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [DuckDB Docs](https://duckdb.org/docs/stable/extensions/iceberg/overview.html) | -| ClickHouse (v25.8 +) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | [ClickHouse Docs](https://clickhouse.com/docs/engines/table-engines/integrations/iceberg) | -| StarRocks (v4.0 +) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [StarRocks Docs](https://docs.starrocks.io/docs/quick_start/iceberg/) | -| Apache Doris (v3.1 +) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [Doris Docs](https://doris.apache.org/docs/dev/lakehouse/best-practices/doris-iceberg) | -| BigQuery (BigLake) | ✅ | ❌ | ❌ | ❌ | ❌ | ⚠️ | ❌ | ❌ | ❌ | [BigQuery Docs](https://docs.cloud.google.com/lakehouse/docs/about-cross-cloud-lakehouse) | -| Snowflake (GA) | ⚠️ | ❌ | ❌ | ⚠️ | ⚠️ | ⚠️ | ⚠️ | ⚠️ | ⚠️ | [Snowflake Docs](https://docs.snowflake.com/en/user-guide/tables-iceberg) | -| Databricks (Spark) | ✅ | ✅ | ✅ | ✅ | ✅ | ⚠️ | ✅ | ✅ | ✅ | [Databricks Docs](https://docs.databricks.com/external-access/iceberg) | -| AWS Redshift | ✅ | ❌ | ❌ | ❌ | ❌ | ⚠️ | ✅ | ✅ | ❌ | [Redshift Docs](https://docs.aws.amazon.com/redshift/latest/dg/querying-iceberg.html) | -| Azure Synapse Analytics | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | [Synapse Docs](https://learn.microsoft.com/en-us/azure/data-factory/format-iceberg) | +| Query Tool | AWS Glue | Hive Metastore | JDBC | REST Generic | Lakekeeper | Unity | Polaris | S3 Tables | Nessie | BigLake | Docs | +|-----------------------|--------|--------|--------|--------|------------|-------|---------|-----------|--------|--------|-------------------------------------------------------------------------------------------| +| Amazon Athena | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ✅ | ❌ | ❌ | [AWS Docs](https://docs.aws.amazon.com/athena/latest/ug/querying-iceberg.html) | +| Apache Spark (v3.3+) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [Spark Docs](https://iceberg.apache.org/docs/latest/spark-configuration/) | +| Apache Flink (v1.18+) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [Flink Docs](https://iceberg.apache.org/docs/latest/flink-configuration/) | +| Trino (v475 +) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [Trino Docs](https://trino.io/docs/current/object-storage/metastores.html) | +| Starburst Enterprise | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [Starburst Docs](https://docs.starburst.io/latest/object-storage/metastores.html) | +| [Presto](/blog/building-open-data-lakehouse-with-olake-presto) (v0.288 +) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | [Presto Guide](https://ibm.github.io/presto-iceberg-lab/lab-1/) | +| Apache Hive (v4.2.0) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | [Hive Docs](https://iceberg.apache.org/docs/latest/hive/) | +| Apache Impala (v5.0) | ❌ | ✅ | ❌ | ✅ | ✅ | ❌ | ✅ | ❌ | ✅ | ❌ | [Impala Docs](https://impala.apache.org/docs/build/html/topics/impala_iceberg.html) | +| Dremio (v25/26) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | x | [Dremio Docs](https://docs.dremio.com/dremio-cloud/bring-data/connect/catalogs/) | +| DuckDB (v1.2.1) | ✅ | ❌ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | x | [DuckDB Docs](https://duckdb.org/docs/stable/extensions/iceberg/overview.html) | +| ClickHouse (v25.8 +) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | x | [ClickHouse Docs](https://clickhouse.com/docs/engines/table-engines/integrations/iceberg) | +| StarRocks (v4.0 +) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | x | [StarRocks Docs](https://docs.starrocks.io/docs/quick_start/iceberg/) | +| Apache Doris (v3.1 +) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | x | [Doris Docs](https://doris.apache.org/docs/dev/lakehouse/best-practices/doris-iceberg) | +| BigQuery (BigLake) | ✅ | ❌ | ❌ | ❌ | ❌ | ⚠️ | ❌ | ❌ | ❌ | x | [BigQuery Docs](https://docs.cloud.google.com/lakehouse/docs/about-cross-cloud-lakehouse) | +| Snowflake (GA) | ⚠️ | ❌ | ❌ | ⚠️ | ⚠️ | ⚠️ | ⚠️ | ⚠️ | ⚠️ | x | [Snowflake Docs](https://docs.snowflake.com/en/user-guide/tables-iceberg) | +| Databricks (Spark) | ✅ | ✅ | ✅ | ✅ | ✅ | ⚠️ | ✅ | ✅ | ✅ | x | [Databricks Docs](https://docs.databricks.com/external-access/iceberg) | +| AWS Redshift | ✅ | ❌ | ❌ | ❌ | ❌ | ⚠️ | ✅ | ✅ | ❌ | x | [Redshift Docs](https://docs.aws.amazon.com/redshift/latest/dg/querying-iceberg.html) | +| Azure Synapse Analytics | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | x | [Synapse Docs](https://learn.microsoft.com/en-us/azure/data-factory/format-iceberg) | :::info Symbol Guide - ✅ — Query Engine connects to this catalog and reliably reads what OLake Go writes From 14a5c1d85714499dc56788449cef61f5d097014e Mon Sep 17 00:00:00 2001 From: Nayan Joshi Date: Wed, 12 Aug 2026 12:24:20 +0530 Subject: [PATCH 2/3] update half table with aprropriate values --- docs/understanding/compatibility-engines.mdx | 12 ++++++------ 1 file changed, 6 insertions(+), 6 deletions(-) diff --git a/docs/understanding/compatibility-engines.mdx b/docs/understanding/compatibility-engines.mdx index 67a02e31..20480474 100644 --- a/docs/understanding/compatibility-engines.mdx +++ b/docs/understanding/compatibility-engines.mdx @@ -16,16 +16,16 @@ You can query OLake Go Iceberg tables from multiple engines. The table below sho | Trino (v475 +) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [Trino Docs](https://trino.io/docs/current/object-storage/metastores.html) | | Starburst Enterprise | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [Starburst Docs](https://docs.starburst.io/latest/object-storage/metastores.html) | | [Presto](/blog/building-open-data-lakehouse-with-olake-presto) (v0.288 +) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | [Presto Guide](https://ibm.github.io/presto-iceberg-lab/lab-1/) | -| Apache Hive (v4.2.0) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | [Hive Docs](https://iceberg.apache.org/docs/latest/hive/) | +| Apache Hive (v4.2.0) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | (Not sure as it does not directly read from biglake catalog) | [Hive Docs](https://iceberg.apache.org/docs/latest/hive/) | | Apache Impala (v5.0) | ❌ | ✅ | ❌ | ✅ | ✅ | ❌ | ✅ | ❌ | ✅ | ❌ | [Impala Docs](https://impala.apache.org/docs/build/html/topics/impala_iceberg.html) | | Dremio (v25/26) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | x | [Dremio Docs](https://docs.dremio.com/dremio-cloud/bring-data/connect/catalogs/) | -| DuckDB (v1.2.1) | ✅ | ❌ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | x | [DuckDB Docs](https://duckdb.org/docs/stable/extensions/iceberg/overview.html) | -| ClickHouse (v25.8 +) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | x | [ClickHouse Docs](https://clickhouse.com/docs/engines/table-engines/integrations/iceberg) | +| DuckDB (v1.2.1) | ✅ | ❌ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [DuckDB Docs](https://duckdb.org/docs/stable/extensions/iceberg/overview.html) | +| ClickHouse (v25.8 +) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | [ClickHouse Docs](https://clickhouse.com/docs/engines/table-engines/integrations/iceberg) | | StarRocks (v4.0 +) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | x | [StarRocks Docs](https://docs.starrocks.io/docs/quick_start/iceberg/) | | Apache Doris (v3.1 +) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | x | [Doris Docs](https://doris.apache.org/docs/dev/lakehouse/best-practices/doris-iceberg) | -| BigQuery (BigLake) | ✅ | ❌ | ❌ | ❌ | ❌ | ⚠️ | ❌ | ❌ | ❌ | x | [BigQuery Docs](https://docs.cloud.google.com/lakehouse/docs/about-cross-cloud-lakehouse) | -| Snowflake (GA) | ⚠️ | ❌ | ❌ | ⚠️ | ⚠️ | ⚠️ | ⚠️ | ⚠️ | ⚠️ | x | [Snowflake Docs](https://docs.snowflake.com/en/user-guide/tables-iceberg) | -| Databricks (Spark) | ✅ | ✅ | ✅ | ✅ | ✅ | ⚠️ | ✅ | ✅ | ✅ | x | [Databricks Docs](https://docs.databricks.com/external-access/iceberg) | +| BigQuery (BigLake) | ✅ | ❌ | ❌ | ❌ | ❌ | ⚠️ | ❌ | ❌ | ❌ | ✅ | [BigQuery Docs](https://docs.cloud.google.com/lakehouse/docs/about-cross-cloud-lakehouse) | +| Snowflake (GA) | ⚠️ | ❌ | ❌ | ⚠️ | ⚠️ | ⚠️ | ⚠️ | ⚠️ | ⚠️ | ⚠️ | [Snowflake Docs](https://docs.snowflake.com/en/user-guide/tables-iceberg) | +| Databricks (Spark) | ✅ | ✅ | ✅ | ✅ | ✅ | ⚠️ | ✅ | ✅ | ✅ | ✅ | [Databricks Docs](https://docs.databricks.com/external-access/iceberg) | | AWS Redshift | ✅ | ❌ | ❌ | ❌ | ❌ | ⚠️ | ✅ | ✅ | ❌ | x | [Redshift Docs](https://docs.aws.amazon.com/redshift/latest/dg/querying-iceberg.html) | | Azure Synapse Analytics | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | x | [Synapse Docs](https://learn.microsoft.com/en-us/azure/data-factory/format-iceberg) | From cf308fe1678984ae14831fa7343cb5736beca1a8 Mon Sep 17 00:00:00 2001 From: Nayan Joshi Date: Thu, 13 Aug 2026 15:58:14 +0530 Subject: [PATCH 3/3] update complete table for biglake --- docs/understanding/compatibility-engines.mdx | 16 ++++++++-------- 1 file changed, 8 insertions(+), 8 deletions(-) diff --git a/docs/understanding/compatibility-engines.mdx b/docs/understanding/compatibility-engines.mdx index 20480474..41e5b5d8 100644 --- a/docs/understanding/compatibility-engines.mdx +++ b/docs/understanding/compatibility-engines.mdx @@ -15,19 +15,19 @@ You can query OLake Go Iceberg tables from multiple engines. The table below sho | Apache Flink (v1.18+) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [Flink Docs](https://iceberg.apache.org/docs/latest/flink-configuration/) | | Trino (v475 +) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [Trino Docs](https://trino.io/docs/current/object-storage/metastores.html) | | Starburst Enterprise | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [Starburst Docs](https://docs.starburst.io/latest/object-storage/metastores.html) | -| [Presto](/blog/building-open-data-lakehouse-with-olake-presto) (v0.288 +) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | [Presto Guide](https://ibm.github.io/presto-iceberg-lab/lab-1/) | -| Apache Hive (v4.2.0) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | (Not sure as it does not directly read from biglake catalog) | [Hive Docs](https://iceberg.apache.org/docs/latest/hive/) | +| [Presto](/blog/building-open-data-lakehouse-with-olake-presto) (v0.288 +) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ❌ | [Presto Guide](https://ibm.github.io/presto-iceberg-lab/lab-1/) | +| Apache Hive (v4.2.0) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | [Hive Docs](https://iceberg.apache.org/docs/latest/hive/) | | Apache Impala (v5.0) | ❌ | ✅ | ❌ | ✅ | ✅ | ❌ | ✅ | ❌ | ✅ | ❌ | [Impala Docs](https://impala.apache.org/docs/build/html/topics/impala_iceberg.html) | -| Dremio (v25/26) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | x | [Dremio Docs](https://docs.dremio.com/dremio-cloud/bring-data/connect/catalogs/) | -| DuckDB (v1.2.1) | ✅ | ❌ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [DuckDB Docs](https://duckdb.org/docs/stable/extensions/iceberg/overview.html) | +| Dremio (v25/26) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [Dremio Docs](https://docs.dremio.com/dremio-cloud/bring-data/connect/catalogs/) | +| DuckDB (v1.2.1) | ✅ | ❌ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | [DuckDB Docs](https://duckdb.org/docs/stable/extensions/iceberg/overview.html) | | ClickHouse (v25.8 +) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | [ClickHouse Docs](https://clickhouse.com/docs/engines/table-engines/integrations/iceberg) | -| StarRocks (v4.0 +) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | x | [StarRocks Docs](https://docs.starrocks.io/docs/quick_start/iceberg/) | -| Apache Doris (v3.1 +) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | x | [Doris Docs](https://doris.apache.org/docs/dev/lakehouse/best-practices/doris-iceberg) | +| StarRocks (v4.0 +) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [StarRocks Docs](https://docs.starrocks.io/docs/quick_start/iceberg/) | +| Apache Doris (v3.1 +) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [Doris Docs](https://doris.apache.org/docs/dev/lakehouse/best-practices/doris-iceberg) | | BigQuery (BigLake) | ✅ | ❌ | ❌ | ❌ | ❌ | ⚠️ | ❌ | ❌ | ❌ | ✅ | [BigQuery Docs](https://docs.cloud.google.com/lakehouse/docs/about-cross-cloud-lakehouse) | | Snowflake (GA) | ⚠️ | ❌ | ❌ | ⚠️ | ⚠️ | ⚠️ | ⚠️ | ⚠️ | ⚠️ | ⚠️ | [Snowflake Docs](https://docs.snowflake.com/en/user-guide/tables-iceberg) | | Databricks (Spark) | ✅ | ✅ | ✅ | ✅ | ✅ | ⚠️ | ✅ | ✅ | ✅ | ✅ | [Databricks Docs](https://docs.databricks.com/external-access/iceberg) | -| AWS Redshift | ✅ | ❌ | ❌ | ❌ | ❌ | ⚠️ | ✅ | ✅ | ❌ | x | [Redshift Docs](https://docs.aws.amazon.com/redshift/latest/dg/querying-iceberg.html) | -| Azure Synapse Analytics | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | x | [Synapse Docs](https://learn.microsoft.com/en-us/azure/data-factory/format-iceberg) | +| AWS Redshift | ✅ | ❌ | ❌ | ❌ | ❌ | ⚠️ | ✅ | ✅ | ❌ | ❌ | [Redshift Docs](https://docs.aws.amazon.com/redshift/latest/dg/querying-iceberg.html) | +| Azure Synapse Analytics | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ❌ | [Synapse Docs](https://learn.microsoft.com/en-us/azure/data-factory/format-iceberg) | :::info Symbol Guide - ✅ — Query Engine connects to this catalog and reliably reads what OLake Go writes