diff --git a/docs/understanding/compatibility-engines.mdx b/docs/understanding/compatibility-engines.mdx index 361afe62..41e5b5d8 100644 --- a/docs/understanding/compatibility-engines.mdx +++ b/docs/understanding/compatibility-engines.mdx @@ -8,26 +8,26 @@ sidebar_label: Compatibility with Query Engines You can query OLake Go Iceberg tables from multiple engines. The table below shows catalog compatibility at a glance, with links to setup guides. -| Query Tool | AWS Glue | Hive Metastore | JDBC | REST Generic | Lakekeeper | Unity | Polaris | S3 Tables | Nessie | Docs | -|-----------------------|--------|--------|--------|--------|------------|-------|---------|-----------|--------|-------------------------------------------------------------------------------------------| -| Amazon Athena | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ✅ | ❌ | [AWS Docs](https://docs.aws.amazon.com/athena/latest/ug/querying-iceberg.html) | -| Apache Spark (v3.3+) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [Spark Docs](https://iceberg.apache.org/docs/latest/spark-configuration/) | -| Apache Flink (v1.18+) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [Flink Docs](https://iceberg.apache.org/docs/latest/flink-configuration/) | -| Trino (v475 +) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [Trino Docs](https://trino.io/docs/current/object-storage/metastores.html) | -| Starburst Enterprise | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [Starburst Docs](https://docs.starburst.io/latest/object-storage/metastores.html) | -| [Presto](/blog/building-open-data-lakehouse-with-olake-presto) (v0.288 +) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | [Presto Guide](https://ibm.github.io/presto-iceberg-lab/lab-1/) | -| Apache Hive (v4.2.0) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | [Hive Docs](https://iceberg.apache.org/docs/latest/hive/) | -| Apache Impala (v5.0) | ❌ | ✅ | ❌ | ✅ | ✅ | ❌ | ✅ | ❌ | ✅ | [Impala Docs](https://impala.apache.org/docs/build/html/topics/impala_iceberg.html) | -| Dremio (v25/26) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [Dremio Docs](https://docs.dremio.com/dremio-cloud/bring-data/connect/catalogs/) | -| DuckDB (v1.2.1) | ✅ | ❌ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [DuckDB Docs](https://duckdb.org/docs/stable/extensions/iceberg/overview.html) | -| ClickHouse (v25.8 +) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | [ClickHouse Docs](https://clickhouse.com/docs/engines/table-engines/integrations/iceberg) | -| StarRocks (v4.0 +) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [StarRocks Docs](https://docs.starrocks.io/docs/quick_start/iceberg/) | -| Apache Doris (v3.1 +) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [Doris Docs](https://doris.apache.org/docs/dev/lakehouse/best-practices/doris-iceberg) | -| BigQuery (BigLake) | ✅ | ❌ | ❌ | ❌ | ❌ | ⚠️ | ❌ | ❌ | ❌ | [BigQuery Docs](https://docs.cloud.google.com/lakehouse/docs/about-cross-cloud-lakehouse) | -| Snowflake (GA) | ⚠️ | ❌ | ❌ | ⚠️ | ⚠️ | ⚠️ | ⚠️ | ⚠️ | ⚠️ | [Snowflake Docs](https://docs.snowflake.com/en/user-guide/tables-iceberg) | -| Databricks (Spark) | ✅ | ✅ | ✅ | ✅ | ✅ | ⚠️ | ✅ | ✅ | ✅ | [Databricks Docs](https://docs.databricks.com/external-access/iceberg) | -| AWS Redshift | ✅ | ❌ | ❌ | ❌ | ❌ | ⚠️ | ✅ | ✅ | ❌ | [Redshift Docs](https://docs.aws.amazon.com/redshift/latest/dg/querying-iceberg.html) | -| Azure Synapse Analytics | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | [Synapse Docs](https://learn.microsoft.com/en-us/azure/data-factory/format-iceberg) | +| Query Tool | AWS Glue | Hive Metastore | JDBC | REST Generic | Lakekeeper | Unity | Polaris | S3 Tables | Nessie | BigLake | Docs | +|-----------------------|--------|--------|--------|--------|------------|-------|---------|-----------|--------|--------|-------------------------------------------------------------------------------------------| +| Amazon Athena | ✅ | ❌ | ❌ | ❌ | ❌ | ❌ | ❌ | ✅ | ❌ | ❌ | [AWS Docs](https://docs.aws.amazon.com/athena/latest/ug/querying-iceberg.html) | +| Apache Spark (v3.3+) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [Spark Docs](https://iceberg.apache.org/docs/latest/spark-configuration/) | +| Apache Flink (v1.18+) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [Flink Docs](https://iceberg.apache.org/docs/latest/flink-configuration/) | +| Trino (v475 +) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [Trino Docs](https://trino.io/docs/current/object-storage/metastores.html) | +| Starburst Enterprise | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [Starburst Docs](https://docs.starburst.io/latest/object-storage/metastores.html) | +| [Presto](/blog/building-open-data-lakehouse-with-olake-presto) (v0.288 +) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ❌ | [Presto Guide](https://ibm.github.io/presto-iceberg-lab/lab-1/) | +| Apache Hive (v4.2.0) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | [Hive Docs](https://iceberg.apache.org/docs/latest/hive/) | +| Apache Impala (v5.0) | ❌ | ✅ | ❌ | ✅ | ✅ | ❌ | ✅ | ❌ | ✅ | ❌ | [Impala Docs](https://impala.apache.org/docs/build/html/topics/impala_iceberg.html) | +| Dremio (v25/26) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [Dremio Docs](https://docs.dremio.com/dremio-cloud/bring-data/connect/catalogs/) | +| DuckDB (v1.2.1) | ✅ | ❌ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | [DuckDB Docs](https://duckdb.org/docs/stable/extensions/iceberg/overview.html) | +| ClickHouse (v25.8 +) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | [ClickHouse Docs](https://clickhouse.com/docs/engines/table-engines/integrations/iceberg) | +| StarRocks (v4.0 +) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [StarRocks Docs](https://docs.starrocks.io/docs/quick_start/iceberg/) | +| Apache Doris (v3.1 +) | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | [Doris Docs](https://doris.apache.org/docs/dev/lakehouse/best-practices/doris-iceberg) | +| BigQuery (BigLake) | ✅ | ❌ | ❌ | ❌ | ❌ | ⚠️ | ❌ | ❌ | ❌ | ✅ | [BigQuery Docs](https://docs.cloud.google.com/lakehouse/docs/about-cross-cloud-lakehouse) | +| Snowflake (GA) | ⚠️ | ❌ | ❌ | ⚠️ | ⚠️ | ⚠️ | ⚠️ | ⚠️ | ⚠️ | ⚠️ | [Snowflake Docs](https://docs.snowflake.com/en/user-guide/tables-iceberg) | +| Databricks (Spark) | ✅ | ✅ | ✅ | ✅ | ✅ | ⚠️ | ✅ | ✅ | ✅ | ✅ | [Databricks Docs](https://docs.databricks.com/external-access/iceberg) | +| AWS Redshift | ✅ | ❌ | ❌ | ❌ | ❌ | ⚠️ | ✅ | ✅ | ❌ | ❌ | [Redshift Docs](https://docs.aws.amazon.com/redshift/latest/dg/querying-iceberg.html) | +| Azure Synapse Analytics | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ❌ | [Synapse Docs](https://learn.microsoft.com/en-us/azure/data-factory/format-iceberg) | :::info Symbol Guide - ✅ — Query Engine connects to this catalog and reliably reads what OLake Go writes