Skip to content

Releases: dataflint/spark

Version 0.9.3

27 Apr 05:43
2739300

Choose a tag to compare

What's Changed

  • sqlNodes instrumentation for spark<3.2 is disabled. by @minskya in #67

Full Changelog: v0.9.2...v0.9.3

Version 0.9.2

23 Apr 18:19
0f370d7

Choose a tag to compare

What's Changed

  • [DATAFLINT-4798] problem with codegen support on spark<3.2 by @minskya in #66

Full Changelog: v0.9.1...v0.9.2

Version 0.9.1

23 Apr 17:20
4990d5d

Choose a tag to compare

What's Changed

  • [DATAFLINT-4798] Fix history server support for older Spark apps (pre-3.2) by @minskya in #65

Full Changelog: v0.9.0...v0.9.1

Version 0.9.0

21 Apr 07:24
b161400

Choose a tag to compare

What's Changed

  • Fix duration metric accuracy: RDD timing, codegen try/finally, per-partition write timing by @minskya in #63
  • Footer improvements, duration fix, and version bump to 0.9.0 by @minskya in #64

Full Changelog: v0.8.9...v0.9.0

Version 0.8.9

16 Apr 17:30
c8f3730

Choose a tag to compare

What's Changed

  • Add TPC-DS benchmark CI workflow with DataFlint plugin verification by @minskya in #60
  • Claude/fix tpcds ci errors by @minskya in #61
  • [DATAFLINT-4425] - duration instrumentation on all nodes by @minskya in #58

Full Changelog: v0.8.8...v0.8.9

Version 0.8.8

22 Mar 16:05
261fd3f

Choose a tag to compare

What's Changed

  • fixed add instrumentation for MapInPandas for versions<3.5 by @minskya in #56
  • added suppport for parsing bigQuery data by @minskya in #53

Full Changelog: v0.8.7...v0.8.8

Version 0.8.7

17 Mar 17:47

Choose a tag to compare

What's Changed

  • local docker-compose.yml to generate local docker with dataflint inst… by @minskya in #51
  • duration instrtumentation by @minskya in #50
  • Release process by @minskya in #49

Full Changelog: v0.8.6...v0.8.7

Version 0.8.6

12 Mar 11:37

Choose a tag to compare

Window function instrumentation - experimental
Fixing UI crash when a query has no nodes in plan

Version 0.8.5

17 Feb 17:27

Choose a tag to compare

Supporting UDF instrumentation for spark 3.0 and 3.1
Performance improvement for UDF instrumentation

Full Changelog: v0.8.4...v0.8.5

Version 0.8.4

15 Feb 21:05

Choose a tag to compare

  1. New spark instrumentation - spark.dataflint.instrument.spark.mapInArrow.enabled and spark.dataflint.instrument.spark.mapInPandas.enabled, which adds duration metrics to all spark versions 3.3+ with these new operators. So you cna know exactly how much a UDF took.
  2. Add full table name to iceberg table reads

Full Changelog: v0.8.3...v0.8.4