Releases: dataflint/spark
Releases · dataflint/spark
Version 0.9.3
What's Changed
Full Changelog: v0.9.2...v0.9.3
Version 0.9.2
What's Changed
Full Changelog: v0.9.1...v0.9.2
Version 0.9.1
What's Changed
Full Changelog: v0.9.0...v0.9.1
Version 0.9.0
What's Changed
- Fix duration metric accuracy: RDD timing, codegen try/finally, per-partition write timing by @minskya in #63
- Footer improvements, duration fix, and version bump to 0.9.0 by @minskya in #64
Full Changelog: v0.8.9...v0.9.0
Version 0.8.9
Version 0.8.8
What's Changed
- fixed add instrumentation for MapInPandas for versions<3.5 by @minskya in #56
- added suppport for parsing bigQuery data by @minskya in #53
Full Changelog: v0.8.7...v0.8.8
Version 0.8.7
Version 0.8.6
Window function instrumentation - experimental
Fixing UI crash when a query has no nodes in plan
Version 0.8.5
Supporting UDF instrumentation for spark 3.0 and 3.1
Performance improvement for UDF instrumentation
Full Changelog: v0.8.4...v0.8.5
Version 0.8.4
- New spark instrumentation - spark.dataflint.instrument.spark.mapInArrow.enabled and spark.dataflint.instrument.spark.mapInPandas.enabled, which adds duration metrics to all spark versions 3.3+ with these new operators. So you cna know exactly how much a UDF took.
- Add full table name to iceberg table reads
Full Changelog: v0.8.3...v0.8.4