Databricks launches LakeFlow to help its customers build their data pipelines (techcrunch.com) 9 points by ctc24 2y ago ↗ HN
[–] datavirtue 2y ago ↗ No mention of data lineage, governance or logging. [–] memhole 2y ago ↗ Their Unity Catalog covers lineage and governance. Logging is still pretty bad last time I used it. But that’s more of PySpark issue with only the driver logs being collected.
[–] memhole 2y ago ↗ Their Unity Catalog covers lineage and governance. Logging is still pretty bad last time I used it. But that’s more of PySpark issue with only the driver logs being collected.
2 comments
[ 3.3 ms ] story [ 14.8 ms ] thread