pyspark 操作 Delta Lake 工具类

以下是使用PySpark操作Delta Lake的工具类的示例代码：

from pyspark.sql import SparkSession

class DeltaLakeUtil:
    def __init__(self, spark: SparkSession):
        self.spark = spark

    def read_delta_table(self, table_path: str):
        return self.spark.read.format("delta").load(table_path)

    def write_delta_table(self, df, table_path: str, mode: str = "overwrite"):
        df.write.format("delta").mode(mode).save(table_path)
    def merge_delta_table(self, source_df, target_path: str, merge_condition: str):
        source_df.write.format("delta").mode("append").option("mergeSchema", "true").option("mergeCondition", merge_condition).save(target_path)

DeltaLakeUtil是一个工具类，用于读取、写入和合并Delta Lake表。使用该工具类，您可以轻松地在PySpark中操作Delta Lake表。