Design, Build and optimize batch and streaming data pipelines with strong performance, fault tolerance, and observability using Python, Spark, and Clickhouse. Develop and operate workflow orchestration with Apache Airflow to schedule, monitor, and...