Senior Data Engineer
Posted Updated
Description
Y-Axis is seeking a senior data engineer to design and maintain robust data pipelines in a Databricks-centric environment. You will work with Delta Lake, Unity Catalog, and Lakeflow Declarative Pipelines to enable scalable data lakehouse architectures.
You will optimize PySpark workloads, write complex SQL, and monitor performance using Spark UI/ Photon, while ensuring data quality and governance with best practices and CI/CD on cloud platforms.
6+ years of data engineering experience. Last 3+ years using Databricks in production. Experience with Lakehouse architectures (Delta Lake, Unity Catalog). Strong Python, PySpark and SQL; proficient in Spark UI/Photon for performance diagnostics.Skills
Sign in to read and join the discussion.