PpbProject description /b /ppWe are seeking an expert with deep proficiency as a Platform Engineer, possessing experience in data engineering. This individual should have a comprehensive understanding of both data platforms and software engineering, enabling them to integrate the platform effectively within an IT ecosystem. /ppResponsibilities /ppManage and optimize data platforms (Databricks, Palantir). /ppEnsure high availability, security, and performance of data systems. /ppProvide valuable insights about data platform usage. /ppOptimize computing and storage for large-scale data processing. /ppDesign and maintain system libraries (Python) used in ETL pipelines and platform governance. /ppOptimize ETL Processes – Enhance and tune existing ETL processes for better performance, scalability, and reliability. /ppSkills /ppbMust have /b /pulliMinimum 10 Years of experience in IT / Data. /liliMinimum 5 years of experience as a Data Platform Engineer / Data Engineer. /liliBachelor's in IT or related field. /liliInfrastructure Cloud : Azure, AWS (expertise in storage, networking, compute). /liliData Platform Tools : Any of Palantir, Databricks, Snowflake. /liliProgramming : Proficiency in PySpark for distributed computing and Python for ETL development. /liliSQL : Expertise in writing and optimizing SQL queries, preferably with experience in databases such as PostgreSQL, MySQL, Oracle, or Snowflake. /liliData Warehousing : Experience working with data warehousing concepts and platforms, ideally Databricks. /liliETL Tools : Familiarity with ETL tools processes /liliData Modelling : Experience with dimensional modelling, normalization / denormalization, and schema design. /liliVersion Control : Proficiency with version control tools like Git to manage codebases and collaborate on development. /liliData Pipeline Monitoring : Familiarity with monitoring tools (e.g., Prometheus, Grafana, or custom monitoring scripts) to track pipeline performance. /liliData Quality Tools : Experience implementing data validation, cleaning, and quality frameworks, ideally Monte Carlo. /li /ulpNice to have /ppContainerization Orchestration : Docker, Kubernetes. /ppInfrastructure as Code (IaC) : Terraform. /ppUnderstanding of Investment Data domain (desired). /ppWe offer numerous benefits such as : /pp⏰ Flexible work schedule /p /p