Ph3Overview /h3pJoin to apply for the bData Engineer /b role at bNTT DATA Europe Latam /b /ppOur client is a leading payment system company specializing in designing and building real-time, account-based payment infrastructures, applications, and services. They are committed to innovation and excellence, constantly driving the evolution of payment solutions in a dynamic and growing industry. /ppWe are seeking a highly skilled Data Engineer to enhance our data and analytics environments. The successful candidate will play a pivotal role in designing, developing, and managing data solutions that leverage cloud technologies and big data frameworks. This role will involve creating efficient data pipelines, optimizing data storage solutions, and implementing robust data processing workflows to ensure high-quality data availability for analytics and business intelligence. /ph3What You'll Be Doing /h3ulliCreate and manage ETL processes using Azure Data Factory to automate data flow between various systems and services /liliImplement data storage solutions using Azure Data Lake and Cosmos DB, ensuring high availability and scalability /liliDesign and optimize data processes in Databricks, implementing Spark jobs that utilize Delta Lake for efficient data handling and versioning /liliBuild and maintain analytics models that can harness the capabilities of Delta Lake for better data quality and performance /liliDevelop scripts in Python and PowerShell to automate operational tasks, deployments, and monitoring of data workflows /liliCollaborate with development teams to integrate CI/CD practices using Azure DevOps and Git for version control /liliManage and optimize MS SQL Server databases, writing efficient T-SQL queries for data manipulation and reporting /liliEnsure data integrity and security through proper database management practices /liliImplement logging and monitoring solutions to proactively address any issues impacting data applications and workflows /liliConduct root cause analysis on data-related problems and develop solutions to mitigate future occurrences /liliCollaborate with business intelligence teams to create and share reports using Power BI /liliProvide insights and recommendations based on data analysis to guide business decisions /li /ulh3What You'll Bring Along /h3ulliBachelor’s degree in Computer Science, Information Technology, or a related field is preferred /liliMinimum of 3-5 years of experience in a similar role /liliProficiency in Python for data processing and automation /liliExperience with PowerShell scripting and Azure Data Factory /liliStrong understanding of MS SQL Server and T-SQL for database scripting /liliFamiliarity with Databricks, Delta Lake, Azure Data Lake, and Cosmos DB /liliExperience with version control using Git and CI/CD frameworks inAzure DevOps /liliSolid problem-solving skills and ability to troubleshoot complex data issues /liliFamiliarity with DevOps methodologies including Scrum and Agile practices for software development /liliExperience creating dashboards and reports using Power BI and Knowledge of data governance and data security best practices /liliExcellent command of both spoken and written English /li /ulh3Seniority level /h3ulliAssociate /li /ulh3Employment type /h3ulliFull-time /li /ulh3Job function /h3ulliInformation Technology /li /ulh3Industries /h3ulliIT Services and IT Consulting /li /ul /p #J-18808-Ljbffr