Python Data Engineer

About the Role We are seeking a well-rounded and highly motivated Python Data Engineer specializing in DevOps to join a dynamic Product Workflow Tools team. This role focuses on building, scaling, and automating high-performance data pipelines and enterprise cloud solutions. Key Responsibilities • Design, build, and maintain high-performance data engineering pipelines and cloud backend architectures. • Provision, manage, and monitor cloud clusters and data components on AWS. • Develop, test, and deploy clean, maintainable Python code adhering to enterprise coding standards. • Create unit tests, integration tests, automated test suites, and deployment scripts to maintain quality. • Implement full continuous integration, continuous delivery (CI/CD), and GitOps workflows for data infrastructure. • Optimize infrastructure and pipeline design for massive scalability, high reliability, and cost-efficiency. • Work with relational and NoSQL databases to store, index, and query large datasets effectively. Requirements • Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field. • 4 to 7 years of professional software development experience, with a focus on data engineering. • Expert-level proficiency in Python as the primary programming language. • Deep expertise in Apache Spark, Databricks, and AWS EMR. • Hands-on mastery of AWS services, specifically S3, AWS Lambda, EMR Serverless, and Step Functions. • Practical experience with GitOps, CI/CD automated deployment pipelines, and cloud cluster monitoring/provisioning. • Familiarity with relational and NoSQL database systems (e.g., PostgreSQL, Elasticsearch, MongoDB). • Proven track record of building solutions for high scalability, performance optimization, and cloud cost management.