⚡ Caught by PythonWatcher · 4h ago
Senior Software Engineer – Data Engineering & DevOps (Python)
location United Stateslevel senior
Posted on LinkedIndirect hiring post
About the Role
We are looking for a Senior Software Engineer – Data Engineering & DevOps (Python) to design, build, and optimize scalable data pipelines and AWS-based cloud infrastructure for enterprise applications.
Key Responsibilities
• Design, develop, and maintain scalable data engineering pipelines and cloud backend architectures
• Build and optimize Apache Spark, PySpark, and Databricks workloads for large-scale data processing
• Provision, manage, and monitor AWS cloud infrastructure and data clusters
• Develop clean, maintainable Python code with comprehensive unit and integration tests
• Implement CI/CD, GitOps, and automated deployment pipelines
• Optimize cloud infrastructure for scalability, reliability, performance, and cost efficiency
• Work with relational and NoSQL databases to process and manage large datasets
Requirements
• 4–7 years of professional software development experience
• Expert-level Python
• Strong Data Engineering experience
• Apache Spark / PySpark
• Databricks
• AWS EMR & EMR Serverless
• AWS Lambda
• AWS Step Functions
• Amazon S3
• AWS Cloud Services
• DevOps & CI/CD
• GitOps
• SQL & NoSQL Databases
• PostgreSQL
• MongoDB
• Elasticsearch
• Unit Testing & Integration Testing
• REST APIs
• High-Performance & Scalable System Design
SKILLS MENTIONED
PythonData EngineeringApache SparkPySparkDatabricksAWS EMRAWS EMR ServerlessAWS Lambda
Your application is already draftedCover letter + CV tailored to this post. Review it, then send — nothing goes out without your click.
Apply to this role