Função: Data Engineer/PySpark/Python/SQL

Local : Lisboa

Senior

Inglês B2

Data de início: Imediato

Duração da contratação: 1 ano

Data Engineer with deep expertise in PySpark, Python, and SQL. You will be responsible for designing and maintaining complex, high-performance data pipelines in distributed environments. This is a role for someone who lives and breathes scalable data processing and knows these tools at an advanced, expert level.

Key responsibilities:

• Build and optimize large-scale data pipelines using PySpark in distributed systems.
• Write advanced, production-level Python code for data transformation and orchestration.
• Design and implement highly efficient SQL queries and data models.
• Ensure best practices for performance, reliability, and maintainability.

Your Profile

• You are an expert in PySpark: not just using it, but deeply understanding performance tuning, partitioning, shuffles, and optimizations.
• You are an expert in Python: you write clean, modular, production-grade code for data engineering tasks.
• You are an expert in SQL: capable of writing and optimizing complex queries on large datasets with ease.
• You have a proven track record of working on complex data workflows in real-world production environments.
• You are detail-oriented, self-driven, and thrive in technically challenging environments.

 This role is only for candidates with proven, hands-on expertise in all three: PySpark, Python, and SQL.