27 feb
Epam Systems
Nuevo Casas Grandes
.We are seeking a highly skilled and experienced **Lead Data Software** **Engineer **to lead our data engineering team in the design, implementation, and maintenance of our data platform.RESPONSIBILITIES- Collaborate with Solution Architects to design and build a configuration/metadata-driven framework for data transformation and orchestration- Develop and implement a Data Ingestion Framework, identifying patterns for initial and incremental data loads- Guide the data engineering team in adopting best practices for data processing,
ensuring scalability and maintainability of the data platform- Oversee the documentation of all data engineering processes and frameworks for knowledge sharing and future reference- Collaborate with DevOps Team to deploy & configure required infrastructure components, connect to Data Source, enable CI/CD, and deliver pipelines implementation (framework)**REQUIREMENTS**:- Data Architectural mindset- Hands-on coding experience of Databricks Jobs with Python, PySpark- Hands-on experience with Data Lake or Data Platform implementation- Good understanding of relational and NoSQL data stores, methods, and approaches (star and snowflake, dimensional modeling)- Experience in Azure cloud data platform, namely Azure Databricks, Delta Lake, ADSL2, Azure Data Factory, Azure SQL Database, Azure Functions- Proven experience in leading data engineering teams- Background or Excessive Knowledge in designing and implementing metadata-driven frameworks for data transformation and orchestration- Expertise in developing data ingestion strategies for handling both initial and incremental data loads
Muestra tus habilidades a la empresa, rellenar el formulario y deja un toque personal en la carta, ayudará el reclutador en la elección del candidato.