21 feb
Citi
Xico
**Key Responsibilities**:
Design, develop, and optimize big data processing pipelines using Apache Spark and Java.
Work on batch and real-time data processing frameworks to transform large datasets.
Write high-performance Spark jobs using RDDs, DataFrames, and Datasets.
Collaborate with data engineers, architects, and analysts to ensure seamless data integration.
Optimize Spark performance through tuning, partitioning, and efficient memory management.
Implement best practices for data governance, security, and compliance.
Work with CI/CD pipelines, version control (Git), and automation tools for continuous deployment.
**Required Skills**:
Strong experience in Java 5+,
with expertise in functional programming and concurrency.
Hands-on experience with Apache Spark (Spark Core, Spark SQL, Spark Streaming).
Good understanding of Hadoop ecosystem, including HDFS, Hive, and YARN.
Experience with Big Data frameworks like Kafka, Flink, or Airflow is a plus.
Knowledge of SQL and NoSQL databases (e.g., PostgreSQL, MongoDB, Cassandra).
Experience working with cloud platforms (AWS EMR, Azure Databricks, GCP DataProc).
Familiarity with containerization (Docker, Kubernetes) and orchestration tools.
Strong problem-solving and debugging skills in a distributed computing environment.
Knowledge of CI/CD pipelines, Git, and automated deployment strategie
**Education**:
- Bachelor's degree/University degree or equivalent experience
This job description provides a high-level review of the types of work performed.
Other job-related duties may be assigned as required.
**Job Family Group**:
Technology
- **Job Family**:
Applications Development
- **Time Type**:
Full time
- Citi is an equal opportunity and affirmative action employer.
Qualified applicants will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
View the "**EEO is the Law**" poster.
View the **EEO is the Law Supplement**.
View the **EEO Policy Statement**.
View the **Pay Transparency Posting
Muestra tus habilidades a la empresa, rellenar el formulario y deja un toque personal en la carta, ayudará el reclutador en la elección del candidato.