Data Engineer

We are seeking a highly skilled and passionate Data Engineer to join our dynamic team. In this role, you will be instrumental in designing, building, and optimizing our data infrastructure, ensuring robust and scalable data solutions that drive critical business insights within the Information Technology and Services sector.

Responsibilities

• Design, develop, and maintain scalable data pipelines for ingestion, transformation, and loading.
• Implement and optimize ETL/ELT processes using various data integration tools and technologies.
• Collaborate with data scientists and analysts to understand data requirements and deliver reliable datasets.
• Ensure data quality, integrity, and security across all data platforms.
• Monitor and troubleshoot data infrastructure, resolving performance bottlenecks and operational issues.
• Develop and maintain documentation for data architectures, pipelines, and processes.

Qualifications

• A Bachelor's Degree in Computer Science, Software Engineering, or a closely related field.
• Minimum of 3 years of professional experience as a Data Engineer or in a similar role.
• Strong proficiency in Python or Java for data manipulation and scripting.
• Expertise in SQL and experience with both relational and NoSQL databases.
• Familiarity with cloud data platforms such as AWS, Azure, or Google Cloud Platform.
• Experience working with big data technologies like Apache Spark or Hadoop.

Additional Advantages

• Experience with data streaming technologies like Apache Kafka.
• Knowledge of data governance and data security best practices.
• Cloud certifications related to data engineering (e.g., AWS Certified Data Analytics).
• Familiarity with CI/CD pipelines for data solutions.
• Understanding of machine learning pipelines and MLOps.

Skills

• Python
• SQL
• ETL/ELT
• Data Warehousing
• Cloud Computing
• Big Data
• Data Modeling