Data Engineer

About this role

Job Title: Data Engineer We are looking for a skilled Data Engineer with strong analytical thinking and experience building scalable data pipelines, performing exploratory data analysis, and working with both structured and unstructured data. In this role, you will help transform raw information into reliable, high-quality datasets that support research, analytics, and AI/ML model development. Exposure to machine-learning tools and AI technologies is highly valuable.

Skills

Key responsibilities

• Design, develop, and maintain scalable ETL pipelines.
• Collect, clean, transform, and organize structured and unstructured data.
• Conduct exploratory data analysis to identify trends, patterns, anomalies, and data-quality issues.
• Collaborate with researchers, data scientists, and engineering teams to prepare datasets for AI and machine-learning initiatives.
• Develop and maintain data models, database schemas, and data-storage solutions.
• Write and optimize SQL queries for data extraction, transformation, and analysis.
• Ensure data quality, integrity, consistency, and security across pipelines and databases.
• Automate data validation, reporting, and recurring data processing workflows.
• Document data pipelines, processes, and technical decisions.
• Troubleshoot pipeline failures and resolve data-related issues.

Required skills & qualifications

• Strong proficiency in Python and SQL.
• Hands-on experience designing and maintaining ETL pipelines.
• Experience conducting exploratory data analysis.
• Proficiency with Python data-processing libraries such as Pandas and NumPy.
• Experience working with relational databases, particularly PostgreSQL and MySQL.
• Strong understanding of data modeling, database schemas, and data transformation.
• Ability to work with both structured and unstructured datasets.
• Experience ensuring data accuracy, quality, and reliability.
• Familiarity with development environments such as Jupyter Notebook, VS Code, or PyCharm.
• Strong analytical, problem-solving, and communication skills.

Preferred qualifications

• Exposure to AI and machine-learning workflows.
• Familiarity with tools and libraries such as scikit-learn.
• Experience working with Hugging Face Transformers.
• Familiarity with the OpenAI API or similar AI platforms.
• Experience preparing and managing datasets used for AI/ML model development.
• Previous experience collaborating with researchers or data scientists.