Job Title: Data Engineer
Date: 20-12-2022
Location: London,UK
Employment Type: Full-time
Experience Level: 3+ Years
Job Description:
We are seeking a skilled and motivated Data Engineer to join our team. As a Data Engineer, you will play a pivotal role in designing, developing, and maintaining our data infrastructure, ensuring data availability, quality, and reliability. You will work closely with our data analysts, data scientists, and other stakeholders to build efficient data pipelines and support our data-driven decision-making process.
Responsibilities:
- Collaborate with data scientists and analysts to understand data requirements and design appropriate data models and architectures.
- Develop and maintain ETL (Extract, Transform, Load) processes and data pipelines to ingest, process, and transform data from various sources.
- Ensure data quality and integrity through data validation, cleansing, and data quality monitoring.
- Optimize and tune database queries and data processing workflows for performance.
- Implement and manage data storage solutions, including data warehouses, data lakes, and databases.
- Work with big data technologies such as Hadoop, Spark, and NoSQL databases.
- Troubleshoot data-related issues and provide timely solutions.
- Stay up-to-date with emerging data engineering trends and technologies to drive innovation and efficiency.
- Collaborate with cross-functional teams to understand business requirements and deliver data solutions that meet those needs.
Qualifications:
- Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
- Proven experience as a Data Engineer or in a similar role.
- Proficiency in programming languages like Python, Java, or Scala.
- Strong SQL skills and experience with database technologies (PostgreSQL, MySQL, Oracle).
- Experience with ETL tools and frameworks (Apache NiFi, Apache Beam).
- Familiarity with big data technologies (Hadoop, Spark, Hive, HBase).
- Knowledge of data warehousing concepts and cloud-based data storage solutions (AWS, Azure, GCP).
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills.
How to Apply:
If you are a passionate and results-driven Data Engineer looking to make a significant impact, we encourage you to apply. Please submit your resume, a cover letter outlining your relevant experience, and any relevant certifications to [email protected]