International Data Group

Senior Data Engineer

Job Locations CZ-Prague | CZ-Ostrava
Job Post Information* : Posted Date 1 month ago(4/4/2024 3:42 AM)
ID
2024-5217
# of Openings
1
Job Category
Data & Analytics

Overview

Join a team that is building a leading intelligence platform for IT vendors!

 

IDC is looking for a skilled, motivated, and dedicated Senior Data Engineer to help build some of the most advanced cloud-based data products. In this role, you will design and launch innovative analytical products through data operations. You will have the opportunity to showcase your industry-leading data design skills, work within a standard product development lifecycle, and collaborate with multiple development teams.

 

We are looking for someone with experience working with large data sets and data pipelines and who can lead a team of talented and visionary individuals.

Responsibilities

  • Design the architecture for ingesting, cleaning, transforming, and loading data from source to destination.
  • Design the workflow for entity profile collection process and entity data flow between products.
  • Prototype end-to-end data operation pipeline; test and QA the pipeline; productionize the pipeline.
  • Integrate and reconcile independent data sources and APIs into a single source.
  • Create automated matching tools to identify entity duplication and entity attribute alignment.
  • Develop data models leveraging statistical and mathematical methods.
  • Monitor data quality and maintain pipeline in development, QA and production environments.
  • Draw insights from data and clearly communicate them (verbal/written) to the stakeholders and senior management as required.
  • Communicate with technical teams and management to collect requirements, describe data modeling decisions and data engineering strategy.
  • Provide support and oversight for team members.

Qualifications

  • BA/BS in Computer Science, Engineering, Mathematics or related field.
  • 5+ years of relevant work experience in a role requiring application of analytic skills to integrate data into operational planning/business planning or advanced degree.
  • Experience managing individuals for team outcomes.
  • Excellent skills in writing Python scripts, Experience in writing and tuning SQL scripts.
  • Experience in Snowflake, PostgreSQL, Apache Airflow, REST API, and Java.
  • Be self-driven, and show ability to ETL/ELT on ambiguous projects in spite of incomplete or inaccurate data.
  • Experience working in very large data warehouse environments; understand the best practices for querying and analyzing dataset to support business decision making.

PERKS & BENFITS:

  • We offer a unique opportunity to work on international projects, with daily communication in English and a guided introduction to everything you need to work independently.
  • 5 weeks of holidays + 5 extra corporate days off
  • Give Back Volunteer Days
  • Sick days
  • Flexibility to work from home most of the week
  • Certain flexibility to schedule your working hours
  • Cafeteria system (you can use points on Flexipasses, pension or life insurance, or Multisport card. You can distribute points by your consideration)
  • Meal allowance 90 CZK net/day

Join our team today and help us transform data into a valuable asset for our colleagues and clients!

Options

Sorry the Share function is not working properly at this moment. Please refresh the page and try again later.
Share on your newsfeed