Seasoned Data engineer need to migrate data pipelines to modernize pipelines the enterprise team has implemented - Once the process is run and produced, it has to close the enterprise pipeline , Already an established pattern that needs to be followed
Involve dealing with a lot of data, close to 5-7 TB of large data , flowing through data stream
Close to 6 datasets that they are working with - They use snowflake as the warehouse
Day to day - working with registration of data and every data set has to be registered correctly
Exchange team that the contractors will work on
AWS Must have worked with EMR specifically
Python and framework like spark is helpful
Debugging skills
SQL is nice to have
Seniority level
Mid-Senior level
Employment type
Full-time
Job function
Information Technology
Industries
Staffing and Recruiting
Referrals increase your chances of interviewing at Exaways Corporation by 2x