5 years minimum experience as Data Engineer--Need end to end data engineers who know how to build ingestion and consumption pipelines
Python and Pyspark experience required
Experience with machine learning models is required
Experience with Lakehouse and/or Datalakes
API data consumption is a must (swaggers, specs, data domain based APIs)
Glue ETL is a must
Solid understanding of data governance tools (data lineage, metadata tagging, metadata catalogs)
Terraform experience required
Understanding of ETL process
AWS is a big plus
Help our partner teams ingest data faster into our data lakes while maintaining Data Governance and Compliance standards, find ways to make our data products more efficient, or innovate ideas to help build self-serve data engineering within the company. Build micro-services, architecting, designing, and promoting self-serve capabilities at scale to help us grow. Collaborate with and across Agile teams to design, develop, test, implement, and support data engineering solutions in full-stack development tools and technologies.
Essential Functions - Lead the design and implementation of complex ETL processes. - Oversee data architecture and ensure scalability and performance. - Mentor and guide junior team members. - Collaborate with data scientists and analysts to implement advanced analytics solutions.
Horizontal facilitates valuable and productive conversations between you and potential employers. We can assist you in growing your career by partnering you with employers that offer challenging assignments. For those that join the team, we offer competitive compensation and benefits including medical, dental, vision, and retirement. Check out all we have to offer and how you can become part of the Horizontal Talent Team. The pay range for this role is $84 - $97 per hour. This is not a guarantee of compensation, as final offer amount may vary based on factors including but not limited to experience and geographic location.
