Lead Data Engineer - Azure

Full Time Perm

Location: Remote

The Enterprise Data Strategy department, under the Office of Innovation owns the data strategy for the enterprise data lake house. 

Your responsibilities may include, but are not limited to:

• Design, implement, and manage data product on the Microsoft Azure cloud platform.

• Craft Azure-based solutions with a strong focus on resilience, scalability, and security, ensuring they surpass industry standards.

• Collaborate with Enterprise Architecture to develop comprehensive standards for the data lake house.

• Leads data engineering strategy for complex projects from beginning-to-end 

• Guides best practices in data architecture across multiple environments (e.g. data warehouses, data lake, etc.) 

• Effectively communicates data engineering concepts to a non-technical audience. Acts as key point of contact in reporting on project related deliverables to key stakeholders. 

Minimum Qualifications

• 8+ years of experience of data engineering such as building and optimizing big-data pipelines, architectures, and data sets or similar job duties

• 8+ years of years of experience utilizing SQL across a variety of databases

• 4+ years of experience with big data technologies such as Azure Databricks and Apache Spark

• 3+ years of experience using Azure data lake platform 

Preferred Qualifications

• Understanding of agile methodologies and experience as a Data Engineer on a cross-functional agile team

• Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores. 

• Experience with containerization and microservices (e.g., Docker, Kubernetes) 

• Familiarity with Linux and Unix 

Disclaimer 

The preceding description is not designed to be a complete list of all duties and responsibilities required of the position. 

Inclusion and Diversity

• Value inclusion within your day-to-day responsibilities by respecting others' perspectives/convictions, engaging others' opinions, creating a safe environment where people, ideas, and opinions are valued within your Team/Customers and external partners.  

• Respect and take into consideration diversity within your Team/Customers and external work partners by valuing different world views, challenges, and cultures that represent all walks of life and all backgrounds.  

• Treat others with respect and consideration.  Actively participate in creating and contributing to a positive work environment.  

Safety 

• Promote a safe work environment by actively participating in all aspects of our employee safety program.    

• Report any unsafe conditions and take actions to prevent personal injuries.    

• Support our interdependent safety culture by ensuring the safety of your co-workers.    

• Stay focused on the task at hand and promote productivity through good work habits.  

#OhioMeansJobs #Remote #WomenInTech #TechJobs #NiSource #EnergyJobs #DataEngineer #Databricks #Azure #AzureDataLake #SQL #NowHiring #AzureCloud #AWS #LeadEngineer #Data #BigData