Sr. Lead, Cloud Engineer, Data Platforms

Company: Northern Trust Corp
Location: Chicago
Posted on: October 16, 2024

Job Description:

Sr. Lead, Cloud Engineer, Data PlatformsApplyAbout Northern Trust:Northern Trust, a Fortune 500 company, is a globally recognized, award-winning financial institution that has been in continuous operation since 1889.Northern Trust is proud to provide innovative financial services and guidance to the world's most successful individuals, families, and institutions by remaining true to our enduring principles of service, expertise, and integrity. With more than 130 years of financial experience and over 22,000 partners, we serve the world's most sophisticated clients using leading technology and exceptional service.Summary:Northern Trust is seeking a dynamic Sr. Lead cloud/data platform engineer to support key data platforms to include Snowflake, Databricks, and other data platforms. The individual will specialize in data platforms, handling the design, implementation, and maintenance of data storage and processing solutions to ensure efficient data flow and accessibility, often collaborating with data engineers and analysts to support data-driven decision-making across an organization. This is an opportunity to play an essential role in optimizing the performance and scalability of data platform environments to meet Northern Trust's data needs. Are you ready for the challenge?Responsibilities:Data Platform Engineering

• Deep understanding of Snowflake's infrastructure and services to optimize and evolve our infrastructure's reliability, availability, serviceability, performance, and cost efficiency.
• Design, develop, and unit-test various modules of database product applications primarily on Snowflake but also on Databricks and other data services.
• Contribute to initiatives aimed at scaling our processes, systems, services, and automation.
• Build data engineering and data ingestion modules for Snowflake (Relational database).
• Implement automation for administering Accounts / Databases and access roles.
• Implement Snowflake standards and methodologies for DB security - both infra and app level.
• Implement data sharing/replication for cross cloud/cross region for internal/external clients.
• Implement data encryption/decryption/masking policies to protect PII/PCI data.
• Propose and implement DB/Snowflake query performance optimizations to manage cost.
• Build foundational database infrastructure automation to manage traffic and scale.
• Create data structures and design data models tailored to Snowflake's architecture.
• Demonstrate knowledge of cloud managed services, particularly Azure CLI.
• Knowledge of semi-structured data and Snowflake's approach to data sharing and security.
• Develop monitoring architecture and implement monitoring agents, dashboards, and alerts.
• Work with Cloud leadership, Product Management, and Application Teams on requirements.Cloud DevOps Engineering, Automation, & Operations
• Develop infrastructure-as-code (IaC) automation (e.g., Terraform) to create IaC patterns and modules to provide acceleration to development end users programmatically.
• Utilize modern software DevOps and CI/CD tooling, such as GitHub, GitHub Actions, ADO, Jenkins, etc., to provision infrastructure resources and prevent configuration drift.
• Investigate and resolve complex cloud infrastructure-related issues and recommend and develop solutions to issues and create documentation of reengineering processes as required.
• Participate in IT Service Management (ITSM) change, incident, and general requests for cloud platform support for business as usual (BAU) operations.Minimum Qualifications
• Bachelor's degree in computer science, engineering, or related technical fields.
• 10+ years of technology experience.
• 5+ years cloud computing (Microsoft Azure).
• 3 to 5+ years Snowflake experience.
• Strong developing skills in Python and associated libraries.
• Terraform Infrastructure as code (IaC) automation.Preferred QualificationsDemonstrate extensive abilities and/or a proven record of success in the following:
• 5+ years of work experience in Snowflake data platform.
• 5+ years hands-on experience with Python libraries such as Pandas, Flask, Django.
• Experience with Databricks data platform.
• Proficiency in scripting languages: Python, Terraform (IaC), SQL, Java.
• Strong hands-on experience in databases (SQL preferred).
• Experience with data analytics, PySpark, and Big data is an added advantage.
• Strong debugging skills to identify issues and provide solutions.
• Understanding of data structures, data modelling, and software architecture.
• Experience creating data architectures and dealing with large volumes of data.
• Experience using statistical languages to manipulate data and draw insights from data sets.
• Experience with DevOps and CI/CD tools (e.g., GitHub/Actions).
• Manage large, complex projects from conception to completion with minimal guidance.
• Strong software engineering fundamentals, coding skills, and knowledge of SDLC.
• Proficiency in waterfall and Agile, Scrum, Kanban, SAFe, etc. delivery methodologies.
• Quick learner and implementing new tools/technologies.
• Strong analytical skills and experience in statistical techniques.Working with Us:As a Northern Trust partner, greater achievements await. You will be part of a flexible and collaborative work culture in an organization where financial strength and stability is an asset that emboldens us to explore new ideas.Movement within the organization is encouraged, senior leaders are accessible, and you can take pride in working for a company committed to assisting the communities we serve! Join a workplace with a greater purpose.We'd love to learn more about how your interests and experience could be a fit with one of the world's most admired and sustainable companies! Build your career with us and apply today. #MadeForGreaterReasonable accommodationNorthern Trust is committed to working with and providing reasonable accommodations to individuals with disabilities. If you need a reasonable accommodation for any part of the employment process, please email our HR Service Center at MyHRHelp@ntrs.com.We hope you're excited about the role and the opportunity to work with us. We value an inclusive workplace and understand flexibility means different things to different people.Apply today and talk to us about your flexible working requirements and together we can achieve greater.
  #J-18808-Ljbffr

Keywords: Northern Trust Corp, Buffalo Grove , Sr. Lead, Cloud Engineer, Data Platforms, Engineering , Chicago, Illinois