Data Movement Engineer (Snowflake) - Contractor
New Haven, CT, US, 06511
Feel Good About Doing Good
The Knights of Columbus is a tax-exempt Catholic fraternal benefit society that provides financial security to members and their families through our life insurance, long-term care insurance, disability income insurance, investment and annuity products. Charity is at the core of our missions: our profits are donated to help those in need and to support our faith - $1.73B over the past ten years.
While we have many employees who are not Catholic, we follow the Church’s teachings in our investment strategies and our employee benefits. As part of our religious mission, we support the pro-life cause by contributing to the March for Life and pregnancy resource centers, we oppose assisted suicide and euthanasia, we are evangelists for the Catholic faith, and we help Christians who are facing religious persecution in the Middle East. We all work together to support our two million members as they volunteer to help others in their parishes and communities around the world.
Share Your Talent. Live Your Purpose.
We are a growing and purpose-driven community of professionals. Join us to discover how you can meet your goals and ours!
#LI-Hybrid
Overview
The Knights of Columbus is embarking on the modernization of its core data platforms. We are currently seeking a Data Movement Engineer who can provide production support to our existing and future ETL environments. This role will also lead the design, optimization, and support framework of Snowflake-based data solutions. The ideal candidate will possess strong technical expertise in Snowflake, data warehousing methodologies like Data Vault 2.0, and be comfortable leading complex projects and mentoring team members.
Core Responsibilities
- Manage the full lifecycle of Snowflake data operations, including monitoring, troubleshooting, and optimizing data pipelines.
- Proactively identify and resolve issues related to data integrity, latency, and pipeline failures to maintain smooth operations.
- Translate stakeholder requirements into Snowflake-specific solutions for data movement.
- Develop and optimize SQL queries, warehouse configurations, and data models for performance, reliability, and scalability.
- Design, develop, and optimize Snowflake data pipelines and models.
- Recommend and implement best practices for data ingestion, transformation, storage, security and data modeling.
- Support advanced features like Change Data Capture (CDC) and Slowly Changing Dimensions (SCD Type 2).
- Support frameworks like Data Vault and dimensional modeling in Snowflake.
- Monitor and troubleshoot data pipeline failures and performance issues in ETL and Snowflake environments.
- Thoroughly test all production solutions prior to implementation.
- Perform root cause analysis of data discrepancies, latency, and integrity issues.
- Provide production support for IBM DB2, Snowflake, and orchestration tools (Airflow, ESP).
- Collaborate with other teams to implement fixes and preventive measures.
- Perform data quality analysis, report issues, and propose solutions.
- Ensure data accuracy, completeness, and consistency across systems.
- Implement validation and reconciliation checks within pipelines.
- Support data governance initiatives including metadata management and lineage tracking.
- Lead the design, development, and maintenance of Snowflake processes.
- Provide technical leadership, code reviews, and mentorship to junior developers.
- Coordinate with business stakeholders, data architects, and application teams to gather requirements and deliver solutions.
- Communicate issue status, impact, and resolution timelines effectively.
- Maintain comprehensive documentation for all Snowflake-related issues, fixes, and scripts, ensuring they are version-controlled and aligned with data architecture and security standards.
- Develop and maintain production support playbooks and detailed ticket resolution procedures to enable consistent and efficient incident handling.
- Prepare effort estimations and contribute to architectural decisions.
- Provide regular updates and reports on issue trends and improvement initiatives.
- On-call and/or after-hours work required.
Skills Qualifications
- Minimum of 5 years of relevant experience in data warehousing, business intelligence tools, and data analysis.
- Minimum of 3 years of SQL query development across multiple database platforms (Snowflake, Oracle, SQL Server, DB2).
- Strong expertise in Snowflake (development, data modeling, security). Snowflake certification preferred.
- Strong proficiency in SQL and scripting languages (e.g., Python, Shell).
- Experience with cloud database technologies.
- Familiarity with orchestration tools (ESP, Airflow) and version control systems (Git).
- Experience with incident management tools (e.g., ServiceNow, Jira) and CI/CD practices.
- Expertise in CDC and SCD Type 2 implementations using SQL.
- Solid understanding of data architecture, dimensional modeling, and frameworks like Data Vault.
- Ability to solve problems using analytical thinking skills.
- Must work well independently and be inquisitive.
- Strong organizational and time management skills.
Education
- Bachelor’s degree in computer science, Information Systems, or related field.
- 5+ years of experience in Snowflake development and data warehousing.
Physical Demands
Nearest Major Market: New Haven
Nearest Secondary Market: Hartford