Overview
Data Engineer, Associate Jobs in United States at Sundayy
Title: Data Engineer, Associate
Company: Sundayy
Location: United States
About The Company
Candid is a renowned nonprofit organization dedicated to providing comprehensive data and insights about the social sector. Our mission is to empower organizations, policymakers, and advocates with accurate and timely information to drive positive social change. Through innovative data collection, analysis, and dissemination, Candid supports a wide range of initiatives aimed at improving communities and fostering transparency within the social sector. We pride ourselves on our commitment to integrity, inclusivity, and excellence in data stewardship, ensuring that our stakeholders have the resources they need to make informed decisions and implement impactful programs.
About The Role
The Associate Data Engineer at Candid plays a vital role in supporting the day-to-day operations of our cloud data platform. This position involves maintaining ingestion and transformation pipelines built on Apache Iceberg, validating data outputs through schema and structural changes, and assisting with storage management, platform observability, and metadata operations. The role offers an excellent opportunity for individuals looking to develop foundational skills across the modern data lakehouse stack while taking ownership of critical pipeline maintenance, documentation, and validation activities. Reporting to the Data Operations Manager, the Associate Data Engineer will work closely with cross-functional teams to ensure data integrity, platform performance, and security compliance, contributing to Candid’s mission of providing reliable and insightful data about the social sector.
Qualifications
- 1–3 years of experience in data engineering, analytics engineering, or a closely related technical role (internships and relevant academic projects considered)
- Solid SQL skills, including writing, reading, and debugging queries against relational or columnar data stores
- Familiarity with cloud data concepts: object storage (Amazon S3), columnar file formats (e.g., Parquet), data-interchange formats (JSON, XML), or open table formats (e.g., Apache Iceberg)
- Experience with or exposure to distributed SQL query engines such as Trino or Starburst
- Familiarity with AWS services such as S3 and Glue
- Exposure to workflow orchestration platforms like Apache Airflow, SSIS, or similar
- Experience writing or maintaining data pipelines in Python
- Understanding of on-prem relational data systems (e.g., Microsoft SQL Server)
- Strong attention to detail, especially around data validation and output accuracy
- Excellent analytical and problem-solving skills
- Effective written and verbal communication skills for documenting findings
- Ability to work independently and collaboratively within a distributed team environment
- Willingness to perform additional duties and participate in special projects as needed
- Respect and sensitivity towards racial, gender, sexual orientation, and cultural differences
- Alignment with Candid’s core values: driven, direct, accessible, curious, and inclusive
Responsibilities
- Pipeline Maintenance, Documentation, & Validation: Take ownership of ingestion pipelines and transformation table adjustments to ensure reliable data delivery. Validate transformation outputs following schema or structural changes, document findings, and escalate anomalies to relevant teams.
- Storage & Platform Support: Assist with scheduling compaction and cleanup jobs to maintain the health of Iceberg tables and optimize query performance. Support partition evolution and snapshot retention to manage storage growth efficiently.
- Observability & Metadata: Implement and maintain CloudWatch metrics, alarms, and dashboards to ensure pipeline visibility. Track and report on platform performance metrics, and support AWS Glue metadata refresh and statistics jobs to optimize query planning.
- Schema Coordination: Collaborate with data teams to coordinate schema changes across ingestion and transformation layers, ensuring end-to-end consistency. Communicate impacts and sequence changes carefully to prevent disruptions.
- Infrastructure & Security: Support and maintain role-based access control (RBAC) and attribute-based access control (ABAC), participate in access reviews and audits, and document security-related changes while escalating risks as needed.
Benefits
- Health insurance coverage including medical, dental, and vision plans
- Retirement contribution options with additional matching opportunities
- Paid life insurance and accidental death & dismemberment (AD&D) coverage
- Paid leave including PTO, compassionate leave, volunteer days, holidays, and parental leave
- Short-term and long-term disability insurance
- Pre-tax transit benefits and flexible spending accounts
- Supplemental insurance options
- Summer hours to promote work-life balance
- Eligibility for Public Service Loan Forgiveness (PSLF) program
Equal Opportunity
Candid is an equal opportunity employer. We are committed to creating an inclusive environment for all employees and applicants. We prohibit discrimination and harassment of any kind based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. This policy applies to all aspects of employment, including recruiting, hiring, promotion, compensation, and termination. We encourage candidates from diverse backgrounds to apply and join our mission-driven team.
