Senior Data Engineer at Arcadia

Short Description:

Arcadia, a technology company committed to combating the climate crisis, is seeking a Senior Data Engineer based in Chennai, India. The role involves designing, developing, and maintaining scalable data pipelines in an AWS environment, with a focus on Snowflake, Fivetran, Prefect, and dbt. The Senior Data Engineer will collaborate with diverse teams to ensure the smooth flow of high-quality data for analysis and reporting, optimizing workflows and scaling infrastructure. The position offers an exceptional opportunity for someone with 5+ years of experience in data engineering, strong Python skills, and a background in database management. Arcadia values diversity, offering competitive compensation, a remote work policy, and a commitment to reducing carbon footprints.

---

 

Position: Senior Data Engineer

Company: Arcadia

Location: Chennai, Tamil Nadu, India

Who We Are

Arcadia is a technology company empowering energy innovators and consumers to combat the climate crisis. Our cutting-edge software and APIs are transforming an industry constrained by outdated systems and institutions, offering unprecedented access to data and clean energy necessary for a decarbonized energy grid.

Founded in 2014, Arcadia embarked on a mission to break the fossil fuel monopoly, dismantling institutional barriers hindering decarbonization. We've connected hundreds of thousands of consumers and small businesses with high-quality clean energy options. Today, we're expanding our vision with the launch of Arc, a groundbreaking SaaS platform enabling developers and energy innovators to create custom, personalized energy experiences. This accelerates the industry's transformation from an analog energy system into a digitized information network.

Addressing one of the world's most significant challenges demands creative thinking and diverse perspectives. We're assembling a team with varied backgrounds, industries, and educational experiences. If you share our passion for ushering in the era of the clean electron, we look forward to discovering what unique contributions you can bring to Arcadia! Visit www.arcadia.com.

HQ: Washington, DC

$1.5B valuation; $380M funding to date

What we’re looking for:

As a Senior Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure and pipelines. Collaborating closely with our standalone Data team (including analysts, analytics engineers, and data governance experts) and other Arcadia engineering and operations teams, you will ensure the smooth flow and availability of high-quality data for analysis and reporting. Your expertise will be vital in optimizing data workflows, ensuring data integrity, and scaling our data infrastructure to support company growth.

This is an outstanding opportunity for someone who enjoys engaging with cutting-edge technology, influencing the development of a world-class data ecosystem, and working in a fast-paced environment within a high-morale, tightly knit team.

Our core data stack heavily utilizes Snowflake and dbt, orchestrated in Prefect within our broader AWS-based ecosystem. While most data sources are loaded with Fivetran, we employ custom Python when appropriate.

What you’ll do:

Design, develop, and maintain scalable and efficient data pipelines in an AWS environment, centered on our Snowflake instance and using Fivetran, Prefect, and dbt. Collaborate with data analysts, analytics engineers, and software engineers to understand data requirements and deliver reliable solutions. Design, build, and maintain tooling for the wider Data team and Arcadia, including CI/CD pipelines for our data lakehouse, unit/integration/validation testing frameworks for data pipelines, and command-line tools for ad-hoc data evaluation. Identify and implement best practices for data ingestion, transformation, and storage to ensure data integrity and accuracy. Optimize and tune data pipelines for improved performance, scalability, and reliability. Monitor data pipelines and proactively address any issues or bottlenecks to ensure uninterrupted data flow. Develop and maintain documentation for data pipelines, promoting knowledge sharing and facilitating the smooth onboarding of new team members. Implement data governance and security measures to ensure compliance with industry standards and regulations. Stay up-to-date with emerging technologies and trends in data engineering, recommending their adoption as appropriate.

Must-haves:

5+ years of experience as a Data Engineer, data-adjacent Software Engineer, or a versatile small data team member focused on building and maintaining data pipelines. Strong Python skills, especially in the context of data orchestration. Solid understanding of database management and design, including experience with Snowflake or a similar platform. Familiarity with data integration patterns, ETL/ELT processes, and data warehousing concepts. Experience with Prefect, Airflow, or similar data orchestration tools. Excellent problem-solving and analytical skills with a strong attention to detail. Customer-oriented and empathetic approach to understanding how data drives the business. Strong communication skills.

Nice-to-haves:

Undergraduate and/or graduate degree in math, statistics, engineering, computer science, or a related technical field. Experience with our stack – AWS, Snowflake, Fivetran, Prefect, dbt, and Github Actions, along with ancillary tools. Experience with DevOps practices, especially CI/CD. Previous experience managing enterprise-level data pipelines and working with large datasets. Proficiency in SQL. Experience in the energy sector.

Benefits:

Competitive compensation based on market standards. Remote work policy in place. Additional benefits include a flexible leave policy, centrally located office, medical insurance (for 1+5 family members), quarterly team engagement activities, rewards & recognitions, and professional growth opportunities through L&D programs. A commitment to reducing carbon footprints and eliminating carbon copies.

Please click here to apply.