Senior Databricks Engineer at Tredence

Short Description:

Tredence, a leading analytics and data science company, is hiring a Senior Data Engineer with 3-6 years of experience for roles in Bangalore, Chennai, Delhi, Pune, and Kolkata. The candidate will be responsible for developing advanced Data Warehouse solutions using Databricks and AWS/Azure Stack, collaborating with DW/BI leads, and addressing ETL pipeline development requirements. Strong skills in SQL, Python, and Spark (PySpark) are essential, along with experience in AWS/Azure stack. The ideal candidate should have expertise in data modeling, Databricks Data & AI platform, and proficiency in managing structured and unstructured data.

Job Title: Senior Databricks Engineer

Organization: Tredence

Position: Senior Data Engineering Professional (3-6 years experience)

Work Locations: Bangalore, Chennai, Delhi, Pune, Kolkata

About Tredence:

Tredence is dedicated to delivering impactful insights that drive profitable actions by integrating business analytics, data science, and software engineering. We collaborate with major companies across various sectors, deploying predictive and optimization solutions at scale. Headquartered in the San Francisco Bay Area, our clientele spans the US, Canada, Europe, and South East Asia. We are in search of an accomplished data scientist who not only possesses the required mathematical and statistical expertise but also exhibits natural curiosity and a creative mindset to explore, connect, and unveil hidden opportunities, ultimately unlocking the full potential of data.

Primary Roles and Responsibilities:

Develop advanced Data Warehouse solutions utilizing Databricks and AWS/Azure Stack.
Offer forward-thinking solutions in the realm of data engineering and analytics.
Collaborate with DW/BI leads to comprehend new ETL pipeline development requirements.
Identify gaps in existing pipelines and rectify issues efficiently.
Work closely with the business to understand reporting layer needs and develop data models accordingly.
Assist team members in resolving issues and technical challenges.
Lead technical discussions with client architects and team members.
Orchestrate data pipelines in scheduler via Airflow.

Skills and Qualifications:

Bachelor's and/or master’s degree in computer science or equivalent experience.
Minimum of 3 years of IT experience and 3+ years' hands-on experience in Data warehouse/ETL projects.
Profound understanding of Star and Snowflake dimensional modeling.
Robust knowledge of Data Management principles.
Thorough understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture.
Hands-on experience in SQL, Python, and Spark (PySpark).
Experience in AWS/Azure stack is mandatory.
Desirable skills include ETL with batch and streaming (Kinesis).
Proficiency in building ETL/data warehouse transformation processes.
Familiarity with Apache Kafka for streaming data/event-based data.
Exposure to Open-Source big data products, including Hadoop (incl. Hive, Pig, Impala).
Familiarity with Open Source non-relational/NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J).
Experience with structured and unstructured data, including imaging & geospatial data.
Proficient in working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.
Databricks Certified Data Engineer Associate/Professional Certification (Desirable).
Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects.
Experience working in Agile methodology.
Strong verbal and written communication skills.
Strong analytical and problem-solving skills with a high attention to detail.

Mandatory Skills: Python/PySpark/Spark with Azure/AWS Databricks

Please click here to apply.

Comments

Other popular job openings

Beamer is hiring for a Remote Fresher Entry Level Data Analyst job in India

Position: Data Analyst Company: Beamer Location: Coimbatore, Tamil Nadu, India Job Type: Full-time Job Mode: Remote Job Requisition ID: Not specified in the description Years of Experience: Entry-level (0-3 years) Company Description: Beamer is a dynamic and innovative company, renowned for empowering product leaders and marketers to develop products that their customers value. The company is highly regarded in the global product marketing space, serving as a trusted platform that helps businesses communicate effectively with their customers. Beamer recently acquired Userflow, expanding its offerings into Product Onboarding and Analytics, which allows them to offer a more comprehensive toolkit for product-led growth (PLG) companies. Backed by successful investors with a track record in the SaaS space (including Dropbox, Solarwinds, and Datadog), Beamer is a profitable, early-stage company in growth mode. The company’s mission is to transform the way product teams engage and grow their

Dentsu is hiring for a fresher entry level Data Science Executive

Position: Modeling & Data Science Executive Company: Dentsu Global leader in advertising and marketing solutions Serves major clients with innovative and data-driven strategies LinkedIn : 1,365,924 followers Industry : Advertising Services Employees : 10,001+ Location: Bengaluru, Karnataka, India Job Type: Full-time Permanent position Job Mode: Hybrid working model (Combination of on-site and remote) Job Requisition ID: Not provided (for internal reference) Years of Experience: Entry-level position (experience not explicitly stated) Company Description: Dentsu is a global marketing and advertising company that focuses on creating data-driven solutions to enable brands to thrive in the digital world. With over 10,001 employees and a presence across multiple regions, Dentsu is a powerhouse in the advertising services industry. Dentsu helps brands navigate the complexities of the modern marketplace through data, creativity, and technology. Specializing in advertising services, the co

Unilever is hiring for a fresher entry level Data Scientist role in India

Position: Data Science Specialist Company: Unilever Location: Mumbai, Maharashtra, India Job Type: Full-Time Job Mode: On-site Job Requisition ID: R-86289 Years of Experience: 0-3 years Company Description: Overview: Unilever is a global leader in consumer goods, driven by a purpose-led approach. With a wide range of beloved brands, Unilever strives to enhance the lives of consumers and communities. The company emphasizes the importance of innovation, fostering a culture where business success is achieved through creativity, disruption, and sustainability. Values: Unilever believes in using business as a force for good, where every team member plays a role in improving lives and building a brighter future. By supporting employees with mentorship, inspiration, and an inclusive environment, Unilever fosters growth both personally and professionally. Global Impact: With nine out of ten Indian households using Unilever’s products, the company stands as a major player in shaping consumer

Allica Bank is hiring for a Remote Fresher Entry Level Data Analyst role in India

Position: Data Analyst Company: Allica Bank Location: Bengaluru, Karnataka, India Job Type: Full-time Job Mode: Remote Job Requisition ID: Not Provided Years of Experience: Entry-level Company Description: Allica Bank is recognized as the fastest-growing company in the UK, specifically excelling in the fintech (financial technology) sector. Our focus is on supporting established small and medium-sized enterprises (SMEs), an often overlooked but crucial segment of the economy. SMEs are the foundation of local economies, representing over one-third of the UK's GDP, yet they have traditionally been underserved by both large-scale banks and modern fintech firms. Allica Bank's mission is to fill this gap by providing innovative, customer-centric solutions tailored to the needs of these businesses. Our growth trajectory is driven by our commitment to providing value-driven financial solutions to SMEs, helping them scale and succeed in their local communities. With a combinati

Neolytix is hiring for an entry-level fresher Business Analyst

Position: Business Analyst - Freshers Company: Neolytix Location: Gurugram, Haryana, India Job Type: Full-time Job Mode: On-site Job Requisition ID: N/A Years of Experience: Entry Level Company Description: Neolytix is a distinguished Consulting and Management Services firm specializing in the healthcare sector across the United States. Known for our targeted services and tailored solutions, we have built a reputation for delivering impactful and practical advice to our clients. Established Expertise : Our firm has honed its skills in supporting healthcare providers by addressing micro verticals, ensuring our solutions are both relevant and effective in managing the intricate details of healthcare management. Reputation and Reviews : We pride ourselves on maintaining high standards of client satisfaction, reflected in our commendable ratings. Our Google rating stands at 4.7 out of 5, and we hold a 4.2 rating on Glassdoor, with an 80% approval rating from our employees. Client and Empl

SitusAMC is hiring for a fresher entry level Associate Data Scientist

Position: Associate, Data Science (Associate Data Scientist) Company: SitusAMC Location: IN - Karnataka - Bengaluru Job Type: Part-time Job Mode: Onsite Job Requisition ID: JR00982 Years of Experience: Unspecified by seems like a fresher entry level opening Company Description: SitusAMC is recognized as a leading player in transforming businesses, especially in the real estate sector. They provide solutions and opportunities that allow both clients and employees to thrive. Whether one is a seasoned professional or someone just entering the workforce, SitusAMC offers a platform for career growth. The company promotes innovation, teamwork, and personal growth. Their mission revolves around helping individuals maximize their potential, blending cutting-edge technology and deep industry insights. SitusAMC is known for creating an inclusive work environment, where employees are encouraged to express themselves and advocate for the needs of others. They emphasize a global outlook while stayi

TIAA is hiring for a fresher entry level data analyst role in India

Position: Data Analyst Company: TIAA Global Capabilities Location: Pune, India Job Type: Full-time Job Mode: Hybrid Flex Job Requisition ID: R240800045 Years of Experience: No Experience Required Company Description: TIAA Global Capabilities was established in 2016 with the goal of utilizing a vast pool of global talent and reducing risks by insourcing key platforms and processes. The company is focused on building a scalable and sustainable organization with a primary emphasis on technology , operations , and expanding into the shared services business space . By working closely with colleagues in the U.S. and other global partners, TIAA strives to enhance its technology stack while reducing risks and improving operational efficiency. TIAA is a well-established organization committed to fostering innovation , developing breakthrough ideas, and improving productivity and throughput across the board. The company prides itself on being an Equal Opportunity/Affirmative Action Employe

Arkose Labs is hiring for a fresher entry level Data Scientist job in India

Position: Data Scientist (Computer Vision) Company: Arkose Labs Location: Pune, India Job Type: Full-time Job Mode: Hybrid (Remote & On-site) Job Requisition ID: Not specified Years of Experience: Not specified (open to candidates with Bachelors, Masters, or PhD in relevant fields) Company Description: Arkose Labs is a leading provider in the field of bot detection and mitigation, recognized as the 2023 Leader in the space by G2. The company’s AI-powered platform offers robust solutions designed to protect enterprises from online fraud and abuse. Arkose Labs has gained significant trust globally, with 20% of its customers being Fortune 500 companies. The company's security measures include the world’s first $1M warranties for issues like credential stuffing and SMS toll fraud. Headquartered in San Mateo, CA, Arkose Labs has a global presence with employees stationed in London, Costa Rica, Australia, India, and Argentina. Their vision is centered on creating a secure online envi

Zeta is hiring for a fresher entry level Data Scientist - I role in India

Position: Data Scientist - I Company: Zeta Location: Bangalore Job Type: Full-time Job Mode: On-site Job Requisition ID: CEO Office – Engineering Years of Experience: 6 months of relevant experience (even relevant internship experience works) Company Description: Zeta is a forward-thinking tech company specializing in the banking industry, founded in 2015 by Bhavin Turakhia and Ramki Gaddipati . The company provides cutting-edge solutions for banks and fintech companies to launch modern banking products. Through its flagship platform, Zeta Tachyon , Zeta offers a cloud-native, fully API-enabled stack that integrates various banking services like core banking, issuance, processing, lending, fraud detection, and risk management. This platform has enabled the issuance of over 20 million cards worldwide. With a presence across the US, EMEA, and Asia, Zeta collaborates with major financial institutions and fintech companies in various markets to revolutionize customer experiences for mult

BCG is hiring for a Data Analyst (Data Science) Intern

Position: Data Analyst Intern (work involves ML as well) Company: Boston Consulting Group (BCG) Location: Gurugram Job Type: Internship Job Mode: Onsite/Hybrid Job Requisition ID: 24085BR Years of Experience: 0-2 years Company Description: Boston Consulting Group (BCG) is a prestigious global management consulting firm that partners with business and societal leaders to address their most critical challenges. With a presence in over 50 countries, BCG’s client base spans various industries, from healthcare to financial services, technology, consumer goods, and more. The firm is known for its innovative solutions, forward-thinking approach, and commitment to driving transformative results. Founded in 1963, BCG has continually expanded its global footprint and expertise across key business areas, including strategy, operations, digital transformation, sustainability, and leadership development. BCG combines deep industry knowledge with cutting-edge technological solutions to help business

Please enter your query here