Senior Databricks Engineer at Tredence

Short Description:

Tredence, a leading analytics and data science company, is hiring a Senior Data Engineer with 3-6 years of experience for roles in Bangalore, Chennai, Delhi, Pune, and Kolkata. The candidate will be responsible for developing advanced Data Warehouse solutions using Databricks and AWS/Azure Stack, collaborating with DW/BI leads, and addressing ETL pipeline development requirements. Strong skills in SQL, Python, and Spark (PySpark) are essential, along with experience in AWS/Azure stack. The ideal candidate should have expertise in data modeling, Databricks Data & AI platform, and proficiency in managing structured and unstructured data.

Job Title: Senior Databricks Engineer

Organization: Tredence

Position: Senior Data Engineering Professional (3-6 years experience)

Work Locations: Bangalore, Chennai, Delhi, Pune, Kolkata

About Tredence:

Tredence is dedicated to delivering impactful insights that drive profitable actions by integrating business analytics, data science, and software engineering. We collaborate with major companies across various sectors, deploying predictive and optimization solutions at scale. Headquartered in the San Francisco Bay Area, our clientele spans the US, Canada, Europe, and South East Asia. We are in search of an accomplished data scientist who not only possesses the required mathematical and statistical expertise but also exhibits natural curiosity and a creative mindset to explore, connect, and unveil hidden opportunities, ultimately unlocking the full potential of data.

Primary Roles and Responsibilities:

Develop advanced Data Warehouse solutions utilizing Databricks and AWS/Azure Stack.
Offer forward-thinking solutions in the realm of data engineering and analytics.
Collaborate with DW/BI leads to comprehend new ETL pipeline development requirements.
Identify gaps in existing pipelines and rectify issues efficiently.
Work closely with the business to understand reporting layer needs and develop data models accordingly.
Assist team members in resolving issues and technical challenges.
Lead technical discussions with client architects and team members.
Orchestrate data pipelines in scheduler via Airflow.

Skills and Qualifications:

Bachelor's and/or master’s degree in computer science or equivalent experience.
Minimum of 3 years of IT experience and 3+ years' hands-on experience in Data warehouse/ETL projects.
Profound understanding of Star and Snowflake dimensional modeling.
Robust knowledge of Data Management principles.
Thorough understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture.
Hands-on experience in SQL, Python, and Spark (PySpark).
Experience in AWS/Azure stack is mandatory.
Desirable skills include ETL with batch and streaming (Kinesis).
Proficiency in building ETL/data warehouse transformation processes.
Familiarity with Apache Kafka for streaming data/event-based data.
Exposure to Open-Source big data products, including Hadoop (incl. Hive, Pig, Impala).
Familiarity with Open Source non-relational/NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J).
Experience with structured and unstructured data, including imaging & geospatial data.
Proficient in working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.
Databricks Certified Data Engineer Associate/Professional Certification (Desirable).
Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects.
Experience working in Agile methodology.
Strong verbal and written communication skills.
Strong analytical and problem-solving skills with a high attention to detail.

Mandatory Skills: Python/PySpark/Spark with Azure/AWS Databricks

Please click here to apply.

Comments

Other popular job openings

Kantar is hiring for a fresher entry level Data Analyst role in India

Position: Data Analyst (Contract-CW) Company: Kantar Location: Mumbai, The ORB Building Job Type: Full-time Job Mode: HYBRID Job Requisition ID: R090883 Years of Experience: 0-3 years as per the JD Company Description Kantar Worldpanel is recognized as the global leader in data, insights, and consulting services, delivering comprehensive solutions to help brands and businesses understand consumer behavior. Operating with a global footprint, Kantar has access to some of the largest omnichannel consumer panels. This gives organizations a unique, 360-degree understanding of how shoppers purchase, use, and interact with products and services. Kantar combines vast datasets, cutting-edge technology, and the expertise of industry-leading analysts to provide meaningful insights to brands and retailers. These insights empower organizations to reimagine business strategies, innovate better, and create solutions that foster a healthier, more sustainable, and inclusive world. The company’s commitm...

Vheda Health is hiring for an entry level Remote Data Analyst role in US

Position: Data and Strategy Analyst Company: Vheda Health Location: Remote (Columbia, Maryland, US) Job Type: Full-Time Job Mode: Remote Job Requisition ID: Not specified Years of Experience: Entry-level position (ideal for recent graduates) Company Description Vheda Health is a prominent leader in virtual health engagement with a mission to advance health equity for underserved populations. With a decade of experience and a strong national presence, Vheda Health specializes in turnkey chronic care coordination programs that simplify access to healthcare services. The company focuses on innovative solutions to enhance health outcomes, enabling health plans to deliver better services for their members. Vheda Health is deeply committed to creating impactful healthcare transformations through technology and data-driven strategies. Profile Overview The Data and Strategy Analyst role at Vheda Health is a high-impact position designed for recent graduates with a master’s degree. This role i...

OneOrigin is hiring for an entry level Data Analyst role in India

Position: Data Analyst Company: OneOrigin Location: Bengaluru, Karnataka, India Job Type: Full-time Job Mode: On-site Job Requisition ID: Not specified Years of Experience: Relevant internship experience also works Company Description OneOrigin is among the world’s fastest-growing technology companies, recognized for its innovative solutions and forward-thinking culture. Established in 2015, the company is headquartered in Scottsdale, Arizona, a city surrounded by the picturesque Sonoran Desert. OneOrigin focuses on delivering exceptional value to its clients by maintaining an unwavering commitment to innovation and technological advancement. The company specializes in providing cutting-edge solutions across multiple domains, including: Artificial Intelligence (AI) Data and Analytics Rapid Web Development Virtual and Mixed Reality Cloud Computing With its advanced products, Sia™ and SpotSearch™, OneOrigin is recognized as a disruptive force in the technology sector and has been feature...

London Stock Exchange Group is hiring for a fresher entry level Data Analyst role in India

Position: Title: Data Analyst Company: Name: London Stock Exchange Group (LSEG) Location: Office: IND-Bangalore-TowerE, RMZ Infin Job Type: Type: Full-time Job Mode: Mode: On-site Job Requisition ID: ID: R0097923 Years of Experience: Required Experience: Not explicitly mentioned; applicants with relevant expertise in data analysis and related fields are encouraged to apply; 0-3 years Company Description Overview: LSEG is a prominent global financial markets infrastructure and data provider. The company focuses on driving financial stability, empowering economies, and enabling customers to achieve sustainable growth. Operating in 65 countries, LSEG employs approximately 25,000 individuals worldwide. It is committed to fostering a diverse and inclusive workplace where employees can bring their authentic selves to work. Values and Culture: Core values include Integrity, Partnership, Excellence, and Change. Promotes a collaborative and creative work culture. Encourages innovation an...

Unacademy is hiring for a Data Analyst intern role in India

Position: Role : Data Analyst Intern Company: Name : Unacademy Industry : E-Learning Providers Size : 5,001-10,000 employees LinkedIn Followers : 1,137,364 Social Media Presence : Active on Twitter, Facebook, YouTube, Instagram, and blogs. Location: City : Bangalore Urban State : Karnataka Country : India Mode : On-site Job Type: Type : Internship Job Mode: Work Arrangement : On-site Job Requisition ID: Reference : Not explicitly mentioned in the job description. Years of Experience: Experience Required : Not explicitly mentioned, but suitable for entry-level candidates or recent graduates. Company Description: Overview : Unacademy is an innovative e-learning platform dedicated to building the world’s largest online repository for multilingual education. It empowers educators and learners through advanced technology to create a robust and accessible knowledge-sharing community. By collaborating with the brightest minds, Unacademy aims to democratize education, making high-quality learn...

Claro Energy is hiring for a REMOTE fresher entry level Data Analyst role in India

Position: Data Analyst Company: Claro Energy Location: New Delhi, Delhi, India Job Type: Full-time Job Mode: Remote Job Requisition ID: Not specified Years of Experience: 0-3 years Company Description: Claro Energy is a pioneering organization operating in regions of India characterized by high power deficits, dependence on diesel, agrarian economies, and poor economic conditions. The company leverages solar energy to provide mass irrigation solutions and generate power at the point of use. Its mission is to improve water productivity, bolster economic development, and enhance living standards in rural areas. Claro Energy focuses on revitalizing irrigation technology, practices, and institutions to address critical challenges in agriculture and water management. The organization aims to combat water scarcity and food insecurity through innovative, sustainable solutions. With a firm commitment to renewable energy, Claro Energy is transforming how rural communities access and utilize pow...

Guardian Life is hiring for a fresher entry level Data Analyst role in India

Position: Analyst Company: Guardian Life Careers Location: Gurgaon Job Type: Full-time Job Mode: On-site Job Requisition ID: R000105303 Years of Experience: Not explicitly mentioned but as per JD : 0-3 Years Company Description: Guardian Life Careers is a leading organization committed to delivering exceptional insurance and financial products and services. With a strong presence in the industry, Guardian serves a diverse client base of 29 million customers worldwide. The company’s mission is driven by its purpose: to inspire well-being. This mission underscores their dedication to ensuring the mental, physical, and financial well-being of their customers and employees. Guardian Life Careers has established itself as one of the largest mutual insurance companies by consistently prioritizing its customers. The organization’s core values emphasize customer satisfaction, innovation, and teamwork. With a legacy of reliability and trust, Guardian Life Careers empowers its team members to de...

GlobalLogic is hiring for a fresher entry level Associate Analyst role in India

Position: Associate Analyst Company: GlobalLogic Location: India – Hyderabad Job Type: Full-time Job Mode: On-Site/Office Job Requisition ID: IRC250532 Years of Experience: 0 to 1 year Company Description: GlobalLogic is a renowned leader in digital engineering, offering cutting-edge solutions to help global brands design and develop innovative products, platforms, and digital experiences. Headquartered in Silicon Valley, the company operates design studios and engineering centers worldwide, serving industries like automotive, communications, financial services, healthcare, manufacturing, media, and technology. As part of the Hitachi Group Company under Hitachi, Ltd., GlobalLogic is committed to advancing society through data-driven innovation and creating a sustainable future. With its expertise in experience design, complex engineering, and data analytics, GlobalLogic collaborates with clients to accelerate their digital transformation and unlock new business possibilities. The compa...

EarnIn is hiring for a fresher entry level Data Scientist role in India

Position: Role : Data Science Contractor [Data Scientist] Company: Name : EarnIn Location: City : Bengaluru State : Karnataka Country : India Job Type: Category : Contractual Job Mode: Mode : On-site Job Requisition ID: Not specified Years of Experience: 0-3 years Company Description: EarnIn is a financial technology company revolutionizing the way people access their earnings. Established in 2013, EarnIn provides solutions for financial flexibility, targeting individuals who live paycheck-to-paycheck. The company offers its flagship Earned Wage Access app, enabling users to access their wages in real-time as they earn them. EarnIn is dedicated to creating a fee-free, interest-free, and credit-check-free financial system. With an extensive customer base, the app has empowered over 3.8 million users to access $15 billion in earnings. Backed by renowned partners such as A16Z, Matrix Partners, DST, and Ribbit Capital, EarnIn is financially robust and rapidly expanding. EarnIn’s focus is o...

Enrich is hiring for a fresher entry level Data Analyst role in India

Position: Data Analyst Company: Enrich Location: Bengaluru, Karnataka, India Job Type: Full-time Job Mode: On-site Job Requisition ID: NA Years of Experience: 0-3 years Company Description Enrich is one of India’s leading consumer services companies, primarily operating as a salon chain while diversifying into education and skill development through its beauty academy. Established with the mission of helping people discover their innate talent and beauty, Enrich has consistently evolved to meet the needs of both customers and employees. Operating in six major cities—Mumbai, Ahmedabad, Pune, Surat, Vadodara, and Bengaluru—Enrich has over 83 salons strategically located to serve a broad client base. Beyond salons, Enrich Academy provides internationally accredited training to aspiring beauty professionals. The academy focuses on honing skills in hair, skin, nails, makeup, and salon management with certifications like CIDESCO, CIBTAC, and ARTH. Enrich takes immense pride in its accolades,...

Please enter your query here