Senior Data Engineer at Paytm

Short Description:

Seeking a Senior Data Engineer in Noida, Uttar Pradesh, with 3-5 years of Big Data experience, proficient in Hadoop, Spark, Python/Java/Scala, and real-time data pipeline development. Responsibilities include optimizing data handling for petabytes, troubleshooting technical issues, and implementing emerging Hadoop Eco-System technologies. Join a pioneering digital payments platform, contributing to impactful work, leveraging vast user data, and offering wealth creation opportunities based on India's largest digital lending story.

Data Engineering - Senior Data Engineer

Location: Noida, Uttar Pradesh

Domain: Technology – Lending

Employment Type: On-roll / Remote

Position Title: Data Engineering – Senior Software Engineer

About Us:

Paytm stands at the forefront of India's digital payments and financial services sector, dedicated to engaging both consumers and merchants through a diverse range of payment solutions. Our platform offers services like utility payments, money transfers, and a variety of Paytm Payment Instruments (PPI), including Paytm Wallet, Paytm UPI, Paytm Payments Bank Netbanking, Paytm FASTag, and Paytm Postpaid - Buy Now, Pay Later. Catering to merchants, Paytm provides acquiring devices such as Soundbox, EDC, QR, and Payment Gateway, facilitating payment aggregation through PPI and other financial instruments. Additionally, we enhance merchants' businesses with commerce services through advertising and the Paytm Mini app store. Leveraging this platform, we extend credit services such as merchant loans, personal loans, and BNPL (Buy Now, Pay Later), sourced through our financial partners.

About the Role:

The Senior Data Engineer role involves working on intricate technical projects within an innovative and fast-paced environment. We seek a professional with a strong product design sense, specializing in Hadoop and Spark technologies.

Requirements:

Minimum 3-5 years of experience in Big Data technologies.
Contribute to the growth of our analytics capabilities by developing faster, more reliable tools for handling petabytes of data daily.
Innovate and build new platforms to support our goal of providing cluster users with diverse data shapes and forms, ensuring low latency and horizontal scalability.
Diagnose and resolve problems across the entire technical stack.
Design and implement a real-time events pipeline for data ingestion, supporting real-time dashboards.
Develop complex and efficient functions to transform raw data sources into robust components of our data lake.
Design and implement new components utilizing emerging technologies in the Hadoop Eco-System, ensuring successful project execution.

Skills for Success:

Proficiency in Hadoop, MapReduce, Hive, Spark, PySpark, etc.
Excellent programming/debugging skills in Python/Java/Scala.
Experience with scripting languages such as Python, Bash, etc.
Knowledge of noSQL databases like Hbase, Cassandra is a plus.
Hands-on programming experience with multithreaded applications.
Experience in Database, SQL, and messaging queues like Kafka.
Familiarity with developing streaming applications (e.g., Spark Streaming, Flink, Storm, etc.).
Experience with AWS and cloud technologies such as S3.
Knowledge of caching architectures like Redis is advantageous.

Why Join Us:

Make a meaningful difference and enjoy the journey.
Be challenged and encouraged to contribute to something meaningful for both yourself and those we serve.
Work with a team that values the potential of technology to positively impact people.
Join a successful organization where collective energy and unwavering focus on the customer drive our successes.

Compensation: For the right fit, we believe in creating wealth for you. With over 500 million registered users, 21 million merchants, and a wealth of data in our ecosystem, we are uniquely positioned to democratize credit for deserving consumers and merchants. Join us and become part of India's largest digital lending story!

Please click here to apply.

Comments

Other popular job openings

Walmart Global Tech is hiring for a fresher entry level Data Analyst role in India

Position: Title: Data Analyst II Department: Walmart Global Tech Team: Contact Center Business Excellence (CBE) Company: Name: Walmart Global Tech Parent Company: Walmart Inc. Industry: Retail and Technology Founded: 1962 Headquarters: Bentonville, Arkansas, USA Global Presence: Operates in 24 countries with over 10,500 stores globally Location: Office Address: 3rd Floor, Block B, Tecci Park, 173, Old Mahabalipuram Road, Sholinganallur, Chennai, India Work Mode: Home Office Setup at Tecci Park Job Type: Employment Type: Full-time Schedule: Rotational Shifts Department: Data Analytics and Customer Service Job Mode: Mode: Hybrid Job Requisition ID: Requisition ID: R-2114924 Years of Experience: Experience Required: Option 1: Bachelor’s degree in relevant fields; 0-3 years of experience Option 2: Minimum of 2 years of experience in data analysis, data science, statistics, or a related field ( in case you don'...

Brillio is hiring for a fresher entry level Data Scientist role in India

Position: Role: Data Scientist Primary Skills Required: Statistical Techniques: Hypothesis Testing, T-Test, Z-Test, Regression (Linear and Logistic) Programming and Tools: Python/PySpark, SAS/SPSS Statistical Analysis and Computing Probabilistic Graph Models Frameworks: TensorFlow, PyTorch, Sci-Kit Learn, CNTK, Keras, MXNet AI/ML Frameworks and Tools: Kubeflow, BentoML Forecasting Methods: Exponential Smoothing, ARIMA, ARIMAX Model Evaluation: Great Expectation, Evidently AI Classification Algorithms: Decision Trees, SVM Distance Metrics: Hamming Distance, Euclidean Distance, Manhattan Distance Statistical Programming: R/R Studio Company: Company Name: Brillio Industry: Data and AI – Data Science Employment Platform: Lever Location: City: Bangalore State: Karnataka Country: India Job Type: Employment Type: Full-Time Specialization: AI/ML Engineer – Data Science Advanced Job Mode: Mode: Hybrid Work Arrangement: Combin...

Amadeus is hiring for a fresher entry level Data Scientist role in India

Position: Title: Data Scientist Company: Name: Amadeus Location: City: Bangalore Country: India Job Type: Type: Full-time Job Mode: Mode: Hybrid (Combination of on-site and remote work) Job Requisition ID: ID: R26757 Years of Experience: Experience: Not specified; as per CV, looks like a fresher entry level role; 0-3 years Company Description About Amadeus: Amadeus is a global technology company that plays a pivotal role in revolutionizing the travel industry by connecting travel providers, agencies, and corporations through advanced software solutions. With a workforce of over 20,000 passionate professionals spread across 100+ global locations , Amadeus thrives on innovation and a deep commitment to enhancing travel experiences. The company’s solutions help airlines, hotels, travel agencies, and other partners deliver seamless services to millions of travelers worldwide. Amadeus leverages cutting-edge technologies such as artifici...

Yulu is hiring for a fresher entry level Data Scientist role in India

Position: Title: Data Scientist Company: Yulu Location: Bengaluru, Karnataka, India Job Type: Full-time Job Mode: On-site Job Requisition ID: Not mentioned Years of Experience: Not specified; as per JD looks like a fresher entry level role; 0-3 years Company Description: About Yulu: Yulu is India’s leading provider of shared electric mobility services, aiming to reduce urban traffic congestion and combat air pollution by offering small, smart, and eco-friendly electric vehicles. Established by a mission-driven team with a commitment to innovation and positive impact, Yulu has earned numerous prestigious awards for its contributions to sustainable urban mobility. The company focuses on two key areas: Providing affordable, last-mile commuting solutions for daily travelers. Enabling gig workers to deliver goods efficiently, thus contributing to lower carbon emissions. Yulu’s innovative solutions combine electric mobility with technology, ensuring a s...

Accertify is hiring for a fresher entry level Data Scientist role in India

Position: Data Science Analyst (Data Scientist) Company: Accertify, Inc. Location: Gurgaon, Haryana, India Job Type: Full-time Job Mode: Hybrid (On-site and Remote) Job Requisition ID: Not provided Years of Experience: 0 to 3 years Company Description: Accertify, Inc., a globally recognized leader in digital fraud prevention, was founded in 2007 by bringing together top minds in engineering, analytics, and design. The company specializes in providing solutions to mitigate risks related to digital identity, fraud prevention, chargeback management, and payment gateway operations. With a customer-centric approach, Accertify ensures seamless protection for organizations against financial fraud while enhancing the user experience. Over the years, Accertify has built a reputation as a trusted platform that assesses risks throughout the customer journey—from account monitoring and payment risk assessment to refund fraud detection and dispute management. The company’s cutting-edge solutions no...

CGI is hiring for an entry level Junior Data Scientist role in US

Position: Junior Data Scientist Company: CGI Location: United States, Virginia, Arlington Job type: Full-Time Job mode: Hybrid (Onsite in Arlington, VA, and work at Fairfax, VA office) Job requisition id: J1224-0174 Years of experience: Not explicitly mentioned, but a minimum of 1 year of experience in relevant areas is required. Company description: Founded in 1976, CGI is one of the world's largest IT and business consulting services firms, offering end-to-end services in IT, digital transformation, and business consulting. Headquartered in Montreal, Canada, CGI operates in over 40 countries with more than 90,000 professionals delivering insights-driven, technology-enabled solutions. CGI provides innovative solutions that accelerate business transformation and improve operational efficiency for clients across industries, including government, healthcare, finance, and retail. CGI has built a reputation for offering exceptional services while maintaining a strong culture of ownersh...

Tesco is hiring for a fresher entry level Data Scientist role in India

Position: Data Scientist Company: Tesco Location: Bengaluru, Karnataka, India Job Type: Full-time Job Mode: Not specified; as per the data looks like a Hybrid role Job Requisition ID: Not mentioned Years of Experience: Not specified Company Description: Tesco, a global retail giant, operates across multiple markets, serving millions of customers worldwide. Established in 2004, Tesco in Bengaluru is a multidisciplinary team that delivers high-quality services and technological solutions to enhance customer experience and streamline operations for over 330,000 employees globally. Tesco’s Bengaluru operations focus on process standardization, cost efficiency, and enabling agility through technology. Tesco Technology includes over 5,000 experts globally, spread across the UK, Poland, Hungary, the Czech Republic, and India. The Bengaluru division plays a pivotal role in delivering cross-functional expertise across Engineering, Product, Programme, Servi...

KPMG is hiring for an entry level Data Analyst role in US

Position: Data Analyst (Contract) Company: KPMG US Location: Seattle, Washington, United States Job Type: Contract Job Mode: Hybrid/Remote (as per project requirements) Job Requisition ID: Not specified in the original job description Years of Experience: Not mentioned explicitly; but looks like an entry level role from the JD Company Description: Global Professional Services Leader: KPMG US is one of the leading professional services firms globally, known for providing audit, tax, and advisory services. As part of the renowned Big Four accounting firms, KPMG operates across more than 75 offices in the United States, employing over 40,000 professionals who are dedicated to driving innovation and maintaining excellence in the field. Commitment to Career Growth and Learning: KPMG strongly emphasizes career development, offering robust formal education programs, leadership training, and mentorship opportunities. Professionals at KPMG benefit from its sta...

CVS Health is hiring for an entry level Data Science Analyst role in US

Position: Data Science Analyst Company: CVS Health Location: 161 Avenue of the Americas, New York, New York Job Type: Full-time Job Mode: Hybrid Job Requisition ID: R0527391 Years of Experience: Not explicitly mentioned; as per JD looks like an entry level role; 0-3 years Company Description: CVS Health is a leading health solutions provider in the United States, committed to improving the healthcare experience for millions of Americans. With a vast workforce of over 300,000 dedicated professionals, CVS Health leverages its local presence and digital channels to provide personalized and accessible healthcare solutions. The company is known for its patient-centric approach, ensuring care is delivered in a manner that is more connected, convenient, and compassionate. CVS Health is passionate about innovation and transformation in healthcare, driven by the goal of improving the quality of life for individuals and communities. Through its comprehensive range of services, CVS Health strives...

London Stock Exchange is hiring for a fresher entry level Junior Data Scientist role again in India

Position: Junior Data Scientist Company: London Stock Exchange Group (LSEG) Location: Bangalore, India (TowerE, RMZ Infin) Job Type: Full-time Job Mode: Hybrid Job Requisition ID: R0102107 Years of Experience: Not specified; looks like a fresher entry level role as per JD; 0-3 years Company Description LSEG (London Stock Exchange Group) is a premier global financial markets infrastructure provider, delivering essential data, technology, and analytics solutions. The organization plays a crucial role in financial stability, offering services that drive economic growth and empower businesses worldwide. With a workforce of over 25,000 employees spread across 65 countries, LSEG values innovation, collaboration, and sustainability. The company focuses on re-engineering financial ecosystems to promote green economy growth, support sustainable development, and enhance inclusive economic opportunities. At LSEG, diversity and inclusion are integral to the c...

Please enter your query here