---

IBM Careers: Data Engineer – Data Platforms in Hyderabad | Spark, Azure, and Cloud Data Engineering Role

Job Title: Data Engineer – Data Platforms
Location: Hyderabad, Telangana, India
Job ID: 23909
Employment Type: Regular, Full-Time
Experience Level: Entry-Level / Early Professional
Work Arrangement: Hybrid
Area of Work: Software Engineering – Consulting
Shift: General (Daytime)
Travel Requirement: Up to 20%
Company: IBM India Private Limited

---

Launch Your Cloud Data Engineering Career with IBM

Are you a skilled data engineer looking to work with global enterprises, cutting-edge technology, and high-impact cloud platforms? IBM is inviting talented professionals to join its Client Innovation Center (CIC) in Hyderabad as a Data Engineer – Data Platforms.

In this role, you’ll contribute to the design, development, and deployment of scalable data solutions using Apache Spark, Python, PySpark, and Azure Cloud technologies. If you’re passionate about building cloud-based data architectures and solving real-world data engineering challenges, this role provides the perfect launchpad.

---

About IBM Consulting

IBM Consulting is IBM’s global consulting and digital transformation business. Backed by more than a century of innovation, IBM Consulting helps organizations navigate their digital journey through strategy, cloud, AI, automation, and data-driven solutions.

Within IBM’s Client Innovation Centers, you’ll collaborate on enterprise-grade projects while being part of a localized delivery team that works with Fortune 500 clients across public and private sectors.

---

About the Role: Data Engineer – Data Platforms

As a Data Engineer, you will be responsible for building and maintaining advanced data pipelines and processing frameworks. Your focus will be on leveraging Apache Spark, Python, Scala, and Azure Data Services to manage large-scale datasets and deliver meaningful business insights.

You will play a key role in implementing solutions that support real-time analytics, stream processing, and data lake architectures, all while following industry best practices for performance, security, and compliance.

---

Key Responsibilities

• Design and implement robust data ingestion pipelines that can handle structured, semi-structured, and unstructured data from diverse sources like files, streams, and relational databases.

• Use Apache Spark, PySpark, and Python or Scala to transform and enrich datasets for downstream analytical use.

• Work with Azure Cloud Data Platform, Databricks, HDInsight, Synapse Analytics, Azure Data Factory, and SQL Server to develop end-to-end data solutions.

• Develop and manage streaming data pipelines to support real-time decision-making.

• Apply efficient coding practices to optimize big data processing frameworks, reduce compute overhead, and enhance performance.

• Collaborate with architects, data scientists, and business analysts to interpret requirements and design scalable, reusable solutions.

• Maintain documentation, unit test scripts, and deployment templates for continuous integration and delivery (CI/CD).

• Troubleshoot production issues, identify bottlenecks, and continuously improve pipeline resiliency.

---

Basic Qualifications

Education

• Required: Bachelor’s Degree in Computer Science, Information Technology, Engineering, or a related field.

• Preferred: Master’s Degree in Data Science, Computer Applications, or Big Data Analytics.

Experience

• Total Experience: 6–7+ years in Data Management or Data Engineering.

• Relevant Experience: Minimum 4+ years in Big Data technologies, particularly with Apache Spark, Python, or Scala.

• Minimum 3 years of hands-on experience working with Azure Cloud Data Platforms.

• Experience in managing data lake, data warehouse, or lakehouse architectures.

---

Required Technical Skills

• Deep expertise in Spark Framework and big data pipelines.

• Strong programming skills in Python, PySpark, or Scala.

• Proven experience with cloud technologies, particularly Microsoft Azure and related services like:

  • Databricks

  • Azure HDInsight

  • Azure Synapse Analytics

  • Azure Data Factory

  • SQL Server DB

• Advanced SQL development and optimization skills.

• Familiarity with NoSQL databases such as HBase or Cosmos DB (preferred).

• Understanding of distributed file systems like HDFS.

---

Preferred Qualifications and Certifications

• Azure or Databricks Certification (Microsoft Certified: Azure Data Engineer Associate).

• Cloudera Certified Spark Developer (CCSD) or similar.

• Familiarity with Kafka, Airflow, Delta Lake, or Snowflake is an added advantage.

• Experience working in Agile/Scrum development environments.

---

Soft Skills and Attributes

• Strong verbal and written communication skills for stakeholder collaboration.

• Team player mindset with a problem-solving attitude.

• Ability to multitask in a fast-paced environment.

• Passion for automation, optimization, and innovation.

• Open to continuous learning and professional development.

---

Why IBM?

At IBM, innovation isn’t just a buzzword—it’s a way of life. We’ve been pushing technological boundaries since 1911, from building the first mainframes to developing cutting-edge AI, blockchain, and quantum computing solutions.

As an IBM Data Engineer, you’ll work on meaningful, world-changing projects while enjoying:

✨ Global Exposure

Work with clients across industries including finance, healthcare, manufacturing, and retail.

🌐 Technology Leadership

Stay on the frontlines of technology adoption—be it hybrid cloud, AI, or big data.

🤝 Collaborative Culture

Be part of inclusive, agile teams that value knowledge sharing and continuous improvement.

🚀 Career Development

Access a robust learning ecosystem with certifications, internal training, mentoring, and global networking opportunities.

---

IBM’s Commitment to Diversity and Inclusion

IBM is proud to be an equal opportunity employer, committed to fostering an inclusive, diverse, and accessible workplace. We welcome applicants of all backgrounds and ensure fair treatment regardless of race, gender, disability, veteran status, sexual orientation, or identity.

IBM also fully complies with employment and immigration regulations, ensuring ethical and legal hiring practices globally.

---

Job Summary Table

---

Who Should Apply?

This opportunity is ideal for:

• Experienced Spark developers seeking career growth in Azure data engineering.

• Professionals with strong coding and data pipeline expertise.

• Engineers looking for exposure to enterprise-scale big data solutions.

• Entry-level professionals transitioning into cloud-native data engineering.

---

How to Apply

Ready to shape the future with IBM?

👉 Click “Apply Now” via the IBM Careers Portal or LinkedIn. Tailor your resume to highlight:

• Data engineering and Spark projects

• Azure cloud experience

• Data pipeline implementation or optimization

• Any relevant certifications

Apply Here