Back

Job details
Apply Application

Customer Job

Data Engineer

Job ID: 25-10658

Primary Skills: Data Engineering, Databricks, Pyspark, Apache Airflow, Apache Spark
Location: San Jose, CA (Hybrid – 3 days/week onsite)
Duration: 5 months
Contract Type: W2 only
Pay Rate: $99.13/Hour

Responsibilities

Design, develop, and maintain scalable and reliable data pipelines to support large-scale data processing.
Build and optimize data workflows using orchestration tools like Apache Airflow and Spark to support scheduled and event-driven ETL/ELT processes.
Implement complex parsing, cleansing, and transformation logic to normalize data from a variety of structured and unstructured sources.
Collaborate with data scientists, analysts, and application teams to integrate, test, and validate data products and pipelines.
Operate and maintain pipelines running on cloud platforms (AWS) and distributed compute environments (e.g., Databricks).
Monitor pipeline performance, perform root cause analysis, and troubleshoot failures to ensure high data quality and uptime.
Ensure proper security, compliance, and governance of data across systems and environments.
Contribute to the automation and standardization of data engineering processes to improve development velocity and operational efficiency.

Required Skills

9-12 YOE
Proficient in Python and PySpark for data processing and scripting.
Strong experience with SQL for data manipulation and performance tuning.
Deep understanding of distributed data processing with Apache Spark.
Hands-on experience with Airflow or similar orchestration tools.
Experience with cloud services and data tools in AWS (e.g., S3, Lambda, SQS, Gateway, Networking).
Expertise with Databricks for collaborative data engineering and analytics.
Solid understanding of data modeling, data warehousing, and best practices in data pipeline architecture.
Strong problem-solving skills with the ability to work independently on complex tasks.
Familiarity with CI/CD practices and version control (e.g., Git) in data engineering workflows.

CV or resume

Choose file

or drag and drop file here

For best results, upload *.doc/.docx/.pdf format files only (File size must be less than 2MB)

Personal information

Tell us something about yourself

First Name *

Last Name *

Email ID *

Phone Number *

Total Experience *

LinkedIn Profile

Captcha *

By entering the information above, you allow Intelliswift to collect, obtain, store and transfer your data for this and any other future job postings. If you wish to withdraw your consent, you may write to us at informationsecurity@intelliswift.com

How may I help you?

Intelliswift's Data & Artificial Intelligence Solutions form strategic alliances to deliver unmatched digital excellence. By unlocking the power of Data and AI in the cloud, we help accelerate the next wave of product and market growth.

Interview

Case study

Blog

Our Agentic AI solutions help organizations automate complex tasks, make faster decisions, and improve efficiency with minimal oversight. Our intelligent systems can learn continuously and deliver measurable business outcomes.

Blog

Interview

Our Data Engineering solutions help enterprises create scalable AI/ML platforms, enhancing insights and driving business success through innovation. Our approach ensures a profound digital transformation, aligning your data infrastructure with current and future needs.

Blog

Blog

Intelliswift's Business Intelligence & Analytics solutions transform data into intelligent decisions, empowering businesses with real-time insights and a scalable growth model. Our robust services convert complex data into actionable insights through compelling visuals and AI-powered analytics.

Elevate your enterprise with our Digital Enterprise solutions. Smoothly integrate people, processes, and advanced technologies for modernization across mobile, web, cloud, social, and analytics.

Blog

Case Study

Datasheet

Case Study

Blog

Cybersecurity is crucial in modern business. We prioritize securing your business value chain and protecting digital and physical perimeters, internal processes, human resources, applications, data, and networks.

Case Study

Case Study

Navigate the evolving business landscape with our customer-centric enterprise solutions. From ERP and CRM to CMS and ITSM, we empower growth with efficient and cost-effective solutions.

Experience the transformative impact on your business with our Salesforce Center of Excellence, a hub of innovation and expertise poised to elevate your operations to new heights. Our highly certified team ensures exceptional results across industries, delivering quick wins and lasting value.

Blog

Blog

Effective project management is critical for Technology PMOs, especially with today's distributed teams and numerous business applications. Intelliswift's specialized Smartsheet services help bridge gaps in people and process management.

Datasheet

Webinar

Simplify Technology infrastructure with our Digital Integration - tailored solutions in API management, Google Cloud Platform, Enterprise Integration, and Microservices. Achieve efficient cloud-enabled integration, cutting-edge services, and robust governance.

Blog

Blog

Datasheet

Intelliswift's Enterprise Integration Solutions connect systems and applications to enable seamless data flow and streamlined operations. Using tools like ESB, iPaaS, and cloud integration, we help modernize legacy systems and boost business agility.

As a certified Google Cloud Partner, we help businesses maximize the value of GCP through cloud modernization, data analytics, and AI/ML solutions. With a focus on scalability, security, and seamless integration, we enable faster innovation and smarter digital transformation.

Discover Digital Product Engineering with us, leveraging advanced technologies like Blockchain, AI, and IoT. Accelerate your roadmap through extended engineering centers, Microservices, and agile models, embracing innovation with tailored solutions.

Blog

Case Study

Datasheet

Strategize and innovate with our product development experts. From conceptualization to technology and architecture, we guide your journey for scalable, future-proof solutions tailored to your needs.

Embrace the future with our agile solutions—from product conceptualization to modernization. We offer industry-leading development, UX/UI design, and applied AI services seamlessly integrated through our comprehensive in-built framework.

Navigate the complexities of product engineering with our integrated Product Lifecycle Services. Explore our Performance Engineering, DevOps Solutions, and Sustenance Engineering services for holistic and effective outcomes.

From navigating the evolving technology landscape to addressing skills gaps, explore our technology solutions. Redefine your digital processes with innovation-led engineering, analytics-driven platforms, and people-centric solutions.

Blog

Datasheet

Blog

Elevate your position in the dynamic financial landscape with customized solutions that streamline operations, integrate customer data visibility, enhance security, and incorporate cutting-edge fraud detection and digital transformation tools.

Blog

Case Study

Datasheet

Blog

Case Study

Intelliswift's healthcare services revolutionize operations, elevate patient care, and ensure regulatory compliance, giving healthcare businesses a transformative edge. Our holistic Technology solutions empower seamless, patient-centric services.

Case Study

Blog

Case Study

Explore Intelliswift's solutions for the dynamic pharmaceutical sector, spanning DMA Advisory, Data Science & Analytics, Data Management & Engineering, and Veeva CRM Management & Engineering for optimized operations.

Case Study

Case Study

Blog

Intelliswift redefines retail success through digital transformation, focusing on enhanced customer experiences, compelling marketing insights, and agile business transformation in the dynamic retail landscape.

Blog

Case Study

Blog

As a global leader in Digital Product Engineering, Data Management, Analytics & AI, and Digital Enterprise Solutions, we are led by a team of passionate and technology-driven innovators who infuse a commitment to embracing innovation into everything we do.

At Intelliswift, our vibrant culture, defined by innovation and passion, encourages Intellians to explore their full potential, contribute authentically, and collectively shape a better world through inclusive and empowering teamwork.

Discover visionary leadership at Intelliswift—industry experts embodying a Love for New. Our global executive team, comprised of thought leaders driving progress, ensures client success with expertise and motivation.

Embark on a journey through our collective triumphs. Uncover the awards and accolades that showcase our unwavering commitment to excellence, advancement, and the success of our clients.

We are taking the lead to make a serious impact on our communities by supporting both local and national charities, nonprofits, and organizations. Intelliswift provides and encourages all employees to volunteer for opportunities and organizations that are important to them.

Explore a resilient future through Intelliswift's Events and Webinars. Elevate your knowledge with thought leadership, fostering meaningful conversations and actionable decisions for organizational growth.

Inspiring stories and insights from women shaping the future of leadership. Tune in to gain insights and be inspired.

Get a comprehensive view of our journey that underscores our steadfast commitment to excellence. Dive into the latest updates showcasing our evolution, achievements, and strategic executions.

At Intelliswift, we prioritize Diversity, Equity, and Inclusion (DEI), fostering an inclusive workplace by attracting diverse talent, promoting gender diversity, and ensuring equitable practices globally.

The Intelliswift Alumni Network aims to foster connection and inspiration within the worldwide Intelliswift community, encouraging members to enhance their professional networks and stay connected with fellow Intelliswift alums.

Navigate your professional journey with us. Join our community of like-minded professionals, where collaboration and continuous learning propel you toward unparalleled career growth and fulfillment.

Join us to work on challenging projects, embrace new technologies, and collaborate with global brands. Discover an environment that fosters creativity, values diversity, and offers continuous learning opportunities, empowering you to thrive in your professional journey.

iNurture is a focused initiative where we seek young professionals from a non-engineering background with a passion for coding. The program provides the perfect gateway into the Technology industry.

Intelliswift's Data & Artificial Intelligence Solutions form strategic alliances to deliver unmatched digital excellence. By unlocking the power of Data and AI in the cloud, we help accelerate the next wave of product and market growth.

Interview

Case study

Blog

Our Agentic AI solutions help organizations automate complex tasks, make faster decisions, and improve efficiency with minimal oversight. Our intelligent systems can learn continuously and deliver measurable business outcomes.