Ab Initio Data Engineer

Required Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related technical field.
• 7+ years of ETL development experience with 5+ years of hands-on experience in Ab Initio development.
• Strong expertise with:
  • Ab Initio GDE (Graphical Development Environment)
  • Co> Operating System (Co> Op)
  • Enterprise Meta> Environment (EME)
  • Conduct> It
  • Data Profiler and Continuous Flows
• Strong understanding of parallel processing concepts, partitioning strategies, and Multi-File System (MFS).
• Advanced SQL skills with experience in relational databases, especially DB2.
• Strong experience with Unix/Linux shell scripting.
• Solid understanding of data warehousing concepts:
  • Dimensional modeling
  • Slowly Changing Dimensions (SCD)
  • Star and Snowflake schemas
• Experience designing and implementing Kafka-based data pipelines.
• Strong debugging, troubleshooting, and performance tuning skills for large-volume data processing.

Preferred Qualifications

• Experience with mainframe data integration: COBOL copybooks, VSAM, Flat files
• Exposure to Kubernetes or OpenShift environments.
• Familiarity with Hadoop/Spark ecosystems and hybrid ETL architectures.
• Experience with API-based integrations and streaming data solutions.
• Prior experience as a technical lead or in client-facing architecture roles.

Roles and Responsibilities

• Design, develop, and maintain complex ETL workflows and graphs using Ab Initio GDE.
• Architect end-to-end data integration solutions across multiple source and target systems including: RDBMS, Mainframe systems, Flat files, Message queues, Streaming platforms
• Optimize Ab Initio graph performance through: Parallelism, Partitioning techniques (Hash, Broadcast, Range), Layout optimization, Checkpointing strategies
• Develop and manage solutions using Ab Initio components including Co> Op, EME, Conduct> It, Data Profiler, and Continuous Flows.
• Implement CDC (Change Data Capture) and near-real-time data processing pipelines.
• Manage metadata, lineage, and data governance activities within EME.
• Troubleshoot production issues, perform root-cause analysis, and implement permanent fixes.
• Define development standards, review ETL code, and enforce Ab Initio best practices.
• Mentor junior and mid-level Ab Initio developers.
• Collaborate with data architects, DBAs, and business teams to translate requirements into technical solutions.