
Data Engineer
3Core Systems, Inc
contract
Posted on:
Location Type: Hybrid
Location: Orlando • Florida • United States
Visit company websiteExplore more
Salary
💰 $55 per hour
Job Level
About the role
- Design, develop, and maintain IBM DataStage ETL jobs that ingest file feeds (CSV, fixed-width, delimited) and load curated destination tables in SQL Server.
- Build end-to-end ETL flows, including staging, transformations, validations, and publishing to downstream schemas.
- Perform source-to-target mapping and implement transformation logic based on business and technical requirements.
- Use common DataStage stages and patterns (e.g., Sequential File, Transformer, Lookup, Join/Merge, Aggregator, Sort, Funnel, Remove Duplicates), with attention to partitioning and parallel job design.
- Write, optimize, and tune SQL Server queries, stored procedures, and T?SQL scripts used in ETL workflows.
- Implement restartable and supportable jobs: parameterization, robust logging, reject handling, auditing columns, and reconciliation checks.
- Apply data quality controls (format checks, referential checks, null/duplicate checks, threshold checks) and produce clear exception outputs for remediation.
- Monitor and troubleshoot ETL runs using DataStage Director/Operations Console and SQL Server tooling; perform root-cause analysis and fix defects.
- Improve performance through job design tuning (partitioning strategy, sorting choices, buffering, pushdown where appropriate) and SQL tuning (indexes, statistics, set-based logic).
Requirements
- Hands-on IBM DataStage ETL development experience, including data mapping and transformation implementation.
- Strong SQL Server experience with advanced T?SQL (joins, window functions, CTEs, temp tables, indexing basics, query plans).
- Solid understanding of file-based ingestion and parsing (CSV, fixed-width, headers/trailers, control totals, encoding, delimiters, quoting/escaping).
- Experience designing ETL jobs with good operational characteristics: parameter-driven design, logging, error handling, restart/re-run strategy, and auditability.
- Ability to troubleshoot data issues end-to-end (source file – stage tables – target tables) and communicate findings clearly.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
IBM DataStageETLSQL ServerT-SQLdata mappingdata transformationfile-based ingestionquery optimizationdata quality controlsroot-cause analysis
Soft Skills
troubleshootingcommunicationproblem-solvingattention to detailanalytical thinking