Data Engineer III
BlueGrace Logistics
AzureCloudETLPySparkPythonSQLSSIS
Senior Big Data Engineer – Apps Dev Tech Lead
Citi
full-time
Posted on:
Location Type: Hybrid
Location: Tampa • Florida, Texas • 🇺🇸 United States
Visit company websiteSalary
💰 $113,840 - $170,760 per year
Job Level
Senior
Tech Stack
AirflowApacheAWSAzureCloudDockerETLGoogle Cloud PlatformHadoopKafkaKubernetesOraclePostgresPythonScalaSparkSQL
About the role
- Partner with multiple management teams to ensure appropriate integration of functions to meet goals
- Identify and define necessary system enhancements to deploy new products and process improvements
- Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes
- Provide expertise in area and advanced knowledge of applications programming
- Ensure application design adheres to the overall architecture blueprint
- Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
- Develop comprehensive knowledge of how areas of business integrate to accomplish business goals
- Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
- Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary
- Appropriately assess risk when business decisions are made
Requirements
- 6-10 years of experience with Data Pipeline Development
- Design, build, and maintain scalable ETL/ELT pipelines to ingest, transform, and load data from multiple sources
- Big Data Infrastructure: Develop and manage large-scale data processing systems using frameworks like Apache Spark, Hadoop, and Kafka
- Proficiency in programming languages like Python, or Scala
- Strong expertise in data processing frameworks such as Apache Spark, Hadoop
- Expertise in Data Lakehouse technologies (Apache Iceberg, Apache Hudi, Trino)
- Experience with cloud data platforms like AWS, Azure, or GCP
- Expertise in SQL and database technologies (e.g., Oracle, PostgreSQL, etc.)
- Experience with data orchestration tools like Apache Airflow or Prefect
- Familiarity with containerization (Docker, Kubernetes) is a plus
- Prior experience with building distributed, multi-tier applications is highly desirable
- Experience with building apps which are highly performant and scalable will be great
Benefits
- medical, dental & vision coverage
- 401(k)
- life, accident, and disability insurance
- wellness programs
- planned time off (vacation)
- unplanned time off (sick leave)
- paid holidays
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
Data Pipeline DevelopmentETLELTApache SparkHadoopKafkaPythonScalaSQLData Lakehouse
Soft skills
problem-solvinganalytical thinkingcoachingrisk assessmentcommunication
