Senior Data Engineer
Parser
Amazon RedshiftAWSAzureCloudNumpyPandasPySparkPythonSQL
Job Level
Senior
Tech Stack
AWSPySparkPythonSparkSQL
About the role
- Design, build, and maintain robust data pipelines to power the market intelligence platform
- Integrate diverse data sources and work with external APIs
- Ensure data quality and implement data quality management practices
- Create scalable data infrastructure to support company growth
- Collaborate with the team to map company and contact information for the employee benefits market
- Provide technical ownership and autonomously drive projects to completion
Requirements
- 10-20 years of experience in data engineering, preferably from big tech backgrounds
- Expert-level Python programming skills
- Advanced SQL capabilities
- Experience building data pipelines at scale
- Proven ability to work with external APIs
- Strong understanding of data ingestion and transformation processes
- Excellent communication and autonomous working style
- US-based candidates only
- Technical skills: Python, SQL, API integration, AWS fundamentals, Data pipeline design and implementation
- Nice to haves: Experience with DBT
- Nice to haves: Background in employee benefits or market intelligence sectors
- Nice to haves: Exposure to startup environments
- Nice to haves: Spark or PySpark knowledge
- Nice to haves: Experience with data quality management
- Nice to haves: Startup transition experience (moving from large, structured environments)
- Candidates should be ready to demonstrate technical prowess through live coding interviews and system design
Similar jobs on JobTailor
Senior Data Engineer
The Muse
ApacheAWSAzureCloudETLPySparkPythonScalaSparkSQL
Cloud Data Engineer
aKUBE
Amazon RedshiftAWSCloudDynamoDBETLJenkinsMySQLNode.jsPostgresPySparkPythonSQL+1 more
Senior Product Manager - Data and Implementation Tools
Rightway
AWSCyber SecurityETLPySparkPython
Senior Data Engineer
8020REI
ApacheAWSCloudEC2ETLMongoDBNoSQLPySparkPythonSQLTableau