
Senior Data Engineer
Healthfirst
full-time
Posted on:
Location Type: Remote
Location: Remote • Connecticut, New Jersey, New York • 🇺🇸 United States
Visit company websiteSalary
💰 $131,900 - $190,570 per year
Job Level
Senior
Tech Stack
AWSAzureCloudETLGoogle Cloud PlatformHadoopNoSQLPySparkPythonSQL
About the role
- Designs and implements standardized data management procedures around data staging, data ingestion, data preparation, data provisioning, and data destruction (e.g., scripts, programs, automation, etc.)
- Ensures quality of technical solutions as data moves across multiple zones and environments
- Provides insight into the changing data environment, data processing, data storage and utilization requirements for the company, and offer suggestions for solutions
- Ensures managed analytic assets to support the company’s strategic goals by creating and verifying data acquisition requirements and strategy
- Develops, constructs, tests, and maintains architectures
- Aligns architecture with business requirements and uses programming language and tools
- Identifies ways to improve data reliability, efficiency, and quality
- Conducts research for industry and business questions
- Deploys sophisticated analytics programs, machine learning, and statistical methods to efficiently implement solutions
- Prepares data for predictive and prescriptive modeling and find hidden patterns using data
- Uses data to discover tasks that can be automated
- Creates data monitoring capabilities for each business process and works with data consumers on updates
- Aligns data architecture to the solution architecture; contributes to overall solution architecture
- Develops patterns for standardizing the environment technology stack
- Helps maintain the integrity and security of company data
- Additional duties as assigned or required
Requirements
- 8+ Years overall IT experience
- Enterprise experience in scripting languages primarily Python and Pyspark building enterprise frameworks
- Enterprise experience in data ingestion methodologies using different etl tools(Glue,DBT or any other)
- Enterprise experience in data warehousing concepts and big data technologies like EMR, Hadoop
- Enterprise experience in any cloud infrastructure like AWS,GCP,Azure
- Strong SQL expertise across different relational and NoSQL Databases.
Benefits
- medical, dental and vision coverage
- incentive and recognition programs
- life insurance
- 401k contributions
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
PythonPysparkETLSQLHadoopEMRAWSGCPAzuredata warehousing
Soft skills
problem-solvinganalytical thinkingcommunicationcollaborationresearch