
Senior Data Engineer
RxSense
full-time
Posted on:
Location Type: Remote
Location: United States
Visit company websiteExplore more
Salary
💰 $140,000 - $150,000 per year
Job Level
About the role
- Analyze and interpret complex data Ability to identify data anomalies and resolve data issues.
- Understand specific business processes and domain concepts and relate them to data subject domains.
- Optimize SQL queries, scripts, and stored procedures in Snowflake and SQL Server to improve efficiency and reduce processing time.
- Integrate and manage data from various sources, ensuring data quality, reliability, and performance
- Design, develop, and maintain scalable and high-performance ETL pipelines using Matillion ETL to ingest, transform, and load data into Snowflake.
- Monitor data pipeline and ETL performance, identifying bottlenecks and making necessary adjustments to ensure optimal system performance.
- Perform troubleshooting and root cause analysis to resolve data issues and prevent future occurrences.
- Develop and implement data models within Snowflake to support business intelligence and analytics requirements.
- Collaborate with Data Leads, Product Managers and QA Engineers to validate requirements, participate in user requirement sessions.
- Perform tests and validate data flows and prepare ETL processes according to business requirements.
- Perform ETL tuning and SQL tuning.
- Ability to document data flows representing business logic in ETL routines.
- Design and implement data conversion strategy from legacy to new platforms.
- Perform design validation, reconciliation, and error handling in data load processes.
- Design and prepare technical specifications and guidelines including ER diagrams and related documents.
Requirements
- Must be well versed with Data warehousing concepts including design patterns (Star schemas, Snowflake design schemas). Must be aware of data modeling concepts including the data modeling Normal forms.
- Knowledge of AWS Infrastructure including S3, SNS, EC2, CloudWatch and RDS.
- 8+ years working in ETL/Data transformation projects with one or more related products such as Informatica or Talend or Microsoft SSIS.
- Experience in business intelligence, data warehousing initiatives.
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases like Oracle or MS SQL Server or Snowflake.
- Strong SQL and Python skills with experience in query optimization and performance.
- Strong analytical, problem-solving, and communication skill.
- Bachelor’s in mathematics, Computer Science or related technical field.
- Experience with additional ETL tools, data transformation methods, or cloud platforms is a plus.
- Healthcare and PBM: PBM-specific knowledge and experience with transforming various healthcare data is a plus, but not required.
- Experience with Matillion ELT tool and Snowflake Database is preferred.
- Experience in building AWS Data Pipelines using Python or Spark, SparkSQL in any of Cloud Environments (AWS / Azure / Google).
Benefits
- RxSense believes that a diverse workforce is a more talented and productive workforce.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
SQLETLdata modelingdata warehousingdata transformationquery optimizationPythonMatillion ETLSnowflakeAWS
Soft skills
analyticalproblem-solvingcommunication