Tech Stack
Amazon RedshiftAWSAzureCassandraCloudETLGoogle Cloud PlatformHBaseJavaScriptLinuxMS SQL ServerNoSQLOraclePostgresPythonRubySQLUnix
About the role
- Create and maintain data pipeline architectures.
- Assemble large, complex data sets for project teams and data scientists.
- Build the infrastructure required for optimal data extraction, transformation, and loading from a wide variety of data sources using SQL, NoSQL, and ‘big data’ technologies.
- Design and implement automated solutions for common data transfer or transformation tasks.
- Build analytics tools that utilize the data pipeline to provide actionable insights.
- Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs.
- Keep our data separated and secure across multiple data centers and cloud services.
- Create data tools for data scientists that assist them in building and optimizing their models.
- Document and version schema changes across all database stacks.
Requirements
- 4+ years in a Data Engineering or similar position.
- Previous system administration with linux and windows.
- Must have strong SQL skills.
- Extensive experience in managing large scale databases such as Postgres, MS SQL Server, or Oracle.
- Experience with Cloud Databases such as Snowflake, AWS RDS/Redshift, GCP databases or Azure databases
- Extensive experience with NoSQL databases such as HBase, Cassandra, or Dynamo.
- Fluency in one or more scripting languages for ETL and data task automation such as Unix shell, Python, Ruby, TCL, or Javascript.
- Experience in data security and management of PII.
- Some positions will require access to U.S. National Security information; In order to qualify for this position, the candidate must be a US Citizen and either currently possess this National Security eligibility or be able to complete the investigation application process with a favorable determination and maintain that eligibility throughout their employment.
- E-Verify is used to confirm employment eligibility to work in the United States.