Director of Data Engineering
Flashfood
AirflowSparkSQL
Senior Data Engineer
Redhorse Corporation
full-time
Posted on:
Location Type: Remote
Location: Remote • Virginia • 🇺🇸 United States
Visit company websiteJob Level
Senior
Tech Stack
ApacheAWSAzureCloudETLSpark
About the role
- Support the configuration and ingestion of structured, unstructured, and semi-structured data repositories into capabilities meeting mission partner requirements, supporting a data analytics and DevOps pipeline for rapid delivery of functionality.
- Maintain all operational aspects of data transfers, accounting for the security posture of the underlying infrastructure and supported systems and applications; monitor environmental health using various tracking capabilities.
- Automate configuration management, leverage appropriate tools, and stay current on ETL technologies and services.
- Work under general guidance, demonstrating initiative to develop solutions independently; review architecture and identify areas for automation, optimization, right-sizing, and cost reduction to improve environmental health.
- Apply comprehension of data engineering technologies and services, leveraging database expertise and various data structuring and retrieval approaches; comprehend cloud architectural constructs and support programmatic Cloud environment establishment and maintenance using vendor consoles.
- Engage with multiple functional groups to understand client challenges, prototype new ideas and technologies, create solutions to drive innovation, and design, implement, schedule, test, and deploy full features and components of solutions.
- Identify and implement scalable and efficient coding solutions.
- Apply DoD Security Technical Implementation Guides (STIGs) and automate that process.
Requirements
- Bachelor’s degree plus 7+ years of experience, or a Master’s degree plus 5 years of experience.
- Experience with big data systems, including Apache Spark and Databricks.
- Experience with ETL processes.
- Experience with the Advana Data Environment.
- Experience with Amazon Web Services (AWS), Microsoft Azure, or MilCloud 2.0.
- Experience engineering data pipelines across multiple security domains/classified networks.
- Experience with multiple coding languages.
- Active Secret security clearance.
Benefits
- Equal Opportunity Employer/Veterans/Disabled
- If you are a qualified individual with a disability or a disabled veteran, you may request a reasonable accommodation if you are unable or limited in your ability to access job openings or apply for a job on this site as a result of your disability. You can request reasonable accommodations by contacting Talent Acquisition at Talent-Acquisition@redhorsecorp.com
- Redhorse Corporation shall, in its discretion, modify or adjust the position to meet Redhorse’s changing needs.
- This job description is not a contract and may be adjusted as deemed appropriate in Redhorse’s sole discretion.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
ETLApache SparkDatabricksdata engineeringcoding languagesdata pipelinesconfiguration managementautomationcloud architecturedata structuring
Soft skills
initiativeproblem-solvingcollaborationinnovationcommunicationindependenceoptimizationcost reductionprototypingtesting
Certifications
Bachelor's degreeMaster's degreeActive Secret security clearance
