Data Engineer – SME
Agile Defense
full-time
Posted on:
Location Type: Hybrid
Location: Fort Bragg • North Carolina • United States
Visit company websiteExplore more
Tech Stack
About the role
- Design, develop, and maintain data ingestion pipelines to collect structured and unstructured data from user applications and bulk data sources.
- Implement efficient data transformation and storage strategies to facilitate easy retrieval and analysis.
- Collaborate with software development teams to optimize application-generated data for streamlined aggregation.
- Ensure data integrity, security, and compliance with industry regulations and company policies.
- Optimize query performance and improve data access patterns to support analytical and operational use cases.
- Work with business stakeholders to define data requirements and improve data accessibility for decision-making.
- Design and build APIs to support data ingestion, retrieval, and integration with external systems.
- Develop and maintain event-driven architectures, utilizing event storage for real-time data processing
Requirements
- Bachelor’s degree in Computer Science, Software Engineering, or a related technical field, or equivalent professional experience.
- Minimum of eight (8) years of relevant professional experience.
- Experience developing data pipelines, integration solutions, and data aggregation services in complex environments.
- Must possess an active TS/SCI security clearance.
- Due to U.S. Government contract requirements, only U.S. citizens are eligible for this position.
- 3+ years of experience in front-end development with a focus on React.
- Strong proficiency in JavaScript (ES6+), TypeScript, HTML5, and CSS3.
- Knowledge of modern CSS frameworks (Tailwind CSS, Styled Components, or SASS/SCSS).
- Experience with build tools and package managers (Webpack, Vite, pnpm, Yarn, npm).
- Familiarity with RESTful APIs, Eventstores, and WebSockets for data fetching.
- Experience with testing frameworks (Jest, React Testing Library, Cypress) is a plus.
- Knowledge of performance optimization techniques and best practices for front-end development.
- Experience with CI/CD pipelines and version control (Git, GitLab, etc.).
- Strong problem-solving skills and the ability to work independently or collaboratively.
- Proficiency in database technologies, including SQL, NoSQL, and event-based databases (e.g., PostgreSQL, MySQL, MongoDB, EventStoreDB).
- Strong programming skills in Golang, Python, and JavaScript/TypeScript.
- Experience with cloud-based data solutions (AWS, GCP, or Azure) and data warehousing.
- Familiarity with building APIs, data integration tools, and best practices for data aggregation.
- Understanding of API-based data aggregation and event-driven architectures.
- Experience working with streaming and batch data processing frameworks is a plus.
- Ability to work independently and collaboratively within a team.
- Building microservice APIs in Golang/Python (e.g., Gin, Echo, FastAPI, etc.) is a plus.
- Designing, maintaining, and updating database schemas and configurations (SQL/NoSQL/EventStoreDB) is a plus.
- Aggregating user-created and imported classified data into versioned datasets is a plus.
- Designing data provenance, lineage, retention, and management solutions is a plus.
Benefits
- Comprehensive benefits package
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
data ingestion pipelinesdata transformationdata aggregationfront-end developmentJavaScriptTypeScriptReactSQLNoSQLGolang
Soft Skills
problem-solvingcollaborationindependencecommunicationorganizational skills
Certifications
Bachelor's degree in Computer Scienceactive TS/SCI security clearance