FREE ACCESS
5,000–10,000 jobs/day
See all jobs on JobTailor
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Tech Stack
Tools & technologiesDockerETLHadoopHDFSKubernetesMongoDBNoSQLPySparkPythonRDBMSSQLSSISTableau
About the role
Key responsibilities & impact- Design, build, and maintain robust, scalable, and high-performance data solutions
- Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
- Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
- Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
- Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
- Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
- Ensure essential procedures are followed and help define operating standards and processes
- Serve as advisor or coach to new or lower level analysts
- Acts as SME to senior stakeholders and /or other team members.
Requirements
What you’ll need- 5+ years of relevant experience as a data engineer
- Expertise in designing and implementing scalable data pipelines using Python/Pyspark, with experience in ETL tools (e.g., Microsoft BI/SSIS, IBM DataStage etc.)
- Advanced proficiency (3+ years) in RDBMS (T-SQL/PL/SQL) and NoSQL (e.g., MongoDB)
- Extensive experience (3+ years) with Hadoop ecosystem technologies (e.g., HDFS, Hive, Pig, Sqoop), preferably Cloudera
- Solid understanding of data warehousing, dimensional modeling, and 3NF to ensure scalable and performant data solutions.
- Ability to implement CI/CD pipelines, use Git for version control, and leverage Docker/Kubernetes for containerization.
- Experience contributing to enforcing good coding standards and participating in code reviews to maintain high-quality codebases.
- Skill in contributing to the enhancement of existing data frameworks and evaluating new technologies for adoption.
- Proficiency in managing data workflows with enterprise scheduling tools (e.g., Autosys).
- Experience with secure data connectivity tools (e.g., Connect Direct, SSH Tectia) and data visualization platforms (e.g., Tableau)
- Capability to utilize AI tools (e.g., Devin) for efficient code refactoring and optimization.
- Experience in systems analysis and programming of software applications.
- Experience in managing and implementing successful projects.
- Working knowledge of consulting/project management techniques/methods.
- Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements.
Benefits
Comp & perks- medical, dental & vision coverage
- 401(k)
- life, accident, and disability insurance
- wellness programs
- planned time off (vacation)
- unplanned time off (sick leave)
- paid holidays
ATS Keywords
✓ Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
data engineeringPythonPysparkETL toolsT-SQLPL/SQLNoSQLHadoopdata warehousingCI/CD pipelines
Soft Skills
problem solvingcommunicationcoachingconsultingproject managementtime managementadaptabilityanalytical thinkingcollaborationuser support