Principal Data Engineer
Docker, Inc
AirflowApacheAWSAzureBigQueryCloudDistributed SystemsDockerERPETLGoGoogle Cloud Platform+7 more
Job Level
Mid-LevelSenior
Tech Stack
AirflowETLMySQLNumpyPandasPostgresPythonRDBMSSQLVBA
About the role
- Identify and resolve discrepancies between data sources and leverage automation tooling to aid in data integrity and efficiency
- Design and implement ETL (Extract, Transform, Load) processes to efficiently move data between systems while ensuring data quality and integrity
- Develop automated quality checks and monitoring procedures to ensure financial data consistency and compliance
- Build and maintain scalable data pipelines to aggregate and process data from diverse sources (relational databases, APIs etc)
- Develop Python scripts and applications using libraries such as Pandas, NumPy, and SQLAlchemy for data manipulation, transformation, and analysis
- Create automated data validation frameworks using Python testing libraries to ensure data quality and consistency
- Apply accounting principles to ensure financial data integrity and develop meaningful financial analytics
- Be an energetic ‘self-starter’ with the ability to take ownership and be accountable for individual deliverables
- Collaborate with cross-functional teams worldwide as part of a high-performing Production Systems team
Requirements
- 3+ years of Experience with fixed asset management systems, including asset tracking, depreciation calculations, and financial reconciliation
- Strong experience with ETL methodologies and tools for data integration and transformation, leveraging frameworks
- Advanced Python programming skills with expertise in data engineering libraries (Pandas, NumPy, SQLAlchemy, Airflow)
- Experience using Jira's REST API to extract project data for reporting and analytics purposes
- Advanced Excel skills including complex formulas, pivot tables, VBA macros, and Power Query for financial data manipulation
- Experience designing schemas and optimizing SQL queries for RDBMS such as MySQL or Postgres
- Fundamental understanding of accounting principles and financial reporting requirements
- Must work effectively and professionally with cross-functional groups across divisions as part of a worldwide team
- Must be able to work with a distributed team in multiple time zones
- Must exhibit meticulous attention to detail, and have the ability to make good, timely decisions
- Demonstrate self-learning capabilities, taking initiative in a fast pace/quickly changing environment
- Excellent written and verbal communication skills are required
- Bonus: Understanding of GAAP/IFRS accounting standards for fixed assets
- Bonus: Experience with compliance frameworks (SOX, SOC2, FEDRAMP)
- Bonus: Experience working in a large-scale production environment and/or with bare-metal hardware
- Bonus: Process governance experience and or strong automation workflow knowledge
- Bonus: Experience working with data center infrastructure and asset management
Similar jobs on JobTailor
Senior Data Analyst – Reporting & Automation
aKUBE
AirflowD3.jsETLNode.jsPythonSQLTableau
Data Engineer
Spotify
AirflowApacheAWSAzureCassandraDistributed SystemsDynamoDBETLGoogle Cloud PlatformGRPCHadoopJava+9 more
Software Engineer, Coaching
Teamworks
AirflowApacheAWSCloudD3.jsDockerETLJavaScriptKafkaMongoDBMySQLNoSQL+4 more
Senior Data Engineer
Tubi
AirflowAWSCloudPandasPythonSparkSQL