A.C.Coy Company

Cloud Architect, Data Lake / Databricks

A.C.Coy Company

contract

Posted on:

Location Type: Hybrid

Location: Raleigh • North Carolina • 🇺🇸 United States

Visit company website
AI Apply
Apply

Job Level

SeniorLead

Tech Stack

ApacheAzureCloudETLHadoopPerlPythonRubySparkSQLTableau

About the role

  • Provide advice and assistance in state-of-the-art software/hardware solutions involving hardware of various capacities, multiple operating environments, database management systems, specialized software, data communications facilities and protocols, and complex software tools or packages.
  • Work with senior client officials to identify enterprise improvement goals, assess organizational and process effectiveness, and implement change strategies.
  • Assist with deployment, configuration, and management of Azure Cloud environment.
  • Assist with migration efforts of existing ETL jobs into Azure/Databricks cloud environment.
  • Assist ETL staff with following best practices for Cloud, maximizing efficiency of cloud resources, and general knowledge sharing of cloud expertise with AA Cloud Staff.
  • Assist with operationalizing deployments and support of Cloud services for ETL Operations, including standardizing and automating processes and workflows and creating documentation/knowledge articles.
  • Evaluate programs, disseminate findings, consult and collaborate with others, and adhere to ethical standards.
  • Conduct knowledge-transfer sessions on monitoring, troubleshooting, incident alerting/avoidance, dashboards, security, testing, and audit compliance reporting.
  • Prepare and deliver monthly status reports including work progress, identified risks or technical issues with recommendations, and schedule deviation recovery plans.

Requirements

  • Master’s Degree from an accredited College/University in the applicable field of services.
  • 15+ years of IT Architecture/Systems experience
  • 10+ years of experience designing technical and business solutions, mentoring and training client staff, and overseeing implementation.
  • Strong Cloud Operations support experience in regard to Azure.
  • Strong experience supporting large scale/enterprise level Cloud environments.
  • Strong experience supporting several cloud services related to compute, network, databases, etc.
  • Experience in using Databricks or other Spark-based platforms.
  • Knowledge of or experience in using any of the following: Sqoop, Oozie, Flume
  • Fluency in at least one scripting language (Python, Perl, Ruby or equivalent)
  • Ability to troubleshoot cloud resource problems and perform complex system tests.
  • Develop and maintain accurate documentation for internal procedures and services.
  • Ability to automate solutions to repetitive problems/tasks.
  • Ability to use a wide variety of open-source technologies and cloud services.
  • Integration of Git in continuous deployment
  • Experience with DevOps monitoring tools
  • Significant experience with SAS, Python, C++, Hadoop, SQL Database/Coding, Apache Spark, Machine Learning, Natural Language Processing, and visualization tools such as Tableau
  • Demonstrated experience working with unstructured data.
  • Must be eligible to obtain Public Trust clearance.
  • All candidates must be US Citizen or have permanent residence status (Green Card).
  • Candidate must have lived in the United States for the past 5 years.
  • Cannot have more than 6 months travel outside the United States within the last 5 years (Military Service excluded).

ATS Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard skills
Azure CloudETLDatabricksPythonSASC++HadoopSQL DatabaseApache SparkMachine Learning
Soft skills
mentoringtrainingtroubleshootingdocumentationautomationcollaborationcommunicationproblem-solvingorganizationalknowledge transfer
Certifications
Master’s DegreePublic Trust clearance
Interface Systems

Data Engineer - Senior Manager

Interface Systems
Seniorfull-time$130k–$150k / year🇺🇸 United States
Posted: 38 days agoSource: interfacesystems.wd5.myworkdayjobs.com
ApacheAzureCloudDockerETLKubernetesPySparkPythonScalaSparkSQLTerraform
Zantech

Senior Data Engineer

Zantech
Seniorfull-timeDistrict of Columbia, Washington · 🇺🇸 United States
Posted: 1 day agoSource: zantech-it.breezy.hr
ApacheAWSDistributed SystemsETLPySparkPythonSparkSQL
Trace3

Data Engineer

Trace3
Senior · Leadcontract$65–$70Colorado · 🇺🇸 United States
Posted: 23 days agoSource: boards.greenhouse.io
ApacheAWSAzureCloudCognosKafkaPythonSparkTableauTerraform
Trace3

Data Engineer

Trace3
Senior · Leadcontract$65–$70Colorado · 🇺🇸 United States
Posted: 23 days agoSource: boards.greenhouse.io
ApacheAWSAzureCloudCognosKafkaPythonSparkTableauTerraform
RTX

Senior Software and DevOps Engineer

RTX
Seniorfull-time$101k–$203k / yearConnecticut, Iowa, North Carolina, Texas · 🇺🇸 United States
Posted: 3 hours agoSource: globalhr.wd5.myworkdayjobs.com
AirflowApacheAWSAzureCloudD3.jsFlaskHadoopIoTJavaScriptJenkinsLinux+4 more