INV Technologies

Automation Engineer

INV Technologies

full-time

Posted on:

Location Type: Remote

Location: California • United States

Visit company website

Explore more

✨ AI Apply
Apply

Tech Stack

AWSDjangoFlaskJavaScriptLinuxPandasPythonRDBMSSeleniumSQL

About the role

  • Create crawlers for each source URL by using Python modules [scrapy, selenium, requests, BeautifulSoup and splash]
  • Create and maintain scrapy pipelines and middlewares to manage the output from the crawlers.
  • Create crawlers for all types of websites irrespective of the technical roadblocks.
  • Manage the crawlers to overcome technical challenges like IP ban, geolocation ban, captcha and bot blocking services.
  • Write SQL queries to manage database operations using Python modules like sqlalchemy
  • Deploy the python scripts / crawlers to Linux based AWS servers

Requirements

  • 3+ experience working on web development frameworks such as Flask/Django/FastAPI/Tornado/Pandas
  • Strong hands-on experience in Python programming
  • Good experience with scraping libraries such as Requests, BeautifulSoup, Selenium and Scrapy.
  • Knowledge of building APIs and services using REST.
  • Experience with any RDBMS and strong SQL knowledge.
  • Clear with Object-oriented concepts.
  • Excellent troubleshooting skills.
  • Proficient understanding of code versioning tools like git.
  • Basic understanding of front-end technologies, such as JavaScript, HTML5 and CSS3
  • Understanding of fundamental design principles behind a scalable application.
Benefits
  • Employees can work remotely
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
PythonScrapySeleniumRequestsBeautifulSoupSQLFlaskDjangoFastAPITornado
Soft Skills
troubleshootingproblem-solvingcommunicationcollaborationadaptability