Notice: While Javascript is not essential for this website, your interaction with the content will be limited. Please turn Javascript on for the full experience.

Data Engineer
Blue Orange Digital
New York City, New York, United States

Job Title

Data Engineer

Job Description

We are looking for an Experienced Data Engineer with a preference for Python that will be responsible for managing ETL/ELT and performant data storage and retrieval. Our projects ingest data from multiple sources, wrangles the disparate data into a unified schema, and then provides a final database/cloud storage for reporting efforts by other groups. We are looking for candidates proficient related AWS services and DBs.

Your primary focus will be the development of server-side logic, data ingestion, data wrangling, and algorithm development. Major technologies involved include AWS, Python 3, Spark, Pandas, MySQL.

The ideal candidate:

  • Motivated by a passion to create highly fault tolerant apps with excellent design practices
  • Enjoys collaborating with other engineers on architecture and sharing designs with the team
  • Has experience collaborating with team members and communicating code patterns.
  • Interacts with others using sound judgment, good humor, and consistent fairness in a fast-paced environment

Restrictions

  • No telecommuting
  • No Agencies Please

Requirements

Skills And Responsibilities

  • Development of new RDBMS schema to handle the addition of new datasets.
  • Applicable AWS proficiency
  • Comfortable with Containerization (Docker, Vagrant, etc)
  • Ability to write intermediate to advanced SQL for data wrangling and reporting efforts.
  • Development of Python/Pandas code to wrangle multiple datasets covering a full spectrum of ETL tasks including entity resolution.
  • Occasional Linux server management including the review or management of log files, crontab, security configuration, etc.
  • Familiarity with machine learning topics to support supervised and unsupervised classification efforts.
  • Data exploration, analysis, and reporting skills with an eye towards developing a narrative using Jupyter Notebook.
  • Working understanding of REST APIs.
  • Developing techniques to work with both tabular and hierarchical data.

About the Company

Founded by freelance engineers, Blue Orange Digital wanted to bring an engineering-first approach to the development agency model. We aim to work on projects that use the latest and greatest technologies. We care about the products we build and only work with clients who understand that good applications come from happy engineers and team members. We’re headquartered in NYC and DC with additional remote engineers across the US.

Contact Info

Previous Senior Python Developer, Artemis Consulting inc in Washington, DC, District of Columbia, United States Next Senior Python Developer, Django/Flask, Clevertech in Remote, Idaho, North America