Jobs


Data Engineer

Location: Boston, Massachusetts
Date Posted: 13 Feb, 2018

Data Engineer
Candidate Description
Client is seeking highly motivated Data Engineers to join a small, highly collaborative team and help create the next generation of data products for trading and investing.  
 
Successful candidates will be curious, independent thinkers who are excited by challenges and driven by building great products.   They will play a key role in developing Client's Machine Intelligence infrastructure.
 
Responsibilities
• Develop production-grade data pipelines and processes to support leading-edge analytics and big data processing
• Curate massive amounts of data and make it accessible via state-of-the-art technologies
• Review internal and external technological techniques, processes, and tools - to improve efficiency and better serve Client clients worldwide ?
• Gather new product requirements from business stakeholders 
o Design new production workflows and architectures to support those products
• Collaborate with Data Scientists and Software Developers to develop experiments and deploy solutions to production
• Rapidly integrate new content sets (financial and non-financial) into Client's big data ecosystem
• Contribute ideas and constructive feedback to the tech and business teams
• Stay current on technological trends
• Take ownership of new projects and initiatives
• Stay current on technological and analytical trends
• Be passionate about data and big data tech 
• Maintain positive attitude 
• Motivate and coach other members of the team
 
Example Projects
• Develop data ingestion and normalization framework that can collect and process data from hundreds of sources daily (and in real-time)
• “Productionalize” the analytical processes developed by the Data Science team
o Productionalize – (verb) Performance tune models, automate data processing workflow, deploy in a highly-available and scalable way
• Develop analytical libraries and tools that allow the Data Science team to take full advantage of Client's Data Platform
 
Background
We will consider candidates from a wide range of backgrounds, however, the many of the problems the candidate would be tasked with solving will require writing complex programs, designing systems, and analyzing data.  Therefore, candidates with a computer science or engineering background are preferred.
 
Experience
Successful candidates will have:
• 5-8 Yeas professional experience in engineering or another technical role
• Experience deploying applications in a production or mission-critical environment
• Experience in financial services is a plus.
 
Education
• Bachelor’s Degree from top tier university in Computer Science, Engineering, Physics, Mathematics, or similar quantitative discipline.
• Master’s Degree a plus. 
 
Skills Required
• Knowledge of cloud platforms and common architectures: AWS, Google¬
• Strong Familiarity with Big Data technologies and architectures: Hadoop, Spark, Kafka, etc.
• Good Programming Skills: Python, Java
• Good verbal and written communication
 
Preferred
• Experience with containers and scalable computing platforms: Docker (ECS), Mesos, Kubernetes 
• Familiarity with Apache Spark: tuning and maintaining clusters, optimizing jobs, etc.
• Familiarity with analytical techniques and machine learning workflows
• Familiarity with financial data sets and use cases
• Strong familiarity with AWS
• Knowledge of Lambda architectures
• Excellent communication skills