Data Engineer

Qualifications Required in the Job: Advanced working SQL/PLSQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases structures (Hadoop, MongoDB, dimensional designed solutions, and structures). Experience building and optimizing data pipelines, architectures, and data sets. Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. Strong analytic skills related to working with unstructured datasets and recommending transformations to optimal architectures. Build processes supporting data transformation, data structures, metadata, dependency, and workload management. A successful history of manipulating, processing, and extracting value from large, disconnected datasets. Working knowledge of message queuing, stream processing, and highly scalable big data data stores. Experience supporting and working with cross-functional teams in a dynamic environment with an agile mindset, agile methodology, sprint planning, writing user stories and delivering data pipelines in an iterative methodology. Candidates should also have 5+ years of experience using the following software/tools: Cloud-based data storage and data pipeline solutions, API development (specifically to connect to SaaS solutions), Hadoop, Spark, Kafka, Linux scripting, etc. Experience with AWS/Azure cloud services and platforms, Experience with Snowflake data platform, Experience with Matillion, Experience with object-oriented/object function scripting languages: Python, Java, etc. Data Engineer role who has attained a degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field experience.

Data modeling experience using either SAP Power Designer or Erwin tools. Snowflake cloud-based data warehousing platform. Experience using agile development methodology and working within a scrum team.

Required Skills: MUST HAVE: Matillion (Production experience. Cannot be a proof of concept), Snowflake, AWS or Azure Basic Qualification: MUST HAVE: Matillion (Production experience. Cannot be a proof of concept), Snowflake, AWS or Azure Additional Skills: MUST HAVE: Matillion (Production experience.