Hadoop Developer/Architect

Location: Dearborn, MI

The Hadoop Developer/Architect position will provide expertise in a wide range of technical areas, including but not limited to: Cloudera Hadoop ecosystem, Java, collaboration toolsets integration using SSO, configuration management, hardware and software configuration and tuning, software design and development, and application of new technologies and languages which are aligned with:

• Design and development of data ingestion pipelines.
• Perform data migration and conversion activities.
• Develop and integrate software applications using suitable development methodologies and standards, applying standard architectural patterns, taking into account critical performance characteristics and security measures.
• Collaborate with Business Analysts, Architects and Senior Developers to establish the physical application framework (e.g. libraries, modules, execution environments).
• Perform end to end automation of ETL process for various datasets that are being ingested into the big data platform.

Required Skills:

• Java/Scala
• Hadoop (preferably Cloudera CDH-5.12+), HDFS, Hive, Impala, Spark, Oozie, HBase
• Apache Kafka
• Any RDBMS
• Linux

Good to Have:

• Python
• Flume
• Solr
• ETL Tools
• NoSQL databases (Mongo/Couchbase/Cassandra), IIB or any other ESB experience