CURRENT OPENINGS

Senior Big Data Engineer

Senior Big Data Engineer with Bachelor’s degree in Computer Science, Computer Information Systems, Information Technology, a closely related field, or a combination of education and experience equating to the U.S. equivalent of a Bachelor’s degree in one of the aforementioned subjects.

Job Duties and Responsibilities:

  • Perform detailed analysis/design of functional and technical requirements and translate them to solutions in the Big Data and Data Science Lab environments.
  • Develop robust and reusable data acquisition and processing routines to ingest data into the Data Science Lab environment.
  • Manage the full lifecycle of assigned data projects from requirements to technical design (platform, data, and automation routines), to project deployment of the proposed lab solution.
  • Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements.
  • Support program and project managers in the planning, estimation and implementation of projects and document use cases, solutions and recommendations.
  • Participate in regular status meetings to track progress, resolve issues, mitigate risks and escalate concerns in a timely manner.
  • Maintain and assist in data model documentation, data dictionary, data flow, data mapping and other MDM and Data Governance documentation.
  • Work closely with IT application teams, Enterprise architecture, infrastructure, information security, and LOB stakeholders to translate business and technical strategies into data-driven solutions for the company.
  • Contribute to the development, review, and maintenance of requirements documents, technical design documents and functional specifications.
  • Optimize the data ingestion using various Big Data technologies like Hive, Python, Flume, Sqoop, Zookeeper, Spark, MapReduce2, YARN, HBase, Kafka and Strom.

Work Experience required for the position:

  • Experience with full Hadoop stack including Sqoop, HBase, Hive, Oozie, Flume, NiFi, etc.
  • Experience with Teradata, MS SQL Server, DB2, Oracle Exadata, Oracle 11g, Postgres Hive etc.
  • Perform detailed analysis/design of functional and technical requirements and translate them to solutions in the Big Data.
  • Experience in full lifecycle of assigned data projects from requirements to technical design (platform, data, and automation routines), to project deployment of the proposed lab solution.
  • Develop robust and reusable data acquisition and processing routines to ingest data into the Data Science Lab environment.
  • Experience with ETL, Unix.
  • Expertise in Ksh (Korn Shell) scripting and data manipulation Proficient with Test Driven Development.
  • Perform advanced data discovery, profiling, and assessment on required data.
  • Ability to support program and project managers in the planning, estimation and implementation of projects.

Technologies Involved / Skills required for the position:

  • Programming Languages: Spark Scala, Python, Pig script, UNIX shell, SQL, SPSS
  • Hadoop: Full Hadoop stack including Sqoop, HBase, Hive, Oozie, Flume, NiFi, Parquet, Snappy compression, Spark.
  • IDEs: Eclipse, IntelliJ
  • Version Control Tools: Git, SVN, Bitbucket
  • Experience with Agile model, Rally, Scrum, Software Testing
  • Databases: Teradata, Oracle, DB2, SQL server, Postgres.
  • ETL Tools: Datastage, Streamsets

The following technology components will be used:

  • CDH and Hortonworks, HDFS, Hadoop, AWS, Snowflake, Hive, Python, SPSS, Pig, Flume, Zookeeper, Mapreduce2, YARN, HBase, Storm, Sqoop, Apache Spark and Scala, Flume, NiFi, Kafka, SQL Server, Oracle, Teradata, WinScp, Putty, UNIX Shell Scripting, Microsoft Visio, MS Word, MS Excel, GIT, JIRA and Confluence etc.

Work location is Portland, ME with required travel to client locations throughout USA.

Rite Pros is an equal opportunity employer (EOE).

Please Mail Resumes to:
Rite Pros, Inc.
415 Congress St, Suite # 201 & 202
Portland, ME 04101

Email: resumes@ritepros.com