Sign In
 [New User? Sign Up]
Mobile Version

Data Engineer - Micron

Micron Technology


Location:
Boise, Idaho
Date:
08/16/2017
2017-08-162017-10-15
Categories:
  • Data Engineer
  • Data Scientist
  • Statistician
Micron Technology
  •  
  • Save Ad
  • Email Friend
  • Print
  • Research Salary

Job Details

Req Id: 90802

Big Data Engineer

A Big Data Engineer at Micron Technology is a key member of a cross-functional team responsible for evolving Micron’s Big Data environment. This position requires collaboration with Technology Development (TD) data scientists, big data engineers, and domain experts. Responsibilities span Micron departments and involve designing and implementing big data solutions from data streams and intelligent systems, including transforming, supporting, configuring, and enhancing existing big data solutions. A successful candidate will embrace the challenge of dealing with petabyte datasets on a daily basis, develop innovative big data solutions and tools, as well as develop automated reports for manufacturing anomaly detection and prevention. This role offers a unique opportunity to develop state-of-the-art big data systems and have a direct impact on key product initiatives at Micron TD.

 

Responsibilities

  • Design and implement optimum data structures in the appropriate data management system within Hadoop, Teradata, Oracle, SQL Server to satisfy the data requirements
  • Identify and select the optimum methods of access for each data source (real-time/streaming, delayed, static)
  • Determine transformation requirements and develop processes to bring structured and unstructured data from the source to a new physical Data Model
  • Develop ETL/ELT using Informatica, Wherescape RED, SSIS, and Apache NiFi within the company’s global warehousing environment
  • Work closely with the TD Data Science team to implement strategies for cleaning and preparing data for analysis, to develop data imputation algorithms, and optimize performance of big data and machine learning systems
  • Work closely with our Software Engineering team to integrate your amazing innovations and algorithms into our production systems
  • Identify and understand the data sources that are relevant to the business problem
  • Be a subject matter expert in data sources and reporting options
  • Understand principles of Big Data Visualization tools (Tableau, SpotFire)
  • Optimize table schema based on usage patterns. Actively participate in growing and develop the team of data engineers
  • Follow best known security practices to ensure data quality and data integrity

Requirements

2+ years’ experience in the following:

  • Develop ETL/ELT processes using Informatica, Wherescape RED, SSIS, and Apache NiFi for Corporate warehousing
  • Experience and deep knowledge of Teradata architecture and tools
  • Experience with big data processing and/or developing applications and data sources via Hadoop, Hive, HBASE, Spark, Sqoop, MapReduce
  • Proficient with one or more high-level client, object-oriented languages listed: (C#, JAVA, Python, Scala)
  • Relational databases and SQL
  • Understanding Agile software development frameworks – Scrum, Kanban
  • Previous work with statistical analysis

     

Education

Required- Bachelor’s Degree in Computer Science, Software Engineering, Electrical Engineering, Applied Mathematics, or related field of study

Preferred- Master’s Degree in Computer Science, Software Engineering, Electrical Engineering, Applied Mathematics, or related field of study

We recruit, hire, train, promote, discipline and provide other conditions of employment without regard to a person's race, color, religion, sex, age, national origin, disability, sexual orientation, gender identity and expression, pregnancy, veteran’s status, or other classifications protected under law. This includes providing reasonable accommodation for team members' disabilities or religious beliefs and practices.

Each manager, supervisor and team member is responsible for carrying out this policy. The EEO Administrator in Human Resources is responsible for administration of this policy. The administrator will monitor compliance and is available to answer any questions on EEO matters.

To request assistance with the application process, please contact Micron’s Human Resources Department at 1-800-336-8918 (or 208-368-4748).

 

Keywords: Boise || Idaho (US-ID) || United States (US) || Technology Development || Experienced || Regular || Engineering || ||

Powered By

Featured Jobs