Sign In
 [New User? Sign Up]
Mobile Version

Principal Engineer, Data Management Engineering - Western Digital

Western Digital


Location:
Fremont, California
Date:
07/06/2017
2017-07-062017-09-04
Categories:
  • Data Analytics
  • Data Engineer
  • Data Scientist
Western Digital
  •  
  • Save Ad
  • Email Friend
  • Print
  • Research Salary

Job Details

  • Data Engineer(s) would focus on Data Preparation/Provisioning for Ad-Hoc, Visual Analytics & Industrial Data Science use-cases, Data Profiling & Quality Improvements, and Data Infrastructure Performance Optimization for Engineering & Operations Analytics in high-tech environment.
  • Data Engineer(s) would work closely with IT and help prepare the “big data” infrastructure to be analyzed by Engineers and Data Scientists. He/She would possess similar skills as software engineers who design, build, integrate data from various resources, and manage big data. The individual would write complex queries on the big data platform, make sure data is easily accessible, create UDF/Stored Procedures, deploy big data processing techniques (eg. Spark) and optimize the performance of wafer engineering and operations data ecosystem.
  • Data Engineer(s) would partner with Enterprise Data Management and Manufacturing IT teams and may help with data automation and ETL (Extract, Transform and Load) for reporting or analysis by wafer engineers. Beyond that, would focus more on the design and architecture, and performance optimization.

     

Job Discipline

Engineering

 

Primary Location

US-California-Fremont

 

Schedule

Full-time

Requirements

  • Experience on one or more programming language (Python, Java and Scala)
  • Experience on SQL and query performance turning
  • Experience in data profiling and understanding its intricacies
  • Experience with dimensional data modeling & schema design in Data Warehouses
  • Good understanding of big data environment (Spark, MapReduce, Hadoop, Hive/Impala, etc)
  • Experience on working with NoSQL or an MPP environment (Redshift, Teradata,etc)
  • Experience in parallel computing (multi-threading) / programming in linux / unix environment using either python / java will be definitely a plus, which will make apps scale in a cloud environment
  • Good Knowledge in custom or structured ETL design, implementation and maintenance
  • Communication skills including the ability to identify and communicate data driven insights
  • Experience on Web application development is plus
  • BS Degree
Powered By

Featured Job