JOB | 跨国手机制造商湾区招大数据架构师啦～

跨国手机制造商招Big Data Engineer – Strategic Analytics ，需要有5年以上经验。这是contractor职位，工作地点在Palo Alto, CA。

- Translate complex functional and technical requirements into detailed design.

- Design for now and future success

- Hadoop technical development and implementation.

- Loading from disparate data sets. by leveraging various big data technology e.g. Kafka

- Pre-processing using Hive, Impala, Spark, and Pig

- Design and implement data modeling

- Maintain security and data privacy in an environment secured using Kerberos and LDAP

- High-speed querying using in-memory technologies such as Spark.

- Following and contributing best engineering practice for source control, release management, deployment etc

- Production support, job scheduling/monitoring, ETL data quality, data freshness reporting

- 5-8 years of Python or Java/J2EE development experience

- 3+  years of demonstrated technical proficiency with Hadoop and big data projects

- 5-8 years of demonstrated experience and success in data modeling

- Fluent in writing shell scripts [bash, korn]

- Writing high-performance, reliable and maintainable code. 

- Ability to write MapReduce jobs

- Ability to setup, maintain, and implement Kafka topics and processes

- Understanding and implementation of Flume processes

- Good knowledge of database structures, theories, principles, and practices. 

- Understand how to develop code in an environment secured using a local KDC and OpenLDAP.

- Familiarity with and implementation knowledge of loading data using Sqoop.

- Knowledge and ability to implement workflow/schedulers within Oozie

- Experience working with AWS components [EC2, S3, SNS, SQS]

- Analytical and problem solving skills, applied to Big Data domain

- Proven understanding and hands on experience with Hadoop, Hive, Pig, Impala, and Spark 

- Good aptitude in multi-threading and concurrency concepts.

- B.S. or M.S. in Computer Science or Engineering