The Data Systems Developer will join a team that manages and maintains our rapidly growing Hadoop infrastructure. You will be responsible for assessing data requests from various BlackBerry teams, designing efficient approaches to ingesting, extracting and maintaining our data collection. You’ll be working in a fast-paced and high-volume processing environment, where quality and attention to detail are vital. Our mission is to provide the best possible user experience for our BlackBerry platform by providing invaluable insights to engineering, sales, and executive decision makers.
RESPONSIBILITIES
•Build and maintain processes utilizing Hive, Python, Java, Pig, Kafka, Oozie, and Apache Spark
•Assist in fine-tuning search queries and map reduce jobs
•Design and develop custom tooling to optimize the ingest of analytics and diagnostics data into HDFS
•Estimate and plan development work, track and report on task progress, and deliver on work schedule
•Understand and contribute to a complex data processing pipeline and analytics framework
•Programming using Java and Map Reduce Frameworks (i.e. Pangool)
ESSENTIAL SKILLS AND QUALIFICATIONS
•BS in CS/EE or related discipline, Master’s is preferred
•3 to 8 years of work experience focused on Java and Big Data development
•Experience with big data tools such as Pig, Sqoop, Hive, Hadoop etc.
•Experience with Linux, Linux Administration, Hadoop administration, and various scripting tools and languages
•Experience in Kafka, Spark, and Flume
•Experience in implementing ETL processes
•Able to work directly with users, developers, and business analysts to provide technical support in developing and maintaining large scale data pipelines
•Excellent organizational, analytical, and problem solving skills
•Must have strong debugging and troubleshooting skills
•Effectively able to work independently with little hands-on supervision delivering to aggressive timelines
•Effectively able to collaborate with multiple teams across geographically diverse areas
Job Description:
POSITION SUMMARY
The Data Systems Developer will join a team that manages and maintains our rapidly growing Hadoop infrastructure. You will be responsible for assessing data requests from various BlackBerry teams, designing efficient approaches to ingesting, extracting and maintaining our data collection. You’ll be working in a fast-paced and high-volume processing environment, where quality and attention to detail are vital. Our mission is to provide the best possible user experience for our BlackBerry platform by providing invaluable insights to engineering, sales, and executive decision makers.
RESPONSIBILITIES
•Build and maintain processes utilizing Hive, Python, Java, Pig, Kafka, Oozie, and Apache Spark
•Assist in fine-tuning search queries and map reduce jobs
•Design and develop custom tooling to optimize the ingest of analytics and diagnostics data into HDFS
•Estimate and plan development work, track and report on task progress, and deliver on work schedule
•Understand and contribute to a complex data processing pipeline and analytics framework
•Programming using Java and Map Reduce Frameworks (i.e. Pangool)
ESSENTIAL SKILLS AND QUALIFICATIONS
•BS in CS/EE or related discipline, Master’s is preferred
•3 to 8 years of work experience focused on Java and Big Data development
•Experience with big data tools such as Pig, Sqoop, Hive, Hadoop etc.
•Experience with Linux, Linux Administration, Hadoop administration, and various scripting tools and languages
•Experience in Kafka, Spark, and Flume
•Experience in implementing ETL processes
•Able to work directly with users, developers, and business analysts to provide technical support in developing and maintaining large scale data pipelines
•Excellent organizational, analytical, and problem solving skills
•Must have strong debugging and troubleshooting skills
•Effectively able to work independently with little hands-on supervision delivering to aggressive timelines
•Effectively able to collaborate with multiple teams across geographically diverse areas
Job Family Group Name:
Product Development