IBM is seeking Big Data Engineers with technical experience in building scalable distributed software on the cloud that will combine cognitive computing/Watson technology with traditional data engineering/science and apply it at scale to transform enterprise business processes. The ideal candidate will also be able to modify a traditional open-source or other data stack to incorporate cognition. Successful candidates should come from a strong data engineering background and need to have experience with un-structured and structured data and being able to transform and analyze the data using various tools. We are building new platforms, and may need to move our data to new technologies requiring data parity guarantees between new and old feeds.
The ideal candidate will have significant experience with much of the following or equivalent:
- 5+ years’ technical and critical thinking skills
- 5+ years’ experience of service oriented architecture (SOA) principles and Web services standards and best practices
- Capability to architect highly scalable distributed systems using open source tools and big data technologies such as Hadoop, HBase, Spark, Storm, etc
- 5+ years’ experience as a software architect designing and delivering large scale distributed software systems, preferably in large scale global business
- Experience in cloud-based agile, devops experience with PaaS & IaaS
- Experience using Big Data batch and streaming tools
- Ability to define, apply and evangelize advanced software patterns and standards to solve complex problems
- Experience with SQL, NoSQL, relational database design, and methods for efficiently retrieving data
- Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.)
- Experience programming in Java, Scala, Python, SQL
- Build prototypes or POCs where needed, to validate technical approach
EDUCATION
- BS in Computer Science degree or equivalent, PHD is a plus
- 2+ years of related work experience in software engineering, architecture and design
微信一键登录
