This is an excellent opportunity for a BIG DATA DEVELOPER to join an international SOFTWARE COMPANY and create DATA SOLUTIONS for Major Global CAPITAL MARKETS FINANCIAL INSTITUTIONS.
This role is with an established Data Solutions & Software company operating in South Africa, UK, USA, New Zealand, Thailand, & Mauritius.
Based in CAPE TOWN this BIG DATA DEVELOPER role offers a salary of R900K – R1M/annum, with benefits on top.
Over their 15 year history this DATA SOLUTIONS SOFTWARE COMPANY has provided CAPITAL MARKETS Financial Institutions with BIG DATA ENGINEERING and CUSTOM DEVELOPMENT aligned to deploying technology and unlocking the potential of data - to gather, process, compare and analyse data from multiple sources, and uncover hidden insights to drive business advantage.
This is a fast-growing international business using technology to solve complex financial data challenges in a simple way. Having grown across 5 continents, this business continues to enjoy success and is a recognised specialist in CAPITAL MARKETS.
As BIG DATA DEVELOPER, your role will involve building and operating a content management platform for high profile big data projects that revolutionise an area of finance by providing unprecedented market insight in a timely manner.
You'll be working closely within a team of developers distributed in London, South Africa and New Zealand.
The role will involve building and operating an ingestion and analytics platform that collects frequently changing data and exposing the normalised and aggregated data via APIs. This includes data cleansing, aggregation, financial computations.
THE TEAM are diverse, smart, agile but laid-back who are passionate about technology, open-minded and open to new ideas. In this business you’ll find serious hardware, and no red tape or unnecessary process. Not only will you get to work with a great team, you’ll also enjoy flexible hours, the flexibility to work from home when needed, private medical and a relaxed dress code.
Ability to pick up a new technology quickly and deliver features in a highly agile manner.
Experience writing functional Scala in a production grade system. (Not a Java developer writing OO in Scala).
To have used Apache Spark SQL in a production system using Scala with YARN as the resource manager.
A clear and practical understanding of how Hive works, which includes running Hive on Tez.
Practical experience using Debian flavoured Linux distributions.
Familiarity with event driven development and architecture.
Used Docker containers to deploy your systems.
Ability to navigate the administration of an HDP cluster on AWS.
Able to index millions of documents from Hadoop into Elasticsearch.
Work with various messaging systems, such as Kafka and RabbitMQ.
Able to aggregate data using Apache Kylin Cube.
Can pick up Python if you have not used it previously.
Operate and deploy to a Kubernetes cluster on AWS.
Understand basic concepts about mortgage backed securities.
If you qualify for this role, please email your CV directly to:
021 801 5001
If you have not had a response to your application within 14 days please consider your application to be unsuccessful.