Joel

Senior Cloud & Data Engineer in Vancouver, Canada

Joel is an experienced and innovate backend developer specializing in delivering AWS Cloud, Big Data, and DevOps solutions. As an experienced data and certified cloud engineer, he has designed and implemented entire Serverless cloud-native platforms and big data frameworks for previous clients. Joel contributes to Terraform's AWS-provider IaC source code and as such, he has a deep familiarity with much of the AWS stack which is built upon his strong unix skills and background as a software developer proficient in Python, Scala, and Go amongst others.

He has a proven track record with previous clients including globally known companies such as HSBC and Vodafone.

Hire Me
Python
Scala
Go
Kotlin
Java
JavaScript
AWS Cloud Architecture
Terraform
Oracle
Kubernetes
Postgres
Hive/Impala/Athena
ElasticSearch
DynamoDB
Hadoop/HDFS
Apache Spark
S3
EMR
Kafka
Athena
Jenkins
CircleCI
Docker/ECS
Vagrant
Neo4j/Neptune

Employment

Cloud & Data Consultant
Manta Innovations Ltd. ⦁ 2018 - 2020

  • Cloud Architect - responsible for designing and implementing cloud architecture for scalable systems, most frequently using IaC
  • Senior Engineer - responsible for designing and implementing big data, machine learning, and cloud applications; and establishing software best practice including establishing DevOps principles - ensuring code is thoroughly tested and meets high standards utilizing CI and CD
  • Previous major clients include HSBC, RELX, RBI, Quantexa, and Blackcat Technology Solutions
  • Projects have included: designing and delivering a Serverless Data Pipeline platform for a client, delivering big data pipelines for fraud detection software, design and delivery of automated systems regression suite for Serverless applications
  • Toolkit: Scala, Python, Go, Elm, Terraform, Docker, Git(Hub/Lab), CircleCI, Apache Spark, TensorFlow, AWS, SQL, NoSQL, Linux

Senior Developer
LimeJump Ltd. ⦁ 2018 - 2019

  • Designed and implemented a real-time Big Data Lake solution using Apache Spark Streaming, Scala, Kafka, AWS Glue, Athena, and S3 to process over 3000 messages per second (300 million messages daily)
  • Provided technical guidance to analysts and developers on Machine Learning and Python
  • Built dockerized energy trading service on AWS ECS with Python-Django REST framework
  • Redesigned cloud architecture for scalability, security, and reliability using Terraform and Saltstack
  • Designed CI/CD solution to improve code quality, test coverage, and speed of development

Senior Data Scientist
BAE Systems Applied Intelligence ⦁ 2015-2018

  • Lead a team of 5 on a large scale big data project owned by one of the UK’s largest Telecommunications companies; developing a framework to ingest and process vast amounts of transactional data using Scala, Python, Spark, and HDFS to process over 2TB of data per day
  • Implemented data mining and ML techniques to deliver production level data solutions
  • Used NLP techniques and Vector Space Models to tokenize and categorize user freetext data. Explored semantic orientation to identify emotion and opinion
  • Used graph theory to model complex networks and uncover patterns of events, then predict up- coming events using Multinomial Linear Regression, enabling the client to pre-emptively avert disastrous situations
  • Head of Analytics Capability - training junior staff and producing technical summaries, and newsletters in applications of Data Science with Python

Risk Analyst
Ascot Underwriting Ltd ⦁ 2014 - 2015                                                                  

Data Analyst
Western Sussex Hospitals NHS Trust ⦁ 2013 - 2014

Portfolio

Education

BSc Mathematics
University of Sussex, Sussex, United Kingdom

MSc Mathematical Biology
University of Bath, Bath, United Kingdom

Certifications
SQL Development For SQL Server
Developer Training For Spark and Hadoop
AWS Certified Cloud Practitioner
AWS Certified Solutions Architect Associate

Languages

English

Joel

Senior Cloud & Data Engineer in Vancouver, Canada

Hire Me