SiouxFallsRecruiter Since 2001
the smart solution for Sioux Falls jobs

Big Data Developer, Apache Spark or Web Applications/Kubernetes

Company: Procom Services
Location: Toronto
Posted on: April 8, 2021

Job Description:

Big Data Developer, Apache Spark or Web Applications/Kubernetes Contract - 7 Months - 31 March 2021 - Toronto, ON Canada Big Data Developer - Apache Spark or Web Applications/Kubernetes On behalf of our client in the Banking Sector, PROCOM is looking for a Big Data Developer - Apache Spark or Web Applications/Kubernetes. Big Data Developer - Apache Spark or Web Applications/Kubernetes - Job Description

  • Explore emerging technologies in Analytics, Cloud and Kubernetes space that relate to our needs and implement those technologies in Hybrid environments.
  • Install, Configure, Construct, and build highly available Kubernetes clusters on-premise and public cloud.
  • Deploy, Test, monitor, administer, optimize and operate scalable clusters on premise and/or in cloud.
  • Responsible for the overall health of the platform including production issues, Troubleshooting, monitoring system capacity using Grafana, working with other technical teams like server support, network, DR etc.
  • Design, build & implementation of various containerized applications using Docker and deploy to Kubernetes Cluster using HELM Charts.
  • Setup Splunk and integrate with Kubernetes cluster to monitor performance, health checks on k8's cluster and troubleshooting application logs to generate alerts.
  • Install, configure CEPH storage system and integrate with Kubernetes cluster.
  • Setup Hashicorp Vault and Envconsul for secret management and Integrate with On Premise and Cloud Kubernetes cluster.
  • Create projects, namespaces, allocate cluster resources, provision user and permissions, create configmaps, secrets and volumes for applications & allocate system resources based on the use cases
  • Design, Develop and Deploy APIs for integrating the Kubernetes clusters with external systems
  • Implement Disaster Recovery and BCP strategy
  • Implement CI/CD process by designing industry standard Jenkins Pipelines for deploying Infrastructure and analytics workloads using Docker, HELM, Ansible, Bitbucket, Jfrog Artifactory, Airflow and other build and deployment activities
  • Install, configure, upgrade Enterprise GitLab, Nexus, Jfrog Artifactory, administer them and standardize CI Process for all new onboarding
  • Document all artifacts, share knowledge & work with change control, security, audit teams as required. Big Data Developer - Apache Spark or Web Applications/Kubernetes - Mandatory Skills
    • Minimum 2-3 Large projects setting up Kubernetes or similar platform on premise/cloud (On-prem Rancher experience is a plus)
    • Minimum 3 years' experience on deploying Apache Spark or web applications on Kubernetes
    • Minimum 3 years' Spark standalone implementation experience or Hadoop-Spark integration experience along with POSIX or HDFS or MinIO storage hand-on
    • Minimum 3 years' experience with Docker - including setting up and managing Docker registries as well as creating Dockerfiles to create custom images
    • Must have virtualization experience like VirtualBox, Hyper-V, Docker, VMware etc. (minimum 3 years')
    • Strong scripting skills (i. e. shell scripting, Python, Perl, Ansible) for automation.
    • Exposure to working on cloud platforms like Azure/GCP/AWS
    • Experience with Agile/Scrum development methodologies
    • Team player with strong communication skills (verbal and written)
    • Able to see tasks through to completion without significant guidance
    • Self-managed and results-oriented with sense of ownership is required
    • A university degree in Mathematics, Science, Engineering, Management or relevant Big Data Developer - Apache Spark or Web Applications/Kubernetes - Nice to Have Skills
      • Experience on Cloudera or HDP is a plus
      • Should have knowledge of overlay networking needed for inter-container communications from different nodes as well as external servers/infrastructure
      • Experience building CI/CD pipelines using GitHub, Artifactory and etc. to reduce cycle times and ensure quality
      • Experience automating systems deployments and configuration management using tools like Ansible, Chef, Puppet, Terraform, Saltstack Big Data Developer - Apache Spark or Web Applications/Kubernetes - Assignment Start Date ASAP - 6 months to start Big Data Developer - Apache Spark or Web Applications/Kubernetes - Assignment Location Procom is one of North America's leading providers of Staffing and Contract Workforce Services. Procom is always looking for the best and brightest talent to join our Clients' project teams.

Keywords: Procom Services, Sioux Falls , Big Data Developer, Apache Spark or Web Applications/Kubernetes, IT / Software / Systems , Toronto, South Dakota

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Other IT / Software / Systems Jobs


Entry Level Software Developer
Description: Revature is the fastest growing employer of emerging technology talent. We will hire over 300 Entry Level Software Developers across the country in the next 4 weeks.One day someone is going to ask you (more...)
Company: Revature
Location: Sioux Falls
Posted on: 04/17/2021

Manager, Applications Support - Sioux Falls IT End User Solutions
Description: Sanford Health is one of the largest and fastest-growing not-for-profit health systems in the United States. We're proud to offer many development and advancement opportunities to our nearly 50,000 members (more...)
Company: Sanford Health
Location: Sioux Falls
Posted on: 04/17/2021

SFDC Developer
Description: SFDC experienced including Visual Force and Apex skills, integration w/ web services Report To: Part of Outcome Development SCRUM team Pay Rate open for right candidate No drug or
Company: MOTOCOL
Location: Toronto
Posted on: 04/17/2021


Software Developer
Description: Looking for a career in technology while also continuing to advance your skills We're looking for software engineers to join our team and work on projects that matter.With a wide range of Fortune 500 (more...)
Company: Revature
Location: Sioux Falls
Posted on: 04/17/2021

Software Architect (.NET Development)
Description: JOB PURPOSE: Provide technical expertise and design direction for software web applications that involve a higher level of complexity. Support all aspects of Midco software and systems strategy by applying (more...)
Company: Midcontinent Communications
Location: Sioux Falls
Posted on: 04/17/2021

25B Information Technology Specialist (Egan)
Description: Job Description If you 039 ve ever considered a job in IT, become an Information Technology Specialist in the Army National Guard and expand your skills and experience with complex technologies. In this (more...)
Company: Army National Guard
Location: Egan
Posted on: 04/17/2021

Software Engineer - Remote
Description: Company Overview iboss is a cloud security company that provides organizations and their employees secure access to the Internet on any device, from any location, in the cloud. This eliminates the need (more...)
Company: iboss
Location: Sioux Falls
Posted on: 04/17/2021

Senior Software Engineer
Description: POSTION SENIOR SOFTWARE ENGINEER with PROGRESS .NET LOCATION SIOUX FALLS, SD TYPE DIRECT HIREFULL TIME LOCAL CANDIDATES ONLY Remote position until a safe return to the office is guaranteed. Potential (more...)
Company: Entelli Consulting LLC
Location: Sioux Falls
Posted on: 04/17/2021

Lead Network Engineer - Sioux Falls Information Technology
Description: Sanford Health is one of the largest and fastest-growing not-for-profit health systems in the United States. We're proud to offer many development and advancement opportunities to our nearly 50,000 members (more...)
Company: Sanford Health
Location: Sioux Falls
Posted on: 04/17/2021

Junior Software Developer
Description: Revature is looking to hire Junior Software Developers.We will provide you with the training and skills needed to succeed. With a wide range of Fortune 500 and government clients, through an employer-paid (more...)
Company: Revature
Location: Sioux City
Posted on: 04/17/2021

Log In or Create An Account

Get the latest South Dakota jobs by following @recnetSD on Twitter!

Sioux Falls RSS job feeds