Weka Data Platform Architect

BCI has the following 3 month contract position available. Project will be a 3-month POC effort for our client’s research and development environment. Target start date will be mid-January and can be 100% remote.

As a Senior Data Platform Engineer, you will be involved in the following:

· Creating new architectural designs

· Provide architectural guidance for our core areas of distributed computing, high-performance storage, and cloud computing.

· Performance testing around IO and storage throughput.

· *Key skillset requirement is solid experience with Weka ML software around performance tuning for analytics workload within a large amount of research data analysis within an Object storage environment.

· Front-end applications consist of K8 and bare-metal compute workloads.

Requirements:

· Familiarity with network concepts and protocols (UDP, TCP, InfiniBand, Ethernet, RDMA).

· Knowledge around WEKA tools and SW optimization skills in identifying performance bottlenecks, tuning memory usage.

· Experience with DPDK and SPDK

· Knowledge of storage systems such as Dell and Hitachi and SSDs

· Kernel driver development and experience with HW interfaces

· Deep networking experience (congestion control, bonding, VLAN, InfiniBand)

· Familiarity with storage concepts (SMB, NFS, S3, SSD, NVMe, Linux filesystems).

· Experience with the development of highly-distributed systems.

· Experience with memory management concepts and entities in a multiprocessing system (cache, shared memory, numa, etc.)