Top 12233 Infrastructure Server Engineer Jobs

AI Infrastructure Engineer
Richtech Robotics Inc —Las Vegas, NV
- $80,000 - $120,000 a year
- Full-time
- DevOps
- Mid-level
- 3 years
- Health insurance
- Dental insurance
Quick Apply
Infrastructure Engineer Data Center
ZRG Partners —Madison, NC
- $100,000 - $160,000 a year
- Full-time
- Mid-level
- Analysis skills
- In-person
- Relocation assistance
- Health insurance
Quick Apply
13d
Infrastructure Engineer
Alexander Technology Group —Amherst, NH
- $95,000 a year
- Computer science
- Azure
- Computer Science
Quick Apply
Senior Windows Server Engineer – Cloud Infrastructure
Fannie Mae —Reston, VA
- $123,000 - $161,000 a year
- Full-time
- Hybrid work
- Inventory management
- Customer service
- System design
6d
Senior Windows Server Engineer – Cloud Infrastructure
Fannie Mae —Reston, VA
- $123,000 - $161,000 a year
- Full-time
- Hybrid work
- Inventory management
- Customer service
- System design
6d
Infrastructure Deployment Engineer
FluidStack —New York, NY
- $150,000 - $250,000 a year
- Email
- Computer Science
- Up to 50% travel
- 5 years
- Dental insurance
- Paid time off
Connectivity Engineer
FluidStack —Remote
- $150,000 - $250,000 a year
- Email
- Computer Science
- Up to 50% travel
- 5 years
- Dental insurance
- Paid time off
Senior IT Construction Engineer, NA
Vantage Data Centers Management Company LLC —Port Washington, WI
- $106,000 - $115,000 a year
- Full-time
- Background check
- Computer science
- Computer Science
- AD&D insurance
- Disability insurance
Quick Apply
12d
Sr. Infrastructure and Cloud Engineer
BSF —Jacksonville, FL
- $110,000 - $115,000 a year
- Full-time
- In-person
- Senior level
Quick Apply
Sr. Systems Development Engineer , Secure Connection Services (SCS), Tactical Edge Mission Engineering Group (TEMEG)
Amazon Development Center U.S., Inc. —Herndon, VA
- $151,200 - $204,600 a year
- Full-time
- Analysis skills
- Senior level
- Communication skills
- AD&D insurance
- Health insurance
6h
System Development Engineer II, Platform Engineering and Emerging Technologies
Amazon Development Center U.S., Inc. —Herndon, VA
- $129,200 - $174,800 a year
- Full-time
- Mid-level
- 1 year
- AD&D insurance
- Health insurance
6h
Systems Development Engineer, Platform Engineering and Emerging Technologies (PEET)
Amazon Development Center U.S., Inc. —Seattle, WA
- $129,200 - $174,800 a year
- Full-time
- 1 year
- Senior level
- AD&D insurance
- Health insurance
6h
Systems Development Engineer II, AWS Commerce Platform-ADC
Amazon Development Center U.S., Inc. —Herndon, VA
- $129,200 - $174,800 a year
- Full-time
- Mid-level
- 2 years
- Commercial
- AD&D insurance
- Health insurance
6h
Development Security Operations Engineer
Next Level Performance —New Brunswick, NJ
- $45 - $50 an hour
- Part-time
- Hybrid work
- Azure
- 5 years
- DevOps
- Health insurance
- Dental insurance
Quick Apply
Systems Development Engineer - Identity, Cryptography and Identity Management
Amazon Development Center U.S., Inc. —Seattle, WA
- $129,200 - $174,800 a year
- Full-time
- 7 years
- Senior level
- AD&D insurance
- Health insurance
6h
Windows Systems Engineer, Region Services Corporate Infrastructure (Vector) Team
Amazon Development Center U.S., Inc. —Bellevue, WA
- $116,900 - $167,400 a year
- Full-time
- Senior level
- AD&D insurance
- Health insurance
7h
ADC Engineer, Identity
Amazon Development Center U.S., Inc. —Bellevue, WA
- $116,900 - $167,400 a year
- Full-time
- Senior level
- 2 years
- AD&D insurance
- Health insurance
7h
Senior IT Project Engineer and Team Lead
ArcLight Information Technology —Newton, MA
- $120,000 - $150,000 a year
- Full-time
- Background check
- Azure
- HIPAA
- Health insurance
- Dental insurance
Quick Apply
Regional Project Engineer (Pittsburgh Region)
Global Data Consultants —Chambersburg, PA
- System design
- Windows
- Bachelor's degree
- Opportunities for advancement
11d
Sr. Virtualization Infrastructure Engineer
MMD Services, Inc —Chicago, IL
- $115,000 - $135,000 a year
- Weekends as needed
- Hybrid work
- 5 years
- Windows
- Linux
- Health insurance
- Dental insurance
Quick Apply
9d

I want to receive the latest job alert for Infrastructure Server Engineer

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

Infrastructure Server Engineer jobs near

AI Infrastructure Engineer

Richtech Robotics Inc
Las Vegas, NV

Quick Apply

Job Details

Full-time
$80,000 - $120,000 a year

Benefits

Health insurance
Dental insurance
Paid time off
Vision insurance

Qualifications

GPU programming
Ansible
Tooling
Infrastructure as Code (IaC)
DevOps
Cloud management tools
Docker
Terraform
DevOps automation
Server management automation
Python

Full Job Description

AI Infrastructure Engineer
Responsibilities
1. NVIDIA GPU & Hardware Infrastructure Deployment

Hardware Provisioning: Rack, stack, configure, and maintain high-performance bare-metal GPU servers (e.g., NVIDIA H200, B300 or equivalent Supermicro/Dell/HGX architectures).

AI Software Stack: Install, update, and optimize NVIDIA Drivers, CUDA Toolkit, cuDNN, and NVIDIA Container Toolkit on physical host machines.

Containerization & Orchestration: Manage GPU-accelerated environments using Docker, including configuring GPU partitioning (MIG/vGPU) for optimal resource allocation.

2. Network & Systems Engineering

High-Performance Networks: Configure and optimize InfiniBand (IB) switches and RoCE (RDMA over Converged Ethernet) to ensure ultra-low latency and maximum throughput for multi-GPU training workloads.

Core Infrastructure: Manage enterprise firewalls, core switches, VLANs, and local network routing to ensure high security and stability of the data center network.

Linux Administration: Oversee Linux server administration (Ubuntu, RHEL, or Rocky Linux), including automated OS provisioning and local storage clusters.

3. Metering & Billing System Integration

Resource Metering: Implement and configure telemetry tools to accurately monitor and log GPU time, CPU utilization, storage usage, and network traffic.

Billing System Management: Maintain and integrate usage-based billing/metering engines to track infrastructure costs or client usage.

Automation: Write robust scripts (Python, Go, or Bash) to link data center resource telemetry with the billing platform for precise invoicing and automated usage reporting.

Qualifications & Skills
Required Qualifications:

Experience: 3-5+ years of experience in Network Engineering, Linux Systems Administration, or DevOps, with hands-on experience in GPU infrastructure deployment.

Linux & Automation: Expert-level knowledge of Linux environments and infrastructure-as-code/automation tools (Ansible, Terraform, or SaltStack).

NVIDIA Ecosystem: Deep technical understanding of the NVIDIA AI Enterprise stack (CUDA, NCCL, NVLink).

Billing/Metering Awareness: Practical experience working with usage-based tracking, billing APIs, or internal chargeback tools.

Pay: $80,000.00 - $120,000.00 per year

Benefits:

Dental insurance
Health insurance
Paid time off
Vision insurance

Work Location: In person

Quick Apply

Refine Your Search

Infrastructure Server Engineer jobs

AI Infrastructure Engineer

Infrastructure Engineer Data Center

Infrastructure Engineer

Senior Windows Server Engineer – Cloud Infrastructure

Senior Windows Server Engineer – Cloud Infrastructure

Infrastructure Deployment Engineer

Connectivity Engineer

Senior IT Construction Engineer, NA

Sr. Infrastructure and Cloud Engineer

Sr. Systems Development Engineer , Secure Connection Services (SCS), Tactical Edge Mission Engineering Group (TEMEG)

System Development Engineer II, Platform Engineering and Emerging Technologies

Systems Development Engineer, Platform Engineering and Emerging Technologies (PEET)

Systems Development Engineer II, AWS Commerce Platform-ADC

Development Security Operations Engineer

Systems Development Engineer - Identity, Cryptography and Identity Management

Windows Systems Engineer, Region Services Corporate Infrastructure (Vector) Team

ADC Engineer, Identity

Senior IT Project Engineer and Team Lead

Regional Project Engineer (Pittsburgh Region)

Sr. Virtualization Infrastructure Engineer

I want to receive the latest job alert for Infrastructure Server Engineer

Related Searches

Explore jobs in more locations

Job Seeker Tools

Employer Tools

Browse

Stay Connected