Top 12114 Infrastructure Server Engineer Jobs

AI Infrastructure Engineer
Richtech Robotics Inc —Las Vegas, NV
- $80,000 - $120,000 a year
- Full-time
- DevOps
- Mid-level
- 3 years
- Health insurance
- Dental insurance
Quick Apply
Senior Windows Server Engineer – Cloud Infrastructure
Fannie Mae —Reston, VA
- $123,000 - $161,000 a year
- Full-time
- Hybrid work
- Inventory management
- Customer service
- System design
6d
Senior Windows Server Engineer – Cloud Infrastructure
Fannie Mae —Reston, VA
- $123,000 - $161,000 a year
- Full-time
- Hybrid work
- Inventory management
- Customer service
- System design
6d
Infrastructure Engineer Data Center
ZRG Partners —Madison, NC
- $100,000 - $160,000 a year
- Full-time
- Mid-level
- Analysis skills
- In-person
- Relocation assistance
- Health insurance
Quick Apply
13d
Senior Linux Server Engineer – Cloud Infrastructure
Fannie Mae —Reston, VA
- $123,000 - $161,000 a year
- Full-time
- Hybrid work
- Customer service
- System design
- Office
6d
Infrastructure Deployment Engineer
FluidStack —New York, NY
- $150,000 - $250,000 a year
- Email
- Computer Science
- Up to 50% travel
- 5 years
- Dental insurance
- Paid time off
Connectivity Engineer
FluidStack —Remote
- $150,000 - $250,000 a year
- Email
- Computer Science
- Up to 50% travel
- 5 years
- Dental insurance
- Paid time off
Virtual Infrastructure Engineer
Star Seven Six —Remote
- On call
- Computer science
- Computer Science
- Mid-level
- Health insurance
- Dental insurance
Server Infrastructure Engineer
SERVIT INC —Kennesaw, GA
- $80,000 - $90,000 a year
- Full-time
- 5 years
- Office
- Continuous improvement
Quick Apply
8d
Senior IT Construction Engineer, NA
Vantage Data Centers Management Company LLC —Port Washington, WI
- $106,000 - $115,000 a year
- Full-time
- Background check
- Computer science
- Computer Science
- AD&D insurance
- Disability insurance
Quick Apply
12d
Sr. Infrastructure and Cloud Engineer
BSF —Jacksonville, FL
- $110,000 - $115,000 a year
- Full-time
- In-person
- Senior level
Quick Apply
Sr. Systems Development Engineer , Secure Connection Services (SCS), Tactical Edge Mission Engineering Group (TEMEG)
Amazon Development Center U.S., Inc. —Herndon, VA
- $151,200 - $204,600 a year
- Full-time
- Analysis skills
- Senior level
- Communication skills
- AD&D insurance
- Health insurance
8h
System Development Engineer II, Platform Engineering and Emerging Technologies
Amazon Development Center U.S., Inc. —Herndon, VA
- $129,200 - $174,800 a year
- Full-time
- Mid-level
- 1 year
- AD&D insurance
- Health insurance
8h
ADC Engineer, Identity
Amazon Development Center U.S., Inc. —Bellevue, WA
- $116,900 - $167,400 a year
- Full-time
- Senior level
- 2 years
- AD&D insurance
- Health insurance
9h
Development Security Operations Engineer
Next Level Performance —New Brunswick, NJ
- $45 - $50 an hour
- Part-time
- Hybrid work
- Azure
- 5 years
- DevOps
- Health insurance
- Dental insurance
Quick Apply
Systems Development Engineer, Platform Engineering and Emerging Technologies (PEET)
Amazon Development Center U.S., Inc. —Seattle, WA
- $129,200 - $174,800 a year
- Full-time
- 1 year
- Senior level
- AD&D insurance
- Health insurance
8h
Systems Development Engineer II, AWS Commerce Platform-ADC
Amazon Development Center U.S., Inc. —Herndon, VA
- $129,200 - $174,800 a year
- Full-time
- Mid-level
- 2 years
- Commercial
- AD&D insurance
- Health insurance
8h
Systems Development Engineer - Identity, Cryptography and Identity Management
Amazon Development Center U.S., Inc. —Seattle, WA
- $129,200 - $174,800 a year
- Full-time
- 7 years
- Senior level
- AD&D insurance
- Health insurance
8h
Senior IT Project Engineer and Team Lead
ArcLight Information Technology —Newton, MA
- $120,000 - $150,000 a year
- Full-time
- Background check
- Azure
- HIPAA
- Health insurance
- Dental insurance
Quick Apply
Information Technology Engineer- Cloud Data (Architect, SQL Server Administration, Data Gateway)
LiveOnNY —Long Island City, NY
- $110,000 - $145,000 a year
- Full-time
- Hybrid work
- 7 years
- Azure
- Computer Science
- Disability insurance
- Health insurance
Quick Apply

I want to receive the latest job alert for Infrastructure Server Engineer

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

Infrastructure Server Engineer jobs near

AI Infrastructure Engineer

Richtech Robotics Inc
Las Vegas, NV

Quick Apply

Job Details

Full-time
$80,000 - $120,000 a year

Benefits

Health insurance
Dental insurance
Paid time off
Vision insurance

Qualifications

GPU programming
Ansible
Tooling
Infrastructure as Code (IaC)
DevOps
Cloud management tools
Docker
Terraform
DevOps automation
Server management automation
Python

Full Job Description

AI Infrastructure Engineer
Responsibilities
1. NVIDIA GPU & Hardware Infrastructure Deployment

Hardware Provisioning: Rack, stack, configure, and maintain high-performance bare-metal GPU servers (e.g., NVIDIA H200, B300 or equivalent Supermicro/Dell/HGX architectures).

AI Software Stack: Install, update, and optimize NVIDIA Drivers, CUDA Toolkit, cuDNN, and NVIDIA Container Toolkit on physical host machines.

Containerization & Orchestration: Manage GPU-accelerated environments using Docker, including configuring GPU partitioning (MIG/vGPU) for optimal resource allocation.

2. Network & Systems Engineering

High-Performance Networks: Configure and optimize InfiniBand (IB) switches and RoCE (RDMA over Converged Ethernet) to ensure ultra-low latency and maximum throughput for multi-GPU training workloads.

Core Infrastructure: Manage enterprise firewalls, core switches, VLANs, and local network routing to ensure high security and stability of the data center network.

Linux Administration: Oversee Linux server administration (Ubuntu, RHEL, or Rocky Linux), including automated OS provisioning and local storage clusters.

3. Metering & Billing System Integration

Resource Metering: Implement and configure telemetry tools to accurately monitor and log GPU time, CPU utilization, storage usage, and network traffic.

Billing System Management: Maintain and integrate usage-based billing/metering engines to track infrastructure costs or client usage.

Automation: Write robust scripts (Python, Go, or Bash) to link data center resource telemetry with the billing platform for precise invoicing and automated usage reporting.

Qualifications & Skills
Required Qualifications:

Experience: 3-5+ years of experience in Network Engineering, Linux Systems Administration, or DevOps, with hands-on experience in GPU infrastructure deployment.

Linux & Automation: Expert-level knowledge of Linux environments and infrastructure-as-code/automation tools (Ansible, Terraform, or SaltStack).

NVIDIA Ecosystem: Deep technical understanding of the NVIDIA AI Enterprise stack (CUDA, NCCL, NVLink).

Billing/Metering Awareness: Practical experience working with usage-based tracking, billing APIs, or internal chargeback tools.

Pay: $80,000.00 - $120,000.00 per year

Benefits:

Dental insurance
Health insurance
Paid time off
Vision insurance

Work Location: In person

Quick Apply

Refine Your Search

Infrastructure Server Engineer jobs

AI Infrastructure Engineer

Senior Windows Server Engineer – Cloud Infrastructure

Senior Windows Server Engineer – Cloud Infrastructure

Infrastructure Engineer Data Center

Senior Linux Server Engineer – Cloud Infrastructure

Infrastructure Deployment Engineer

Connectivity Engineer

Virtual Infrastructure Engineer

Server Infrastructure Engineer

Senior IT Construction Engineer, NA

Sr. Infrastructure and Cloud Engineer

Sr. Systems Development Engineer , Secure Connection Services (SCS), Tactical Edge Mission Engineering Group (TEMEG)

System Development Engineer II, Platform Engineering and Emerging Technologies

ADC Engineer, Identity

Development Security Operations Engineer

Systems Development Engineer, Platform Engineering and Emerging Technologies (PEET)

Systems Development Engineer II, AWS Commerce Platform-ADC

Systems Development Engineer - Identity, Cryptography and Identity Management

Senior IT Project Engineer and Team Lead

Information Technology Engineer- Cloud Data (Architect, SQL Server Administration, Data Gateway)

I want to receive the latest job alert for Infrastructure Server Engineer

Related Searches

Explore jobs in more locations

Job Seeker Tools

Employer Tools

Browse

Stay Connected