Top 8 Software engineering manager Jobs in Madison, Wi

Manager, ML Ops Infrastructure
Paradigm —Middleton, WI
- Full-time
- Hybrid work
- Computer science
- Computer Science
- Residential
Quick Apply
System Test Manager
Technoviz —Madison, WI
- Mid-level
- Java
- Travel
Software Engineering Manager
Extreme Engineering Solutions —Verona, WI
- Full-time
- Background check
- Computer Science
- Computer literacy
- AD&D insurance
- Paid holidays
Engineering & Software Development Manager
SGTS —Madison, WI
- Email
- Engineering
- Mid-level
- Continuous improvement
- Paid training
- Paid holidays
Software Engineering Manager
Genus Plc —Windsor, WI
- $135,000 - $160,000 a year
- Full-time
- Hybrid work
- Azure
- Computer Science
- Master's degree
- Health savings account
- Paid holidays
Manager of Strategic Sourcing, Software and Engineering
Zendesk —Madison, WI
- $116,000 - $174,000 a year
- Email
- Hybrid work
- 5 years
- Data analysis skills
- Office
2d
Business Process Management Programmer
Genome International Corporation —Madison, WI
- Oracle
- Mid-level
- Java

Related jobs to explore

Based on your search for software engineering manager

Civil Engineer - Project Construction Lead
Kapur & Associates —Madison, WI
Must have a valid driver's license and reliable transportation. Provide engineering designs and technical leadership to transportation design engineers,…
$100,000 - $150,000 a year
Quick Apply
Engineering Manager
Agility Personnel —Monroe, WI
Lead and develop the engineering team with clear expectations and a culture of continuous improvement. Bachelor's degree in Mechanical, Electrical, or related…
$120,000 - $165,000 a year
Quick Apply
4d

Show more related jobs

Explore jobs in cities nearby

Check out jobs in cities near your current location, Columbus

Software Engineering Manager - Hybrid
The Hartford —Columbus, OH
Successful candidates will be expected to demonstrate strong leadership skills, excellent partnership with stakeholders and partner teams, solid technical…
$133,200 - $199,800 a year
Software Engineering Manager
Kimball Midwest —Columbus, OH
Experience with modern software design principles (e.g., microservices, API-first architecture, cloud-native development, CI/CD, and secure coding practices).
Quick Apply
2d

Show more jobs in cities nearby

I want to receive the latest job alert for software engineering manager in madison, wi

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

software engineering manager jobs near madison, wi

Software Engineering Manager jobs in Madison, WI

No Drug Test Required jobs in Baltimore, Md

Prototype Vehicle Test Driver jobs in California

Nurse Case Manager jobs in Cincinnati, Oh

No Drug Test Required jobs in Toledo, Oh

Test Manager jobs in Charlotte, Nc

Test Manager jobs in Wright Patterson Afb, Oh

Test Manager jobs in Jersey City, Nj

Test Manager jobs in Arlington, Tx

Software Engineering Manager jobs in California

Software Engineering Manager jobs in Dayton, Oh

Customer Success Manager jobs in Wisconsin

Safety Manager jobs in Chicago, Il

Process Manager jobs in Remote

Software Engineering Manager jobs in Stevens Point, Wi

Software Engineering Manager jobs in Greensboro, Nc

Machine Learning Operations Architect jobs in Irvine, Ca

Landscape Architect jobs in Austin, Tx

Machine Learning Operations Architect jobs in Redwood City, Ca

Machine Learning Operations Architect jobs in Ann Arbor, Mi

Manager, ML Ops Infrastructure

Paradigm -
Middleton, WI

Quick Apply

Job Details

Full-time

Qualifications

AI models
GPU programming
Containerization systems
Performance monitoring
Cost management
Software engineering
GPU architecture
IT operations
Infrastructure as Code (IaC)
Operational management
Application deployment
Managing IT teams
AI platforms (beyond public GPTs)
Scalable systems
Computational framework
Team development
Machine learning cloud services
Cloud engineering team management
Model deployment
Developing large-scale AI models
Mentoring
APIs
Production monitoring
Model training
Cloud automation
DevOps automation
Machine learning libraries
Machine learning frameworks
MLOps
Managing tech infrastructure teams

Full Job Description

Paradigm is a software company transforming the way that the residential, construction & building product industries operate across the globe. We are looking for a Manager, ML Ops Infrastructure to be part of revolutionizing these industries.

We're looking for a hands-on technical leader to build and scale the ML Ops infrastructure that powers our AI capabilities in production. You'll oversee the end-to-end platform for deploying, serving, and operating ML models and AI agents, what we call our "agent factory": a repeatable framework that makes shipping AI-powered features as reliable and routine as deploying any other service.

This role sits at the intersection of ML operations, platform engineering, and cloud infrastructure. You'll build the compute, orchestration, and deployment pipelines that take ML experiments from notebooks to production, creating self-service tooling so data scientists and ML engineers can deploy with confidence and speed.

What You Will Do:

Build and lead a team of ML Ops engineers focused on production deployment frameworks for AI/ML systems including hiring, mentoring, and technical guidance.
Design and operate Kubernetes-based infrastructure for ML workloads including model training, real-time inference, LLM serving, and agent orchestration.
Create the core ML Ops platform: model versioning, deployment automation, registries, serving infrastructure, and CI/CD pipelines purpose-built for ML and AI agent workflows.
Architect and manage GPU-accelerated compute for training and inference, optimizing for both performance and cost through spot instances, auto-scaling, and efficient resource allocation.
Build self-service deployment tooling that enables data scientists and ML engineers to push models and agents to production without manual infrastructure work.
Build the infrastructure for agentic AI: tool-calling, multi-step workflows, orchestration frameworks, multi-agent systems, and agent lifecycle management.
Implement production-grade deployment strategies (canary, blue/green) with rollback capabilities, observability, drift detection, and performance monitoring.
Partner with data science, ML engineering, and SRE teams to align infrastructure with deployment requirements and reliability SLOs.
Drive continuous improvement in deployment velocity, cost efficiency, and operational maturity across the ML platform including evaluating and integrating tools like MLflow, Kubeflow, and emerging agent frameworks.

What You Need to Succeed:

Bachelor’s degree in Computer Science, Engineering, or a related field or equivalent experience.
7+ years in infrastructure engineering, DevOps, or platform engineering, with at least 3 years focused on ML/AI infrastructure.
1+ years of experience building and leading teams that operate production ML systems or demonstrated tech lead experience with direct influence over team processes and career growth.
Track record deploying and managing ML models in production. You understand the full lifecycle from training to serving to monitoring.
Hands-on experience with GPU computing, model optimization, and ML-specific infrastructure patterns.
Hands-on experience with Kubernetes and container orchestration for ML workloads (Kubeflow, KServe, Ray, or similar).
Experience working with Azure cloud services such as Azure ML, Azure OpenAI, Azure Databricks, GPU-accelerated compute (GPU VMs, AKS with GPU node pools).
Experience using infrastructure as code tools (Terraform or equivalent) with ML infrastructure patterns.
Python programming experience with fluency in ML frameworks (PyTorch, TensorFlow) and LLM APIs (OpenAI, Anthropic, Azure OpenAI).
Experience with the modern AI/ML toolchain including model serving (vLLM, Triton, TorchServe), ML Ops platforms (MLflow, Kubeflow, W&B), vector databases (pgvector, Azure AI Search), and agent orchestration frameworks. Familiarity with RAG architectures, fine-tuning workflows, and embedding pipelines at scale.
You are a bridge-builder who translates fluently between ML practitioners and infrastructure teams.
You are a systems thinker who balances performance, cost, and reliability while building for scale.
You are collaborative, curious, and driven to enable teams to ship AI capabilities faster than they thought possible.

Ready to Join? Apply now at myparadigm.com/careers/
#Paradigm

Quick Apply

Refine Your Search

software engineering manager jobs in madison, wi

Manager, ML Ops Infrastructure

System Test Manager

Software Engineering Manager

Engineering & Software Development Manager

Software Engineering Manager

Manager of Strategic Sourcing, Software and Engineering

Business Process Management Programmer

Related jobs to explore

Explore jobs in cities nearby

I want to receive the latest job alert for software engineering manager in madison, wi

Explore jobs in more locations

Job Seeker Tools

Employer Tools

Browse

Stay Connected