2874 Software Engineer Compute Platform jobs in New York,NY

Apply Directly

Principal Engineer - Python API Development

Fidelity Investments

Jersey City, NJ 07311

~ 22 min OnsiteEducation AssistanceHealth InsurancePaid Time OffRetirement Benefit

Bachelor's or Master's degree in Computer Science, Software Engineering, or a closely related engineering discipline
8+ years (typically 10+) building and operating production platforms and services at scale
Deep software engineering expertise in Python and distributed systems
A track record of building production‑grade services, libraries, and internal platforms
Linux fluency and scripting are required
Cloud platform leadership (AWS) —hands-on with S3, Lambda, Batch, Step Functions, EventBridge, CloudWatch, and SNS/SQS—and experience shaping platform patterns that other teams adopt
Experience enabling managed ML services (e.g., SageMaker) as part of broader platform capabilities; exposure to Azure or GCP is beneficial
DevOps and CI/CD at scale, owning standards for automated build/test/deploy (e.g., Jenkins, Git‑based workflows), containerization (Docker), release governance, and multi‑environment promotion for ML‑enabled workloads
Infrastructure as Code (CloudFormation, Terraform/OpenTofu) and platform reliability engineering (SLOs/error budgets, capacity planning, cost observability, incident response, and post‑mortems) for ML serving and data/feature pipelines
ML enablement in production: model packaging, deployment strategies (batch/online/streaming), inference routing, traffic management, performance tuning, observability, and controls for responsible use—without a research or modeling focus
Cross‑org technical leadership: you mentor junior and senior engineers, are a backbone of code review across repos, and routinely consider impacts on upstream/downstream systems when proposing changes
Set platform strategy and standards for ML packaging, deployment, serving, and observability—driving consistent adoption across squads and business units
Partner with Data Scientists to package, scale, and operationalize models; define the APIs, guardrails, and automation that take work from experimentation to reliable production
Enable secure, scalable access to traditional and generative models by collaborating with platform and application engineers to integrate through enterprise gateways and services
Advance model/data observability—tooling for data and feature drift detection, prediction‑quality monitoring and uncertainty signals, and automated diagnostics/ explainability
Lead cross‑platform incident response and post‑mortems, drive systemic fixes, and evolve standards to prevent recurrence—across applications and the platform
Uplevel engineering velocity by introducing reusable frameworks, paved paths, and CI/CD templates that simplify integration, reduce toil, and improve reliability at scale
Reduce cost and complexity across the ML ecosystem through pragmatic technology choices, clear abstractions, and a long‑term platform roadmap
The base salary range for this position is $107,000-216,000 USD per year.
Base salary is only part of the total compensation package. Depending on the position and eligibility requirements, the offer package may also include bonus or other variable compensation.

SmartExplore AI is experimental.

iHire

Applied Researcher I

Capital One

New York, NY 10001

Apply Directly

Technology Test Engineer

LMI Consulting, LLC

New York, NY 10001

Apply Directly

Associate, Product Specialists

Goldman Sachs & Co. LLC

New York, NY 10060

Apply Directly

IT Infrastructure Architect, Staff

Curtiss-Wright

Parsippany, NJ 07054

RemotePaid Time OffRetirement Benefit

5-12 years of experience in infrastructure, systems engineering, or related roles
Broad experience in enterprise IT environments (not limited to a single system or tool)
Exposure to core infrastructure areas such as: Identity and access management (e.g., Active Directory or similar)
Server environments (Windows and/or Linux)
Application or platform support
Experience participating in system upgrades, migrations, or integrations
Demonstrated ability to learn and adapt to new technologies quickly
Strong communication and interpersonal skills
Proven ability to produce clear documentation with attention to detail
Exposure to Microsoft environments (Active Directory, Windows Server, SQL Server, Exchange) preferred
Experience with virtualization (e.g., VMware) preferred
Familiarity with cloud platforms (e.g., Azure) preferred
Exposure to CMDB or service management tools preferred
Experience working alongside ERP or business systems teams preferred
Any experience with platform ownership or application support preferred

SmartExplore AI is experimental.

Apply Directly

Principal Engineer - Python API Development

Fidelity Investments

Hoboken, NJ 07030

~ 16 min OnsiteEducation AssistanceHealth InsurancePaid Time OffRetirement Benefit

Bachelor's or Master's degree in Computer Science, Software Engineering, or a closely related engineering discipline
8+ years (typically 10+) building and operating production platforms and services at scale
Deep software engineering expertise in Python and distributed systems
A track record of building production‑grade services, libraries, and internal platforms
Linux fluency and scripting are required
Cloud platform leadership (AWS) —hands-on with S3, Lambda, Batch, Step Functions, EventBridge, CloudWatch, and SNS/SQS—and experience shaping platform patterns that other teams adopt
Experience enabling managed ML services (e.g., SageMaker) as part of broader platform capabilities; exposure to Azure or GCP is beneficial
DevOps and CI/CD at scale, owning standards for automated build/test/deploy (e.g., Jenkins, Git‑based workflows), containerization (Docker), release governance, and multi‑environment promotion for ML‑enabled workloads
Infrastructure as Code (CloudFormation, Terraform/OpenTofu) and platform reliability engineering (SLOs/error budgets, capacity planning, cost observability, incident response, and post‑mortems) for ML serving and data/feature pipelines
ML enablement in production: model packaging, deployment strategies (batch/online/streaming), inference routing, traffic management, performance tuning, observability, and controls for responsible use—without a research or modeling focus
Cross‑org technical leadership: you mentor junior and senior engineers, are a backbone of code review across repos, and routinely consider impacts on upstream/downstream systems when proposing changes
Set platform strategy and standards for ML packaging, deployment, serving, and observability—driving consistent adoption across squads and business units
Partner with Data Scientists to package, scale, and operationalize models; define the APIs, guardrails, and automation that take work from experimentation to reliable production
Enable secure, scalable access to traditional and generative models by collaborating with platform and application engineers to integrate through enterprise gateways and services
Advance model/data observability—tooling for data and feature drift detection, prediction‑quality monitoring and uncertainty signals, and automated diagnostics/ explainability
Lead cross‑platform incident response and post‑mortems, drive systemic fixes, and evolve standards to prevent recurrence—across applications and the platform
Uplevel engineering velocity by introducing reusable frameworks, paved paths, and CI/CD templates that simplify integration, reduce toil, and improve reliability at scale
Reduce cost and complexity across the ML ecosystem through pragmatic technology choices, clear abstractions, and a long‑term platform roadmap
The base salary range for this position is $107,000-216,000 USD per year.
Base salary is only part of the total compensation package. Depending on the position and eligibility requirements, the offer package may also include bonus or other variable compensation.