8987 Datacenter System Software Architect jobs in New York,NY

Deep expertise across the full intelligence platform stack — including distributed data pipelines, ML platform architecture, embedding systems, feature stores, agent-to-agent API design, and LLM-powered application layers — with demonstrated ability to architect and ship all layers as a coherent, production-grade product
Demonstrated experience architecting and operating consumer data intelligence or data product platforms underpinned by complex machine learning systems and built on modern, cloud-native data infrastructure
Hands-on proficiency with Snowflake (including Cortex, Native Apps, and data sharing frameworks), cloud data platforms (AWS, Azure, or GCP), and production ML/AI systems at scale
Experience building agentic AI systems and LLM-powered product interfaces — including agent-to-agent APIs, retrieval-augmented generation architectures, and natural language UIs grounded in proprietary data — with strong product instincts around accuracy, trust, and user experience for non-technical enterprise audiences
Proven ability to translate complex technical architecture into clear executive and partner-facing communications; comfortable engaging at the C-suite level and in strategic partner negotiations with hyperscalers and technology platforms
Strong understanding of privacy-preserving data architecture, including differential privacy, de-identification techniques, zero-copy and clean room frameworks, and the regulatory landscape governing consumer behavioral data
Track record of recruiting and developing exceptional engineering talent in competitive markets; experience building high-performance teams from early-stage through scaled operations
Experience managing external development partners and outsourced engineering resources alongside an internal team in a fast-moving, build-from-scratch environment
Ability to operate in an ambiguous, early-stage environment while maintaining rigorous engineering standards and delivering against aggressive milestones
Experience building externally-consumed data or intelligence platforms — including developer-facing APIs, data marketplace integrations, or partner-accessible data products — with strong instincts around developer experience, access governance, and commercial platform design
Bachelor's Degree in Computer Science, Software Engineering, Electrical Engineering, or a related technical field
Experience leading consumer data intelligence, AI/ML platform, or data product engineering organizations — 10 years
Engineering leadership and team-building experience, including managing senior technical staff — 7 years