842 Python Data Engineer Azure Etl Pipelines jobs in New York,NY

Principal Engineer - Python API Development

Fidelity Investments

Weehawken, NJ 07086

~ 12 min OnsiteUrgently HiringEducation AssistanceHealth InsurancePaid Time OffRetirement Benefit

Bachelor's or Master's degree in Computer Science, Software Engineering, or a closely related engineering discipline
8+ years (typically 10+) building and operating production platforms and services at scale
Deep software engineering expertise in Python and distributed systems
A track record of building production‑grade services, libraries, and internal platforms
Linux fluency and scripting are required
Cloud platform leadership (AWS) —hands-on with S3, Lambda, Batch, Step Functions, EventBridge, CloudWatch, and SNS/SQS—and experience shaping platform patterns that other teams adopt
Experience enabling managed ML services (e.g., SageMaker) as part of broader platform capabilities; exposure to Azure or GCP is beneficial
DevOps and CI/CD at scale, owning standards for automated build/test/deploy (e.g., Jenkins, Git‑based workflows), containerization (Docker), release governance, and multi‑environment promotion for ML‑enabled workloads
Infrastructure as Code (CloudFormation, Terraform/OpenTofu) and platform reliability engineering (SLOs/error budgets, capacity planning, cost observability, incident response, and post‑mortems) for ML serving and data/feature pipelines
ML enablement in production: model packaging, deployment strategies (batch/online/streaming), inference routing, traffic management, performance tuning, observability, and controls for responsible use—without a research or modeling focus
Cross‑org technical leadership: you mentor junior and senior engineers, are a backbone of code review across repos, and routinely consider impacts on upstream/downstream systems when proposing changes
Set platform strategy and standards for ML packaging, deployment, serving, and observability—driving consistent adoption across squads and business units
Partner with Data Scientists to package, scale, and operationalize models; define the APIs, guardrails, and automation that take work from experimentation to reliable production
Enable secure, scalable access to traditional and generative models by collaborating with platform and application engineers to integrate through enterprise gateways and services
Advance model/data observability—tooling for data and feature drift detection, prediction‑quality monitoring and uncertainty signals, and automated diagnostics/ explainability
Lead cross‑platform incident response and post‑mortems, drive systemic fixes, and evolve standards to prevent recurrence—across applications and the platform
Uplevel engineering velocity by introducing reusable frameworks, paved paths, and CI/CD templates that simplify integration, reduce toil, and improve reliability at scale
Reduce cost and complexity across the ML ecosystem through pragmatic technology choices, clear abstractions, and a long‑term platform roadmap
The base salary range for this position is $107,000-216,000 USD per year.
Base salary is only part of the total compensation package. Depending on the position and eligibility requirements, the offer package may also include bonus or other variable compensation.

SmartExplore AI is experimental.

New, Posted 20 hours ago

Recommended

Apply Directly

Sr. Data / M/L Engineer [211066]

Skill

New York, NY 10261

Hybrid

Strong SQL and database management experience
Experience with data pipelines and ETL processes
Proficiency in machine learning and statistical modeling
Experience with BI tools (Power BI, Tableau)
Full-stack development knowledge
Experience with cloud platforms (AWS preferred)
Data architecture
Data modeling n
Infrastructure setup
Ability to work with large-scale datasets
Programming experience (likely Python/R inferred)
Strong problem-solving and analytical skills
Bachelor's degree in Electrical Engineering or Computer Engineering
The role requires full stack knowledge, including front-end and back-end components, and the ability to set up new infrastructure.

SmartExplore AI is experimental.

New, Posted 4 hours ago

Recommended

Apply Directly

Principal Engineer - Python API Development

Fidelity Investments

Belleville, NJ 07109

~ 27 min OnsiteUrgently HiringEducation AssistanceHealth InsurancePaid Time OffRetirement Benefit

Bachelor's or Master's degree in Computer Science, Software Engineering, or a closely related engineering discipline
8+ years (typically 10+) building and operating production platforms and services at scale
Deep software engineering expertise in Python and distributed systems
A track record of building production‑grade services, libraries, and internal platforms
Linux fluency and scripting are required
Cloud platform leadership (AWS) —hands-on with S3, Lambda, Batch, Step Functions, EventBridge, CloudWatch, and SNS/SQS—and experience shaping platform patterns that other teams adopt
Experience enabling managed ML services (e.g., SageMaker) as part of broader platform capabilities; exposure to Azure or GCP is beneficial
DevOps and CI/CD at scale, owning standards for automated build/test/deploy (e.g., Jenkins, Git‑based workflows), containerization (Docker), release governance, and multi‑environment promotion for ML‑enabled workloads
Infrastructure as Code (CloudFormation, Terraform/OpenTofu) and platform reliability engineering (SLOs/error budgets, capacity planning, cost observability, incident response, and post‑mortems) for ML serving and data/feature pipelines
ML enablement in production: model packaging, deployment strategies (batch/online/streaming), inference routing, traffic management, performance tuning, observability, and controls for responsible use—without a research or modeling focus
Cross‑org technical leadership: you mentor junior and senior engineers, are a backbone of code review across repos, and routinely consider impacts on upstream/downstream systems when proposing changes
Set platform strategy and standards for ML packaging, deployment, serving, and observability—driving consistent adoption across squads and business units
Partner with Data Scientists to package, scale, and operationalize models; define the APIs, guardrails, and automation that take work from experimentation to reliable production
Enable secure, scalable access to traditional and generative models by collaborating with platform and application engineers to integrate through enterprise gateways and services
Advance model/data observability—tooling for data and feature drift detection, prediction‑quality monitoring and uncertainty signals, and automated diagnostics/ explainability
Lead cross‑platform incident response and post‑mortems, drive systemic fixes, and evolve standards to prevent recurrence—across applications and the platform
Uplevel engineering velocity by introducing reusable frameworks, paved paths, and CI/CD templates that simplify integration, reduce toil, and improve reliability at scale
Reduce cost and complexity across the ML ecosystem through pragmatic technology choices, clear abstractions, and a long‑term platform roadmap
The base salary range for this position is $107,000-216,000 USD per year.
Base salary is only part of the total compensation package. Depending on the position and eligibility requirements, the offer package may also include bonus or other variable compensation.

SmartExplore AI is experimental.

New, Posted 20 hours ago

Apply Directly

Vice President, Full-Stack Engineer

BNY

New York, NY 10007

$83,000-$209,000/yr

New, Posted 11 hours ago

Apply Directly

Head of AlphaGen - Investor Research Product Engineering, Director

Blackrock

New York, NY 10025

OnsiteEducation AssistanceHealth InsurancePaid Time OffRetirement Benefit

Bachelor's degree in Computer Science, Engineering, or a related field; or equivalent practical experience
An advanced degree is a plus
Strategic Engineering Leadership: Proven experience leading large-scale engineering organizations through product transformation initiatives (e.g., platform modernization, cloud migration, operating model changes). Demonstrated success in setting vision and executing across complex, multi-year technology programs
Alpha generation workflows or closely related quantitative research processes in finance/investments
Cloud technologies and cloud-native architectural patterns (e.g., microservices, containerization, distributed computing e.g. Ray)
API-first platform design and developer experience best practices
AI/ML applications for workflow automation, data validation, and operational excellence
Modern stack knowledge and skills - e.g. Python, Polars, Ray, MLFlow or equivalent technology
Demonstrated strength in partnership-building and cross-functional collaboration
Able to influence and align product teams, platform/infrastructure teams, and governance bodies around a common vision and roadmap
Ability to operate in complex market and organizational contexts, translating strategic objectives into actionable plans
Proven track record of driving innovation, navigating ambiguity, and delivering measurable outcomes at scale
AI-First, Human-in-the-Loop: Embraces AI-driven solutions as a default for efficiency and scale, while keeping expert human judgment in critical loops to ensure quality and trust
Platform Over People: Prioritizes building robust platforms and automation over relying on individual heroic efforts, enabling sustainable and scalable growth
Single Front Door: Advocates for a unified user experience where researchers and stakeholders have one intuitive portal for all their needs, simplifying access and support
Standardization Everywhere: Drives consistency in tools, processes, and data across the board, reducing complexity and improving interoperability and maintainability
Self-Service as the Default: Champions self-service capabilities, empowering users to accomplish tasks independently (from data ingestion to model deployment) without bespoke engineering work
Deep Co-Ownership with PMG: Fosters a culture of partnership with the Portfolio Management Group, aligning closely on priorities, sharing roadmaps and KPIs, and co-owning outcomes to ensure the platform truly meets investment teams' needs
For New York, NY Only the salary range for this position is USD$225,000.00 - USD$285,000.00
Additionally, employees are eligible for an annual discretionary bonus, and benefits including healthcare, leave benefits, and retirement benefits
BlackRock operates a pay-for-performance compensation philosophy and your total compensation may vary based on role, location, and firm, department and individual performance
4 days in the office per week, with the flexibility to work from home 1 day a week

SmartExplore AI is experimental.

New, Posted 11 hours ago

Apply Directly

Manufacturing Engineering Manager - Boonton, NJ

Hubbell Incorporated

Boonton, NJ 07005

~ 49 min Onsite

BS in Electrical, Industrial, Mechanical Engineering or similar
5+ years experience in an Electronics, Electro-Mechanical, or relevant manufacturing environment
Proven track record for handling new product launches through PFMEA assembly line creation, ERP setup work etc.
Proven track record of conceptualizing and implementing Test automation framework on the manufacturing floor to reduce takt times and improve process quality,
Must be fluent with mechanical 3D CAD package.
Must be able to read schematics to troubleshoot board level issues
Experience with Electronics and manufacturing of Printed Circuit Board (PCB) Assemblies.
Must possess excellent verbal and written communications skills
An understanding of lean tools and concepts is essential, i.e. time studies, kaizen events, Value Stream Maps, etc
A continuous improvement mindset is critical
Must be familiar with ISO 9000

SmartExplore AI is experimental.

New, Posted 11 hours ago

Apply Directly

Electronic Warfare, Systems Engineering Lead

L3 Harris

Clifton, NJ 07011

~ 30 min OnsiteUrgently HiringBilingual PreferredEducation AssistanceHealth InsurancePaid Time OffRetirement Benefit

Bachelor's Degree and minimum 9 years of prior relevant experience.
Graduate Degree and a minimum of 7 years of prior related experience.
In lieu of a degree, minimum of 13 years of prior related experience.
9 years of experience in systems engineering for radar, RF, or sensor systems
Ability to obtain secret clearance
Travel as needed to support program execution and customer engagement, including periodic travel to Amityville, NY - 25%
10%-20% travel
Background checks
Pre-employment substance abuse testing

SmartExplore AI is experimental.

New, Posted 12 hours ago

Recommended

iHire

Senior Distinguished Engineer, AI Compute (Remote Eligible)

Capital One

New York, NY 10001

Remote

New, Posted 9 hours ago

Recommended

Apply Directly

Lan Administrator Contractor

TEKsystems

New York, NY 10025

$30-$35/hr

OnsiteUrgently HiringHealth InsurancePaid Time OffRetirement Benefit

4 year degree preferred (or close to 4 years completed)
Experience as a tech worker in an enterprise sized company
Experience with mobile device management
Active Directory, Azure/Entra, EAC, Intune experience
VoIP Telephone / end user computer network experience (IDF room experience a+)
Excellent verbal and written communication skills (including command of spelling, grammar, nuanced meaning and tone)
Aptitude for detail-oriented and multiple-dependency decision making
Capable in high pressure environment
Genuinely interested in working on site 5 days a week and willing to do OT when necessary
Must have excellent communication skills and presentation skills

SmartExplore AI is experimental.

Apply Directly

Associate or Senior Associate, Fixed Assets / Cost Segregation Engineer (AMCS) (NYM)

KPMG

New York, NY 10025

OnsiteHealth InsuranceRetirement Benefit

Minimum one year of recent experience in an engineering firm, corporation, or publicaccounting firm; background in cost segregation, fixed asset consulting, construction, engineering, or a related technical field is preferred
Bachelor's degree from an accredited college/university in engineering, architecture, construction management, or a closely related discipline is required
Understanding of construction processes and building systems, and how project costs translate into asset classifications
Basic knowledge of federal income tax depreciation principles and accounting for capital expenditures, or a demonstrated interest in developing this skillset
Experience reviewing technical drawings, construction documentation, or large project cost datasets
Strong proficiency in Excel (such as advanced formulas, pivot tables, lookups) and experience working with structured data from financial or operational systems; demonstrated experience or strong aptitude with data wrangling/automation tools (such as, Power Query, Alteryx), business intelligence tools (such as Power BI, Tableau), or query/scripting languages (such as SQL, Python, R)
Applicant must be authorized to work in the U.S. without the need for employment-based visa sponsorship now or in the future. KPMG LLP will not sponsor applicants for U.S. work visa status for this opportunity (no sponsorship is available for H-1B, L-1, TN, O-1, E-3, H-1B1, F-1, J-1, OPT, CPT or any other employment-based visa)

SmartExplore AI is experimental.