Databricks Data Engineer Job at Smart IT Frame LLC, New York, NY

TUxDaVRCRXBRWWlwZktLSVFEcEFKdDFNcUE9PQ==
  • Smart IT Frame LLC
  • New York, NY

Job Description

Job Title: Databricks Data Engineer

Location: NYC, NY (Hybrid)

Work Type: Full Time

Job Description:-

· This role will be part of the Data Strategy team spanning across the client Capital Markets and securities teams, Americas Division’s broker-dealer and swap-dealer entities.

· This role will be involved in the active development of the data platform in close coordination with the team, beginning with the establishment of a reference data system for securities and pricing data, and later moving to other data domains.

· The consulting team will need to follow internal developments standards to contribute to the overall agenda of the Data Strategy team.

· The implementation of this strategic platform on client’s Azure Cloud Platform will require solutions and know-how as listed in the qualifications below.

Qualifications and Skills

· 10+ years of experience in software development using Python, PySpark and its frameworks.

· Proven experience as a Data Engineer with experience in Azure cloud.

· Experience implementing solutions using -

o Azure cloud services

o Azure Data Factory

o Azure Lake Gen 2

o Azure Databases

o Azure Data Fabric

o API Gateway management

o Azure Functions

· Well versed with Azure Databricks

· Strong SQL skills with RDMS or noSQL databases

· Experience with developing API’s using FastAPI or similar frameworks in Python

· Familiarity with the DevOps lifecycle (git, Jenkins, etc.), CI/CD processes

· Good understanding of ETL/ELT processes

· Experience in financial services industry, financial instruments, asset classes and market data are a plus.

Job Tags

Full time,

Similar Jobs

State of Wisconsin

Plumbing Plan Reviewer (South Central) - $2,000 Sign-on Bonus Job at State of Wisconsin

 ...pressurized gas systems, and electrical systems; and performing plan reviews of commercial building, plumbing, fire suppression, elevators,...  ...or training with plumbing inspections How To Apply Apply online! To apply, click "Apply for Job" to start the application... 

Organic Biolabs

Real Estate Driver - Investment Firm Job at Organic Biolabs

 ...Job Description Job Description Real Estate Driver- Investment Firm $20/HR (Phoenix) compensation: $18-20 Hour employment type: employee's choice Real Estate Driver Job Details Part-time to Full Time Contract Estimated: $31,000 - $42,000 a year Benefits... 

Dexian

Python Data Tester Job at Dexian

 ..., NC. Responsibilities: Will be developing automated tests for regulatory reports, Sarbanes-Oxley (SOX) and other critical uses...  ...applications / backend service / analytics / statistics ~ Data ETL, DB development, SQL, Hadoop, Macros, VBAm, Excel/Access,... 

Aramark

Low Voltage Alarm Technician Job at Aramark

 ...lighting fixtures and other electrical components. Tests electrical and electronic equipment and components for continuity, current, voltage and resistance. Maintains, repairs, installs and tests switchgear, transformers, switchboard meters, regulators, and reactors.... 

CoreCivic

Senior Correctional Officer, Inmate Relations Job at CoreCivic

 ...service, high standards of professionalism and a responsibility to better the public good. We are currently seeking a **Senior Correctional Officer, Inmate Relations** who has a passion for providing the highest quality care in an institutional, secure setting. Come...