Cloud Data Engineer
Federal Reserve Bank of Atlanta
Company
Federal Reserve Bank of New YorkWorking at the Federal Reserve Bank of New York positions you at the center of the financial world with a unique perspective on national and international markets and economies. You will work in an environment with a diverse group of experienced professionals to foster and support the safety, soundness, and vitality of our economic and financial systems.The Bank believes in work flexibility to balance the demands of work and life while also connecting and collaborating with our colleagues in person. Employees can expect to be in the office a couple of days per week as needed for meetings and team collaboration and should live within a commutable distance.
What we do:
As a member of the development team in EPC, you will be building the next generation distributed data storage and processing systems that can outperform specialized SQL query engines in relational query performance and provide the programming abstractions to support diverse workloads ranging from ETL to data consumption across various analytical models.
Your role as a Cloud Data Engineer:
Design, develop, support, and maintain automated business intelligence products using Alteryx/Tableau.
Rapidly design, develop, and implement reporting applications that embed KPI metrics and actionable insights into the operational, tactical, and strategic activities of key business functions. Knowledge of Qualtrics is a plus.
Extensive experience with Data Pipeline development using Python/Pyspark on Databricks and designing of bigdata platform with Hadoop and Scala experience.
Possess a robust technical background in Databricks, enabling you to guide teams through complex technical challenges.
Good understanding of GitLab, CI/CD Pipeline and Devops.
Utilize Python for data manipulation, automation, and integration tasks for Data Pipeline development.
Write and optimize SQL queries for data extraction, transformation, and loading processes.
Knowledge of RDBMS, NoSQL, Key/Value databases.
Experience in AWS resources for building data workflows, transformations using AWS Glue, EKS, S3, DynamoDB & Redshift.
What we are looking for:
Experienced in Python/Pyspark development.
Experience in building notebooks in Databricks.
Experience with Gitlab, CI/CD Pipeline, DevOps.
Experience in AWS resources such as S3, Lambda, Redshift, Glue, Athena
Experienced in Python/Pyspark development for data pipeline and ETL development
Familiarity with Starburst and Trino
Familiarity with Agile Framework and Scrum methodology
Salary Range: $144200 - $236300 / year
We believe in transparency at the NY Fed. This salary range reflects a variety of skills and experiences candidates may bring to the job. We pay individuals along this range based on their unique backgrounds. Whether you’re stretching into the job or are a more seasoned candidate, we aim to pay competitively for your contributions.
Our Touchstone Behaviors—Communicate Authentically, Collaborate Inclusively, Drive Progress, Develop Others, and Take Ownership—help shape the culture of the Bank. They also provide a shared language for how we work together and achieve success, and they set clear expectations for leading with impact at every stage of your career with us. Learn more.
Benefits:
Our organization offers benefits that are the best fit for you at every stage of your career:
Fully paid Pension plan and 401k with Generous Match
Comprehensive Insurance Plans (Medical, Dental and Vision including Flexible Spending Accounts and HSA)
Subsidized Public Transportation Program
Tuition Assistance Program
Onsite Fitness & Wellness Center
And more
The New York Fed expects its employees to perform their duties with honesty, integrity, and impartiality, and without improper preferential treatment of any person. Learn more about our code of conduct and conflicts of interest rules.
In addition, candidates must undergo an enhanced background check.
The Federal Reserve Bank of New York is committed to a diverse workforce and to providing equal employment opportunity to all persons without regard to race, color, religion, national origin, sex, sexual orientation, gender identity, age, genetic information, disability, pregnancy, or military service.
We value accessibility for all candidates and are happy to provide an accommodation or assistance. Please email us at ny.leaves@ny.frb.org and we’ll be glad to help. Please note, this is a dedicated e-mail box designed exclusively to assist applications with accommodation requests in relation to our recruiting process. All other inquires including the status of applications will not receive a response from this e-mail box.
This is not necessarily an exhaustive list of all responsibilities, duties, performance standards or requirements, efforts, skills or working conditions associated with the job. While this is intended to be an accurate reflection of the current job, management reserves the right to revise the job or to require that other or different tasks be performed when circumstances change.
Be aware of potentially fake online job postings that claim to be from the Federal Reserve. Always verify and apply to jobs on the Federal Reserve System Careers webpage.
Full Time / Part Time
Full timeRegular / Temporary
RegularJob Exempt (Yes / No)
YesJob Category
Information TechnologyWork Shift
First (United States of America)The Federal Reserve Banks believe that diversity and inclusion among our employees is critical to our success as an organization, and we seek to recruit, develop and retain the most talented people from a diverse candidate pool. The Federal Reserve Banks are committed to equal employment opportunity for employees and job applicants in compliance with applicable law and to an environment where employees are valued for their differences.
Always verify and apply to jobs on Federal Reserve System Careers (https://rb.wd5.myworkdayjobs.com/FRS) or through verified Federal Reserve Bank social media channels.