Capacity Management Data Engineer
Job Summary
Job Description
What is the opportunity?
Capacity Management Platform (CMP) is looking for a Lead Data Engineer for building data ingestion pipeline via Elasticsearch and Airflow, deep insights generation using Large Language Model tools, as well as business sponsored programs such as Compliance and Regulatory. The engineer will work closely with Shared Platform Services, Digital Operation Teams, and Technology Infrastructure Partners to evolve the technologies and data processes used in capacity management of their platforms.
What will you do?
- Creating software for retrieving, parsing, and processing structured and unstructured data.
- Developing predictive data models, quantitative analyses, and visualization of targeted, big data sources.
- Overseeing the acquisition and ingestion of data from structured and unstructured sources, while ensuring quality and comprehensiveness of data.
- Exploring and implementing semantic data capabilities through NLP, text mining and machine learning techniques.
- Defining and building scalable ETL/ELT workflows for reporting and analytics.
- Supporting project team to scale, monitor and operate data platforms for very high availability and performance.
- Developing scripts and programs for converting various types of data into usable formats.
What do you need to succeed?
Must-have
- 5+ years of development experience with data engineering and science expertise
- 5+ professional working experience with object-oriented programming e.g. Python
- Hands-on experience with Requests, NumPy, SciPy, Pandas, StatsModel, SciKit and other data related Python libraries
- Familiarity with modern data engineering and science packages
- 3+ year of ETL Experience on Data Warehousing and Data Lake environments. Expert on main ETL platforms and tools (Elasticsearch, Postgres, SQL, DB2/ORACLE)
- Experience and comfort delivering a project in true agile fashion and work cross functionally, where requirements are iteratively defined.
- Analytical, insights driven with the ability to leverage data driven decisions.
Nice-to-have
- Cloud development experience such as OCP, GitHub Actions, Jenkins
- Engineering/Math background with a focus on statistics and/or analytics
- Familiarity with modern observability tools (Grafana, Splunk, Dynatrace) and Open Telemetry
What's in it for you?
We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.
- A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable
- Leaders who support your development through coaching and managing opportunities
- Ability to make a difference and lasting impact
- Work in a dynamic, collaborative, progressive, and high-performing team
- A world-class training program in financial services
- Flexible work/life balance options
- Opportunities to do challenging work
#LI-Hybrid
#LI-POST
#TECHPJ
Job Skills
Big Data Management, Critical Thinking, Data Administration, Data Governance, Data Movement, Data Warehousing (DW), Information Capture, Knowledge Organization, Long Term Planning, Repository ToolsAdditional Job Details
Address:
City:
Country:
Work hours/week:
Employment Type:
Platform:
Job Type:
Pay Type:
Posted Date:
Application Deadline:
Note: Applications will be accepted until 11:59 PM on the day prior to the application deadline date above
Inclusion and Equal Opportunity Employment
At RBC, we embrace diversity and inclusion for innovation and growth. We are committed to building inclusive teams and an equitable workplace for our employees to bring their true selves to work. We are taking actions to tackle issues of inequity and systemic bias to support our diverse talent, clients and communities.
We also strive to provide an accessible candidate experience for our prospective employees with different abilities. Please let us know if you need any accommodations during the recruitment process.
Join our Talent Community
Stay in-the-know about great career opportunities at RBC. Sign up and get customized info on our latest jobs, career tips and Recruitment events that matter to you.
Expand your limits and create a new future together at RBC. Find out how we use our passion and drive to enhance the well-being of our clients and communities at jobs.rbc.com.