Data Engineer

☞ JPMorgan Chase & Co.

View: 106

Update day: 01-06-2024

Location: Glasgow Scotland

Category: IT - Software

Industry: Capital Markets

Job type: Full-time

Loading ...

Job content

As a member of the CTC Cyber Data Office team, developing and maintaining innovative data-centric solutions that maximize JPMC’s most critical data assets will drive you to excel. You will be part of a highly motivated team focused on analyzing, designing, developing and delivering data and analytics solutions built to utilize data to stop adversaries and strengthen our operations. You will demonstrate best practices and embrace emerging trends to strengthen our strategic roadmap. Finally, you will lead by example and earn the trust of the Cybersecurity team and collaborators from around the world working in our global team of technologists and innovators, senior management, and, the people and companies whose assets we manage and protect.

Preferred candidates will have experience with data catalogs and metadata management to simplify discovery and governance of data assets. In addition this role will be required to have knowledge of statistical methods for measuring and actively monitoring data quality, outliers, and detecting anomalous behavior in source systems and working with stakeholders to resolve them.

Responsibilities
  • Engage with cybersecurity domain experts to understand business goals and use cases related to using real-world data to solve business problems
  • Work with cybersecurity engineers and machine learning practitioners to develop data applications to solve business goals (fraud, anomalies, cyber threats)
  • Create the automated system of workflows (tasks, jobs) to move data from commercial or in-house applications into Data Lakes, Data Meshes, or Relational Databases
  • Design, develop and document the ETL/ELT pipelines that reshape and persist data for data consumers
  • Integrate or create the management infrastructure to monitor, measure, and maintain data-centric applications
Required
  • Experience with batch or streaming technologies such as Apache Spark or AWS Glue
  • Experience creating workflows and data pipelines using tools like Apache Airflow
  • writing code that runs in a production system
    • Software Development Lifecycle tools like Git, Bitbucket, Jenkins and Jira
  • Experience working with incremental data transfer solutions such as Apache Sqoop or Change Data Capture (CDC)
  • Integration with monitoring solutions such as DataDog, Prometheus or others
  • Creating dashboards for monitoring batch jobs (Grafana, other)
Preferred
  • Experience using Amazon AWS tools for data management
    • AWS Glue, AWS EMR, AWS Redshift Spectrum/Athena
  • Experience deploying AWS services using Terraform or CloudFormation
  • Database or Schema Design and Schema Evolution
  • Experience with structured file formats such as Parquet or Apache Iceberg
  • Data catalog solutions such as Collibra, DataHub or Alation
  • Experience with streaming platforms such as Apache Kafka, Flink, or Spark Streaming
  • Data Processing workflow solutions such as Apache Beam
  • Development of REST APIs using tools like Flask, FastAPI or SpringBoot
    • Polygot programming skills; Python, Java, Bash
  • Experience with measuring data quality using statistical measures for detecting anomalous events, outliers or other data quality issues
J.P. Morgan is a global leader in financial services, providing strategic advice and products to the world’s most prominent corporations, governments, wealthy individuals and institutional investors. Our first-class business in a first-class way approach to serving clients drives everything we do. We strive to build trusted, long-term partnerships to help our clients achieve their business objectives.

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. In accordance with applicable law, we make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as any mental health or physical disability needs.
Loading ...
Loading ...

Deadline: 16-07-2024

Click to apply for free candidate

Apply

Report job
Loading ...
Loading ...

SIMILAR JOBS

Loading ...
Loading ...