Data Engineer with Python- Full time

Company: Capital One Careers
Location: Baltimore
Posted on: November 8, 2024

Job Description:

Center 1 (19052), United States of America, McLean, Virginia Distinguished Engineer, Risk Management Data Architect Capital One is looking for a Distinguished Engineer with extensive experience in data engineering, data architecture and data modeling to drive the design and implementation of a high performance data ecosystem that supports real-time, intelligent experiences to enable our Risk Management functions. In this role, you will help shape the Risk Management Data domains that will drive our journey towards standardized data assets and data products. At Capital One, we believe diversity of thought strengthens our ability to influence, collaborate and provide the most innovative solutions across organizational boundaries. This role is part of the Risk Technology organization. In Risk Technology, we provide the foundation for Capital One to thrive in an uncertain world. Our engaged, empowered, and intelligent people produce outstanding products, working toward the common goal of transforming risk management with technology. We build data-driven tools that use machine learning to prevent risks & automatically detect issues before they impact our business, our customers, or our communities. Define and Implement data architecture standards, frameworks and guidelines to ensure data platform efficiency and to ensure high quality data for gaining insights / downstream consumptions Lead the creation of data models and ontologies to standardize data definitions, relationships and semantics across systems Collaborate with extended teams and stakeholders to establish data standards, metadata management practices and data quality frameworks Design scalable architectures that integrate various data sources, systems, and platforms while minimizing duplication Partner with engineering, data analysis, data science and business teams to align data solutions with business needs. Mentor technical teams in data architecture best practices Develop comprehensive architectural documentation and communicate data architecture principles to both technical and non-technical stakeholders Conduct exploratory data analysis to elucidate deficiencies and opportunities with tangible evidence Partner with other Distinguished Engineers across the enterprise to identify and foster investments in shared data services and platforms Engage with senior business product leads to understand the business strategy, value propositions, relative priorities and criteria for success. Hands on experience with AWS Cloud data technologies including RDS, DynamoDB, S3 and Glue ETL Experience designing and implementing event based stream processing solutions using technologies such as Kafka, Kinesis, Spark and Flink Ability to design and implement high availability, multi-region data replication for mission critical applications Experience designing and implementing data management solutions that enable Data Quality, Reference Data Management, and Metadata Management. A track record of designing and implementing end-to-end data pipelines supporting both production and analytic use cases Comfortable coding with Python or Scala and proficient in SQL In-depth understanding of AVRO, Parquet and DeltaLake data formats Background using multiple data storage technologies including relational, document, key/value, graph and object stores Demonstrated ability to partner with internal product and intent owners to help define requirements and outcomes for data-focused initiatives Ability to decompose large problems and execute smaller, manageable bodies of work to demonstrate continuous architecture delivery Understanding of machine learning and AI data infrastructure needs Basic Qualifications: Bachelor's degree At least 7 years of experience in Data Architecture and Data Engineering At least 7 years of Data modeling and platform design At least 2 years of experience in cloud computing (building applications in AWS ) Preferred Qualifications: Bachelor's or Master's Degree in Computer Science or a related field At least 2 years of experience with ontology standards for defining a domain At least 2 years of experience using Python, SQL or Scala At least 1 year of experience deploying machine learning models Experience implementing knowledge graphs Familiarity with Industry standards related to Data Experience with data mesh, data lakehouse architectures and real-time data pipelines Capital One will consider sponsoring a new qualified applicant for employment authorization for this position. The minimum and maximum full-time annual salaries for this role are listed below, by location. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked. This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website . Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level. This role is expected to accept applications for a minimum of 5 business days. Capital One is an equal opportunity employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to sex (including pregnancy, childbirth or related medical conditions), race, color, age, national origin, religion, disability, genetic information, marital status, sexual orientation, gender identity, gender reassignment, citizenship, immigration status, protected veteran status, or any other basis prohibited under applicable federal, state or local law. and other applicable federal, state, and local laws and regulations regarding criminal background inquiries. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations. For technical support or questions about Capital One's recruiting process, please send an email to Careers@capitalone.com Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site. Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (

Keywords: Capital One Careers, Potomac , Data Engineer with Python- Full time, Engineering , Baltimore, Maryland