West Creek 5 (12075), United States of America, Richmond, VirginiaData Engineer, Principal Associate (Remote-Eligible)Senior Data Engineer - Principal Associate (ITDE45)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you''ll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you''ll have the opportunity to be on the forefront of driving a major transformation within Capital One. What You''ll Do:Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologiesWork with a team of developers with deep experience in machine learning, distributed microservices, and full stack systemsUtilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and SnowflakeShare your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering communityCollaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowermentPerform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performanceBasic Qualifications: Bachelor''s Degree At least 4 years of experience in application development (Internship experience does not apply)At least 1 year of experience in big data technologies Preferred Qualifications: 5+ years of experience in application development including Python, SQL, Scala, or Java2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)3+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)2+ year experience working on real-time data and streaming applications 2+ years of experience with NoSQL implementation (Mongo, Cassandra) 2+ years of data warehousing experience (Redshift or Snowflake) 3+ years of experience with UNIX/Linux including basic commands and shell scripting2+ years of experience with Agile engineering practices At this time, Capital One will not sponsor a new applicant for employment authorization for this position.No agencies please. Capital One is an Equal Opportunity Employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to sex, race, color, age, national origin, religion, physical and mental disability, genetic information, marital status, sexual orientation, gender identity/assignment, citizenship, pregnancy or maternity, protected veteran status, or any other status prohibited by applicable national, federal, state or local law. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City''s Fair Chance Act; Philadelphia''s Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at [Click Here to Email Your Resum]. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.For technical support or questions about Capital One''s recruiting process, please send an email to [Click Here to Email Your Resum]Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).

The Data Engineer, Data Platforms is a pivotal role on our Data Team - with broad responsibility. You're not just managing data; you're pioneering the very platforms that underpin our data and analytics engineering pursuits across the company's extensive landscape. You will own state-of-the-art big data platforms that power the Global Partners data stack -- with your work standing as the backbone supporting all data-centric innovations. You are fluent with platforms like AWS, Snowflake, Dagster, and dbt at your fingertips, and deploying via tools such as Kubernetes, Docker, and Terraform being second nature, you are primed to spearhead our pursuit of data excellence. Your vast experience, extending from data storage best practices to continuously assessing and integrating new technologies, ensures that Global Partners stays ahead of the curve. At the heart of it all, you're not just an engineer; you see the art in orchestrating data. As you engage with teams, provide strategic guidance, and champion the consistent adoption of best practices, you're also shaping the future of data analytics. If you're ignited by the prospect of being at the helm of technological evolution, where every decision melds strategy with data - Join us. Global Partners offers a collaborative team and an environment where we actively invest to create a culture of data driven excellence. For over 90 years Global Partners LP has been delivering the energy our communities need to grow, move, and thrive. FromAlltown Fresh, with its innovative chef-led creations and guest-focused retail experience, to our vast network of over 50 liquid energy terminals across the eastern seaboard and beyond, Global Partner's integrated network of businesses delivers value day-in and day-out to our guests and customers across the US. At Global Partners we embrace the future, investing in the energy transition with initiatives likeGlobalGLOand supporting the communities in which we operate with our charitable work. We're excited for the next 90 years at Global Partners and what innovative new ideas we can bring to our guests and customers in the future. We're looking for passionate people with great ideas to contribute to our company's future. If you're motivated by what's next, Global Partners can provide you the opportunities to push your career to the next level. The Types of "Energy" You Bring <ul> <li>Excellent written and verbal communication skills. </li><li>You are self-motivated and like to take initiative. </li><li>You are a team player with a positive attitude. </li><li>You have strong time management skills. </li></ul> "Gauges" of Responsibility <ul> <li>Architect and implement scalable, cloud-native data platforms that serve as the foundation for all data engineering initiatives across the organization, utilizing technologies such as AWS, GCP, or Azure </li><li>Design and develop CI/CD pipelines for data infrastructure and applications, leveraging tools like Jenkins, GitLab CI, or GitHub Actions to ensure rapid, reliable deployments </li><li>Implement Infrastructure as Code (IaC) practices using tools such as Terraform or CloudFormation to manage and version control cloud resources </li><li>Develop and maintain robust data orchestration workflows using modern tools like Apache Airflow, Dagster, or Prefect, ensuring efficient data processing and transformation </li><li>Collaborate with security teams to implement and maintain IAM policies, user group management, and fine-grained access controls across data platforms and tools </li><li>Design and implement data cataloging and metadata management solutions to enhance data discovery, lineage tracking, and governance, utilizing tools like Apache Atlas or Collibra </li><li>Optimize data storage and processing systems, including data lakes and data warehouses (e.g., Snowflake, BigQuery, Redshift), to ensure cost-effectiveness and performance at scale </li><li>Develop automated tools and self-service platforms that enable data scientists and analysts to efficiently set up, configure, and monitor their data environments </li><li>Implement observability and monitoring solutions for data pipelines and infrastructure using tools like Prometheus, Grafana, or DataDog to ensure system reliability and performance </li><li>Lead the adoption of DataOps practices, fostering collaboration between data engineering, data science, and operations teams to streamline the entire data lifecycle </li><li>Design and implement data quality frameworks and automated testing processes to ensure data integrity and reliability across the organization </li><li>Continuously evaluate and integrate emerging technologies and best practices in big data, cloud computing, and DevOps to drive innovation and efficiency in data engineering processes </li></ul> "Fuel" forYou <ul> <li>Coins!We offer competitive salaries and opportunities for growth. We mean it! We have an amazing Talent Development Team who create trainings for growth and job development. </li><li>Health + Wellness- Medical, Dental, Visions and Life Insurance. Along with additional wellness support. </li><li>The Road Ahead- We offer 401k and a match component! </li><li>Professional Development- We provide tuition reimbursement; this benefit is offered after 6 months of service. </li><li>Give Back! We believe in community support. We know everyone gives in their own way, that's why we offer paid volunteer time-off to you to help an organization of your choice. </li></ul> The GPS of our Interview Process <ul> <li>First thing first, if you're interested in the role, please apply. </li><li>A talent acquisition team member will review your resume in partnership with the hiring manager. If your experience would lend to this opportunity a recruiter willcontact you. </li><li>We conduct "in-person" (ZOOM) interviews and provide additional interview information or other items needed at that time. </li></ul> QUALIFICATIONS <ul> <li>Bachelor's or Master's degree in Computer Science, Engineering, Mathematics, or a related field, or equivalent experience in Data Engineering, DataOps, MLOps, Software Engineering with a minimum of three year's experience or 5 year's experience, in lieu of an applicable degree. </li><li>Strong proficiency in designing and implementing scalable, cloud-native (containerized) data platforms using Infrastructure as Code (e.g., Terraform, Docker, Kubernetes). </li><li>Advanced programming skills in Python focusing on data-intensive applications. Strong SQL proficiency and experience with cloud data warehouses (e.g., Snowflake, BigQuery) required </li><li>Proven track record in designing and implementing CI/CD pipelines for data infrastructure and applications, using tools like Jenkins, GitLab CI, or GitHub Actions </li><li>In-depth knowledge of big data technologies (e.g., Apache Spark, Kafka) and data orchestration tools (e.g., Apache Airflow, Dagster). Experience with data transformation frameworks like dbt and ETL/ELT processes in cloud environments </li><li>Strong background in data security, governance, and metadata management. Experience implementing IAM/RBAC policies, encryption, and data access controls in cloud environments. </li><li>Proficiency in implementing monitoring, logging, and alerting solutions for data infrastructure (e.g., Prometheus, Grafana, ELK stack). Familiarity with serverless architectures is a plus. </li><li>Ability to design and develop automated tools and self-service platforms enabling efficient data environment setup and management for data scientists and analysts </li><li>Experience in optimizing data storage and processing systems for cost-effectiveness and performance at scale. Familiarity with MLOps and integrating ML models into production </li><li>Exceptional team player with strong communication skills, ability to work with cross-functional teams, and a willingness to mentor and share knowledge </li><li>Proficiency in modern Agile development methodologies, coupled with excellent problem-solving abilities and a metrics-first mindset </li></ul> Research shows that many, especially women and marginalized people, are hesitant to apply for job if they don't check every box. If you are excited about this position, and think you could have an impact here, please apply anyway, even if you don't meet every point on the job description. We'd love to hear from you. Global Partners LP is an equal opportunity employer. We foster a company culture where ideas from all people help us grow, move and thrive. We embrace the diversity of all applicants and do not discriminate against race, color, religion, sex, age, national origin, sexual orientation, gender identity, disability, protected veteran status or any other basis prohibited by federal, state or local law. If you have a disability and need an accommodation to apply, please contact our recruiting department at 781-891-4000.

Data Engineer Jobs in Waltham, MA

Data Engineer Principal Associate Remoteeligible
December 1, 2024

Data Engineer Data Platforms
November 29, 2024

Quick filters

Top companies

Data Engineer Jobs in Waltham, MA

Data Engineer Principal Associate RemoteeligibleDecember 1, 2024

Data Engineer Data PlatformsNovember 29, 2024

Quick filters

Top companies

Data Engineer Principal Associate Remoteeligible
December 1, 2024

Data Engineer Data Platforms
November 29, 2024