Center 1 (19052), United States of America, McLean, VirginiaLead Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,<a href="https://www.capitalone.com/diversity/business-resource-groups/" target="_blank"> </a>inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, youll have the opportunity to be on the forefront of driving a major transformation within Capital One. Team Description: The Card Data Organization team works on the foundational capabilities of how data should be produced and consumed. The environment involves Batch Pipelines involving core technologies such as Scala, Python, Spark, EMR, Glue, Airflow, Step Functions, Delta, Uniform Catalog, Iceberg, DynamoDB amongst many others. The team tackles problems of massive scale, with a critical data footprint that has bottomline business impact, resiliency & availability requiring the best techniques within Big Data Analytics and Machine Learning, all while providing a superior analyst experience on our tools.What Youll Do:<ul><li>Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies</li><li>Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems</li><li>Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake</li><li>Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community</li><li>Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment</li><li>Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance</li></ul> Basic Qualifications: <ul><li>Bachelors Degree </li><li>At least 6 years of experience in application development (Internship experience does not apply)</li><li>At least 2 years of experience in big data technologies </li><li>At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)</li></ul>Preferred Qualifications:<ul><li>7+ years of experience in application development including Python, SQL, Scala, or Java</li><li>4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)</li><li>4+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)</li><li>4+ year experience working on real-time data and streaming applications </li><li>4+ years of experience with NoSQL implementation (Mongo, Cassandra) </li><li>4+ years of data warehousing experience (Redshift or Snowflake) </li><li>4+ years of experience with UNIX/Linux including basic commands and shell scripting</li><li>2+ years of experience with Agile engineering practices </li></ul>At this time, Capital One will not sponsor a new applicant for employment authorization for this position.Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the <a href="https://www.capitalonecareers.com/benefits" target="_blank">Capital One Careers website</a>. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.This role is expected to accept applications for a minimum of 5 business days.No agencies please. Capital One is an equal opportunity employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to sex (including pregnancy, childbirth or related medical conditions), race, color, age, national origin, religion, disability, genetic information, marital status, sexual orientation, gender identity, gender reassignment, citizenship, immigration status, protected veteran status, or any other basis prohibited under applicable federal, state or local law. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York Citys Fair Chance Act; Philadelphias Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at <a href="mailto:RecruitingAccommodation@capitalone.com" target="_blank">RecruitingAccommodation@capitalone.com</a>. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.For technical support or questions about Capital One's recruiting process, please send an email to <a href="mailto:Careers@capitalone.com" target="_blank">Careers@capitalone.com</a>Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).

Key Responsibilities: - Lead and mentor a team of data engineers in designing, building, and maintaining efficient, scalable data pipelines. - Ensure the integrity and accuracy of data used for analysis, implementing robust validation processes. - Utilize graph databases like Neo4j for complex data modeling and analysis. - Collaborate with business and IT teams to understand requirements and translate them into actionable data and engineering specifications. - Drive the adoption of best practices in data engineering, including continuous integration and delivery (CI/CD) pipelines using tools like GitHub, Jenkins, and UCD. - Oversee the implementation and use of data storage solutions, including PostgreSQL, MS SQL,HIVE, and Snowflake. - Manage cloud-based data solutions utilizing AWS services like EC2, S3, IAM, SQS, SNS, Lambda, and Step Functions. - Advocate for Agile methodologies, fostering a culture of rapid iteration, feedback, and continuous improvement. - Ensure team alignment with disaster recovery plans and practices. - Facilitate communication and collaboration within the team and across departments, leveraging tools like SharePoint, Confluence, and JIRA.

Center 1 (19052), United States of America, McLean, Virginia Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you'll have the opportunity to be on the forefront of driving a major transformation within Capital One. Team Description: The Card Data Organization team works on the foundational capabilities of how data should be produced and consumed. The environment involves Batch Pipelines involving core technologies such as Scala, Python, Spark, EMR, Glue, Airflow, Step Functions, Delta, Uniform Catalog, Iceberg, DynamoDB amongst many others. The team tackles problems of massive scale, with a critical data footprint that has bottomline business impact, resiliency & availability requiring the best techniques within Big Data Analytics and Machine Learning, all while providing a superior analyst experience on our tools. What You'll Do: Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance Basic Qualifications: Bachelor's Degree At least 6 years of experience in application development (Internship experience does not apply) At least 2 years of experience in big data technologies At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud) Preferred Qualifications: 7+ years of experience in application development including Python, SQL, Scala, or Java 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud) 4+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 4+ year experience working on real-time data and streaming applications 4+ years of experience with NoSQL implementation (Mongo, Cassandra) 4+ years of data warehousing experience (Redshift or Snowflake) 4+ years of experience with UNIX/Linux including basic commands and shell scripting 2+ years of experience with Agile engineering practices At this time, Capital One will not sponsor a new applicant for employment authorization for this position. Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website . Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level. This role is expected to accept applications for a minimum of 5 business days. No agencies please. Capital One is an equal opportunity employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to sex (including pregnancy, childbirth or related medical conditions), race, color, age, national origin, religion, disability, genetic information, marital status, sexual orientation, gender identity, gender reassignment, citizenship, immigration status, protected veteran status, or any other basis prohibited under applicable federal, state or local law. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections ; New York City's Fair Chance Act; Philadelphia's Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1- or via email at . All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations. For technical support or questions about Capital One's recruiting process, please send an email to Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site. Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).

Typical task breakdown: - daily standup, collaborate with peers, work independently to complete sprint commitments, participate in agile ceremonies. Candidates local to Peoria would be onsite hybrid. 100% remote candidates ok - please note preference at top of resume Interaction with team : - Daily stand up meetings with team - working mainly with Helios Platform adoption team Work environment : - Mostly remote, deadline driven projects Candidate Requirements Education & Experience Required: -Bachelor's in computer science required plus 5+. Masters degree with 4+ years acceptable as well. Preferred: AWS cloud certifications Technical Skills (Required) - *exp with Object oriented programming - Python (2+ years) - *AWS (3+ years overall exp) lambda and/or glue, EMR, S3 - *SQL (3+ years) - * 2+ years exp in test driven development, unit test, integration testing, regression testing (Desired) - *Event driven framework exp *Kinesis or Kafka exp *familiar with working in Agile methodology Soft Skills (Required) - strong written and verbal communication, experience working as a member of agile engineering team, ability to commit to and deliver work within allocated sprint window. Required Skills : Word Basic Qualification : Additional Skills : Background Check :Yes Drug Screen :Yes Notes : Selling points for candidate : Project Verification Info : Candidate must be your W2 Employee :No Exclusive to Apex :No Face to face interview required :No Candidate must be local :No Candidate must be authorized to work without sponsorship ::No Interview times set : :No Type of project :Other Project Type Master Job Title :Misc: Non-Technical Branch Code :Bloomington

Typical Day This position will be a hybrid of remote work with the ability to attend on-site meetings twice per week in Peoria, IL. The position will be working as a member of a three person team that will interact with a global cross functional team to complete capacity planning projects. Job activities will include designing, gathering and understanding detailed manufacturing process data, executing statistical analysis of product demand, analyzing manufacturing capabilities vs demand requirements, participating in project meetings, maintaining existing statistical models, providing insights into capacity solutions, continually improving existing processes for better reliability and cost. Job duties will include: •Create statistical component demand models •Complete analysis of facility manufacturing capabilities •Effectively communicate with clients, team members, and process partners •Investigate and provide insights into capacity solutions •Perform maintenance of existing statistical models •Lead moderately complex process improvement projects Education/Experience Requirements: •Associates degree or equivalent in engineer, math, or science required. (Bachelors degree nice to have) •3+ years experience manufacturing processes and methods, supply chain, or statistics. Technical Skills •Proficient the Microsoft Tool Suite •Analytical and problem solving capability • Ability to interpret statistical analysis results •High acumen in supply chain and manufacturing process planning. •Ideal candidate will have experience with shop floor planning and manufacturing execution Soft Skills •Team player with the ability to work with a diverse global team •Excellent verbal and written communication skills •Well organized with an attention to detail Required Skills : Excel Basic Qualification : Additional Skills : Background Check :Yes Drug Screen :Yes Notes : Selling points for candidate : Project Verification Info : Candidate must be your W2 Employee :No Exclusive to Apex :No Face to face interview required :No Candidate must be local :Yes Candidate must be authorized to work without sponsorship ::No Interview times set : :No Type of project :Administration/Support Master Job Title :VMS Access Entry Branch Code :Bloomington

Data Engineer Employment Type: Full-Time, Mid-level Department: Business Intelligence CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence platform focused on providing solutions that empower our federal customers with the tools and capabilities needed to turn data into actionable insights. The ideal candidate is a critical thinker and perpetual learner; excited to gain exposure and build skillsets across a range of technologies while solving some of our clients' toughest challenges. CGS brings motivated, highly skilled, and creative people together to solve the government's most dynamic problems with cutting-edge technology. To carry out our mission, we are seeking candidates who are excited to contribute to government innovation, appreciate collaboration, and can anticipate the needs of others. Here at CGS, we offer an environment in which our employees feel supported, and we encourage professional growth through various learning opportunities. Skills and attributes for success: -Complete development efforts across data pipeline to store, manage, store, and provision to data consumers. -Being an active and collaborating member of an Agile/Scrum team and following all Agile/Scrum best practices. -Write code to ensure the performance and reliability of data extraction and processing. -Support continuous process automation for data ingest. -Achieve technical excellence by advocating for and adhering to lean-agile engineering principles and practices such as API-first design, simple design, continuous integration, version control, and automated testing. -Work with program management and engineers to implement and document complex and evolving requirements. -Help cultivate an environment that promotes customer service excellence, innovation, collaboration, and teamwork. -Collaborate with others as part of a cross-functional team that includes user experience researchers and designers, product managers, engineers, and other functional specialists. Qualifications: -Must be a US Citizen. -Must be able to obtain a Public Trust Clearance. -7+ years of IT experience including experience in design, management, and solutioning of large, complex data sets and models. -Experience with developing data pipelines from many sources from structured and unstructured data sets in a variety of formats. -Proficiency in developing ETL processes, and performing test and validation steps. -Proficiency to manipulate data (Python, R, SQL, SAS). -Strong knowledge of big data analysis and storage tools and technologies. -Strong understanding of the agile principles and ability to apply them. -Strong understanding of the CI/CD pipelines and ability to apply them. -Experience with relational database, such as, PostgreSQL. -Work comfortably in version control systems, such as, Git Repositories. Ideally, you will also have: -Experience creating and consuming APIs. -Experience with DHS and knowledge of DHS standards a plus. -Candidates will be given special consideration for extensive experience with Python. -Ability to develop visualizations utilizing Tableau or PowerBI. -Experience in developing Shell scripts on Linux. -Demonstrated experience translating business and technical requirements into comprehensive data strategies and analytic solutions. -Demonstrated ability to communicate across all levels of the organization and communicate technical terms to non-technical audiences. Our Commitment: Contact Government Services (CGS) strives to simplify and enhance government bureaucracy through the optimization of human, technical, and financial resources. We combine cutting-edge technology with world-class personnel to deliver customized solutions that fit our client's specific needs. We are committed to solving the most challenging and dynamic problems. For the past seven years, we've been growing our government-contracting portfolio, and along the way, we've created valuable partnerships by demonstrating a commitment to honesty, professionalism, and quality work. Here at CGS we value honesty through hard work and self-awareness, professionalism in all we do, and to deliver the best quality to our consumers mending those relations for years to come. We care about our employees. Therefore, we offer a comprehensive benefits package: -Health, Dental, and Vision -Life Insurance -401k -Flexible Spending Account (Health, Dependent Care, and Commuter) -Paid Time Off and Observance of State/Federal Holidays Contact Government Services, LLC is an Equal Opportunity Employer. Applicants will be considered without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran. Join our team and become part of government innovation! Explore additional job opportunities with CGS on our Job Board: https://cgsfederal.com/join-our-team/ For more information about CGS please visit: https://www.cgsfederal.com or contact: Email: info@cgsfederal.com

Data Engineer Jobs in Peoria, IL

Lead Data Engineer
July 23, 2024

Data Engineer
July 19, 2024

Lead Data Engineer
July 18, 2024

Lead Data Engineer
July 16, 2024

Data Engineer 3
July 10, 2024

Data Engineer 1
July 6, 2024

Data Engineer
June 28, 2024

Quick filters

Top companies

Data Engineer Jobs in Peoria, IL

Lead Data EngineerJuly 23, 2024

Data EngineerJuly 19, 2024

Lead Data EngineerJuly 18, 2024

Lead Data EngineerJuly 16, 2024

Data Engineer 3July 10, 2024

Data Engineer 1July 6, 2024

Data EngineerJune 28, 2024