Northstrat is seeking a talented and experienced Senior Data Engineer to join our team. The ideal candidate will have a strong background in designing and implementing data solutions, with expertise in data integration, data warehousing, and ETL processes. This role involves working closely with cross-functional teams to gather requirements, design data models, develop and maintain ETL pipelines, and ensure data accuracy and quality.

Key Responsibilities:

Design and implement data solutions, including data integration, data warehousing, and ETL processes.

Collaborate with cross-functional teams to gather requirements and translate them into effective data models and data flow diagrams.

Develop and maintain ETL pipelines, ensuring data accuracy, quality, and integrity.

Identify and resolve data-related issues and performance bottlenecks.

Work with stakeholders to understand their data needs and provide guidance on data-related best practices.

Keep up-to-date with the latest trends and technologies in the data engineering field.

Requirements

Candidates have bachelors degree in Engineering or Computer Science with 14 years of experience in data engineering or a related role.

Must have an active TS clearance and SCI eligible

Must be willing to achieve required skill certification promptly or be DOD 8570 IAT 2 certified

Strong expertise in designing and implementing data solutions, including data integration, data warehousing, and ETL processes.

Proficiency in SQL and experience with relational databases (e.g., Oracle, SQL Server, PostgreSQL).

Experience with distributed data platforms and technologies (e.g., Hadoop, Spark, Kafka) and cloud-based data services (e.g., AWS, Azure, GCP).

Hands-on experience with ETL tools and frameworks (e.g., Informatica, Apache Airflow, Talend, SSIS).

Strong programming skills in Python, Java, or other relevant .

Experience with data modeling concepts and tools.

Knowledge of data governance principles and best practices.

Excellent problem-solving and troubleshooting skills.

Effective communication and collaboration abilities.

Desired Qualifications:

Experience working with large-scale and distributed data systems.

Certifications related to data engineering or cloud platforms.

Knowledge of Big Data technologies and frameworks (e.g., Hadoop, Spark).

Experience with workflow management tools (e.g., Apache Airflow).

Benefits

Work/Life Balance

Northstrat values true work life balance. We offer power of choice benefits designed to best meet the needs of you and your lifestyle. Our benefits programs are designed to support and encourage wellness, healthy living, retirement investment, and lifetime learning.

Flex Time

Northstrat does not mandate specific working hours. Although project requirements may dictate schedules, a Northstrat employee is only required to work an average of 8 hours per weekday over the course of a month. For example: John worked 12 hours on June 1st to meet a project deadline. On June 15th, John only worked 4 hours because he left early for a long weekend. John’s IBA was not debited for time off because flex time allowed him to carry over those 4 hours from June 1st.

Individual Benefits Account (IBA)

To attract and retain the highest quality staff, Northstrat provides a unique and versatile benefits package, the Individual Benefit Account (IBA), which places the power of choice in the hands of our greatest asset – the employee.

The purpose of the IBA is to provide attractive benefits to all full-time employees of Northstrat on a flexible basis that enables each covered employee to select a package that best suits his or her needs. Whether those needs are paid time off, medical expenses, prescription drug expenses, cash disbursement, or a combination of any of these, the IBA provides flexibility to help you meet your specific goals. The IBA can be used for such things as:

Medical and Vision Insurance through United Health Care; Dental insurance through Delta Dental

100% Medical Reimbursement

Time Off with Pay

Profit Sharing Plan

401k

Educational Benefits

Additional Income

IBA Benefits accrue each month in the amount equivalent to 50% of the employee’s monthly compensation rate. That is, the effective dollar amount of this accrual is in addition to an employee’s salary.

Profit Sharing Plan (PSP)

The PSP is a qualified retirement plan that Northstrat funds semi-annually on the employee’s behalf through the IBA in the amount equivalent to 25% (up to the IRS contribution limit) of the employee’s compensation. That is, of the 50% accrual in the IBA, half of the amount accrued is applied to the PSP.

Stock Options

Because Northstrat is an employee-owned company, all new employees are offered stock options. Employees have the opportunity to receive additional stock options based on accomplishment of individual performance goals. Stock owners elect the Board of Directors and are directly impacted by the success of the company.

Lifelong Learning

Our culture promotes and nurtures a growth environment. We hire and scale rapidly to meet the needs of our partner customers. Through the use of company provided online learning opportunities, periodic company sponsored training events, and the ability to use IBA funds for reimbursement of work-related education expenses you will have the opportunity to continually grow your skills and abilities.

Bring Your True Self

We embrace and encourage . We support employee led interest groups and challenge our employees to support others and be their best self. We are so true to our beliefs that we offer employee referral incentives. When you like it here, your friends and family will too!

Northstrat is an Equal Opportunity Employer

We are committed to fostering an inclusive, diverse workplace. All qualified applicants will receive consideration for employment without regard to , , , , , , , disability, veteran status or other legally protected status.

Title: Lead Data Engineer

Location: Bridgewater, NJ (hybrid schedule)

Duration: 6 months plus

These are the keys for this role :

Life Sciences (Pharma, Biotech etc.)

Python is a must.

Snowflake Platform is a must.

Exposure to digital data (social, web activity, etc.) is helpful.

"Ownership is a must and has been lacking in the resources who have been unsuccessful

Should want to handle lead responsibilities and help to manage on and offshore resources.

Role: Sr. Data Engineer

Job Description

Experienced Data management specialist responsible for developing, overseeing, organizing, storing, and analyzing data and data systems

Participate in all aspects of the software development lifecycle for Snowflake solutions, including planning, requirements, development, testing, and quality assurance

Work in tandem with our engineering team to identify and implement the most optimal solutions

Ensure platform performance, uptime, and scale, maintaining high standards for code quality and thoughtful design

Troubleshoot incidents, identify root causes, fix and document problems, and implement preventive measures

Able to manage deliverables in fast paced environments

Areas of Expertise

At least 8-10 years of experience designing and development of data solutions in enterprise environment

At least 5+ years' experience on Snowflake Platform

Strong hands-on SQL and Python development

Experience with designing and development data warehouses in Snowflake

A minimum of three years' experience in developing production-ready data ingestion and processing pipelines using Spark, Scala

Strong hands-on experience with Orchestration Tools e.g. Airflow, Informatica, Automic

Good understanding on Metadata and data lineage

Hands on knowledge on SQL Analytical functions

Strong knowledge and hands-on experience in Shell scripting, Java Scripting

Able to demonstrate experience with software engineering practices including CI/CD, Automated testing, and Performance Engineering.

Good understanding and exposure to Git, Confluence and Jira

Good problem solving and troubleshooting skills.

Team player, collaborative approach, and excellent communication skills

Center 3 (19075), United States of America, McLean, Virginia
Lead Data Engineer - Python, Spark (Enterprise Platforms Technology)  Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers, and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One.
Enterprise Platforms Technology (EPTech) comprises many of Capital One’s most important enterprise platforms. We play an essential role in establishing practices for building technology solutions across the company, while also delivering capabilities that exemplify those practices.
What You’ll Do:   Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies.
Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems.
Utilize programming like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud-based data warehousing services such as Redshift and Snowflake.
Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community.
Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment.
Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance.
Basic Qualifications:   Bachelor’s Degree.
At least 4 years of experience in application development.
At least 2 years of experience in big data technologies.
At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud).
Qualifications:   7+ years of experience in application development including Python, SQL, Scala, or Java.
4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud).
4+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL).
4+ year experience working on real-time data and streaming applications.
4+ years of experience with NoSQL implementation (Mongo, Cassandra).
4+ years of data warehousing experience (Redshift or Snowflake).
4+ years of experience with UNIX/Linux including basic commands and shell scripting.
2+ years of experience with Agile engineering practices.
This role is expected to accept applications for a minimum of 5 business days.
No agencies please. Capital One is an equal opportunity employer committed to diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status.

#J-18808-Ljbffr

About Client: The client is a leading digital transformation consultancy and engineering services company that specializes in driving digital transformation for Fortune 1000 enterprises. The company provides a comprehensive range of services, including cloud migration, big data analytics, machine learning, artificial intelligence, and DevOps. It is known for its deep technical expertise and innovative solutions that help businesses optimize operations, improve customer experience, and accelerate time-to-market. The company operates globally, with development centers and offices across the United States, Europe, and Latin America. Salary Range: $160K-$180K/Annum Job Description: Strong understanding of machine learning principles, especially in the context of LLMs. 5 years of experience in big data engineering Proficiency in Java, Scala, Spark Proficiency in PySpark and Golang() Experience building and leveraging largescale data infrastructure, map-reduce/hadoop, cloud- deployments Experience with alerting, monitoring andremediation automation in a large scaledistributed environment BS/BA or equivalent degree in computerscience or similar (). About ApTask: ApTask is a leading global provider of workforce solutions and talent acquisition services, dedicated to shaping the future of work. As an African American-owned and Veteran-certified company, ApTask offers a comprehensive suite of services, including staffing and recruitment solutions, managed services, IT consulting, and project management. With a focus on excellence, collaboration, and innovation, ApTask provides unparalleled opportunities for professional growth and development. As a member of the ApTask team, you will have the chance to connect businesses with top-tier professionals, optimize workforce performance, and drive success across diverse industries. Join us at ApTask and be part of our mission to empower organizations to thrive while fostering a diverse and inclusive work environment. Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview. Candidate Data Collection Disclaimer: At ApTask, we prioritize safeguarding your privacy. As part of our recruitment process, certain Personally Identifiable Information (PII) may be requested by our clients for verification and application purposes. Rest assured, we strictly adhere to confidentiality standards and comply with all relevant data protection laws. Please note that we only collect the necessary information as specified by each client and do not request sensitive details during the initial stages of recruitment. If you have any concerns or queries about your personal information, please feel free to contact our compliance team at

Data Engineer Cv Library Jobs

Senior Data Engineer
December 23, 2024

Lead Data Engineer
December 23, 2024

Lead Data Engineer Python Spark Enterprise Platforms Technology
December 23, 2024

Senior Data Engineer
December 21, 2024

Quick filters

Top companies

Data Engineer Cv Library Jobs

Senior Data EngineerDecember 23, 2024

Lead Data EngineerDecember 23, 2024

Lead Data Engineer Python Spark Enterprise Platforms TechnologyDecember 23, 2024