The Kriddha technologies Data Engineer interview guide, interview questions, salary data, and interview experiences.

Kriddha technologies Data Engineer Interview Guide

Getting ready for an Data Engineer interview at Kriddha technologies? The Kriddha technologies Data Engineer interview span across 10 to 12 different question topics. In preparing for the interview:
<ul>
<li>Know what skills are necessary for Kriddha technologies Data Engineer roles.</li>
<li>Gain insights into the Data Engineer interview process at Kriddha technologies.</li>
<li>Practice real Kriddha technologies Data Engineer interview questions.</li>
</ul>
Interview Query regularly analyzes interview experience data, and we've used that data to produce this guide, with sample interview questions and an overview of the Kriddha technologies Data Engineer interview.


Getting ready for an Data Engineer interview at Kriddha technologies? The Kriddha technologies Data Engineer interview span across 10 to 12 different question topics. In preparing for the interview:

- Know what skills are necessary for Kriddha technologies Data Engineer roles.
- Gain insights into the Data Engineer interview process at Kriddha technologies.
- Practice real Kriddha technologies Data Engineer interview questions.

Interview Query regularly analyzes interview experience data, and we've used that data to produce this guide, with sample interview questions and an overview of the Kriddha technologies Data Engineer interview.
        

Overview

We've gathered this data from parsing thousands of interview experiences sourced from members.

We've gathered this data from parsing thousands of interview experiences sourced from members.

Kriddha technologies Data Engineer Interview Process

You are tasked with keeping track of a customer’s addresses in your database.

However, customer’s addresses change whenever they move. We want to keep track of their moving history as well as the person that moves in afterwards.

How would you create or modify a schema to keep track of these address changes?

Create a schema to keep track of customer address changes

Address Schema

You’re tasked with designing a database system for Swipe Inc., a company that manages payments for software developers. Swipe manages a set of APIs so developers can abstract payment processes for their web service and transfer control over to Swipe’s APIs to manage payment security and finance handling (contacting credit card providers, etc.)

Your database system should store a collection of API keys with their attributes, as shown in the example below:

<pre tabindex="0" class="chroma"><code>{
 &#34;API_key&#34;:{
 &#34;Transaction_list&#34;:{
 &#34;User_ID&#34;:{
 &#34;Name&#34;:{
 &#34;f_name&#34;: 
 &#34;l_name&#34;: 
 }
 &#34;Card_Details&#34;:{
 &#34;Bank&#34;:
 &#34;Card_No&#34;:
 &#34;Expiry&#34;:
 &#34;CV&#34;:
 } 
 }
 }
 &#34;Curr_balance&#34;:
 }
}
</code></pre>

What are the functional and non-functional requirements for this database?

Determine the requirements for designing a database system to store payment APIs

Swipe Payment API

Given a table called <code>employees</code>, get the largest salary of any employee by department

Example:

Input:

<code>employees</code> table

<table>
<thead>
<tr>
<th>Column</th>
<th>Type</th>
</tr>
</thead>

<tbody>
<tr>
<td><code>id</code></td>
<td>INTEGER</td>
</tr>

<tr>
<td><code>department</code></td>
<td>VARCHAR</td>
</tr>

<tr>
<td><code>salary</code></td>
<td>INTEGER</td>
</tr>
</tbody>
</table>
Output:

<table>
<thead>
<tr>
<th>Column</th>
<th>Type</th>
</tr>
</thead>

<tbody>
<tr>
<td><code>department</code></td>
<td>VARCHAR</td>
</tr>

<tr>
<td><code>largest_salary</code></td>
<td>INTEGER</td>
</tr>
</tbody>
</table>

Write a query to get the largest salary of any employee by department

Largest Salary by Department

Kriddha technologies Data Engineer Interview Questions

.video-wrapper svg { top:40%; } U.S. - What we do matters By playing this video you consent to Google/YouTube processing your data and using cookies Learn more . Position Description: CGI has an immediate need for an AWS Data Engineer to join our team. This is an exciting opportunity to work in a fast-paced team environment supporting one of the largest customers. We take an innovative approach to supporting our client, working side-by-side in an agile environment using emerging technologies. This position is located in our a client site in Reston, VA. A hybrid working model is acceptable. We partner with 15 of the top 20 banks globally, and our top 10 banking clients have worked with us for an average of 26 years! We have over 92,000+ CGI Members in 40 countries and over 5k+ loyal Clients who are leveraging our end-to-end services across the globe. Your future duties and responsibilities: We are looking for an AWS Data Engineer in Reston, VA to join our team. Experience in full life cycle application/system development. Experience developing in distributed application environments (Database, Transaction Management). Experience writing conceptual and detailed design documents and developing large scale enterprise applications following an Agile execution model. Experience in AWS development and services. Should be able to contribute for both Automation testing and deployment work. Required qualifications to be successful in this role: 6+ years of Data Engineering and insight experience. Strong Python experience. Experience in building and deploying applications in AWS using services like (S3,Glue,Redshift,RDS,AWS EMR, CloudWatch, Lambda, State Machine, SNS, SQS, ECS, AppFlow, etc.). SQL and Data Analysis Experience with APIs, RESTful services. Strong experience building CI/CD pipelines on AWS (CloudFormation and Gitlab) Desired Skills: Knowledge on Informatica Power center ETL tool or any other ETL tools and automation testing Education: Bachelor's degree in computer science or related field CGI is required by law in some jurisdictions to include a reasonable estimate of the compensation range for this role. The determination of this range includes various factors not limited to skill set, level, experience, relevant training, and licensure and certifications. To support the ability to reward for merit-based performance, CGI typically does not hire individuals at or near the top of the range for their role. Compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range for this role in the U.S. is $66,30.00 - $146,900.00. Benefits CGIs benefits are offered to eligible professionals on their first day of employment to include: Competitive compensation Comprehensive insurance options Matching contributions through the 401(k) plan and the share purchase plan Paid time off for vacation, holidays, and sick time Paid parental leave Learning opportunities and tuition assistance Wellness and Well-being programs Skills: * Data Analysis * ETL * GitLab * Python * SQL * Informatica What you can expect from us: Together, as owners, lets turn meaningful insights into action. Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, youll reach your full potential because You are invited to be an owner from day 1 as we work together to bring our Dream to life. Thats why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our companys strategy and direction. Your work creates value. Youll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise. Youll shape your career by joining a company built to grow and last. Youll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons. Come join our teamone of the largest IT and business consulting services firms in the world. Qualified applicants will receive consideration for employment without regard to their race, ethnicity, ancestry, color, sex, religion, creed, age, national origin, citizenship status, disability, pregnancy, medical condition, military and veteran status, marital status, sexual orientation or perceived sexual orientation, gender, gender identity, and gender expression, familial status or responsibilities, reproductive health decisions, political affiliation, genetic information, height, weight, or any other legally protected status or characteristics to the extent required by applicable federal, state, and/or local laws where we do business. CGI provides reasonable accommodations to qualified individuals with disabilities. If you need an accommodation to apply for a job in the U.S., please email the CGI U.S. Employment Compliance mailbox at . You will need to reference the Position ID of the position in which you are interested. Your message will be routed to the appropriate recruiter who will assist you. Please note, this email address is only to be used for those individuals who need an accommodation to apply for a job. Emails for any other reason or those that do not include a Position ID will not be returned. We make it easy to translate military experience and skills! Click here to be directed to our site that is dedicated to veterans and transitioning service members. All CGI offers of employment in the U.S. are contingent upon the ability to successfully complete a background investigation. Background investigation components can vary dependent upon specific assignment and/or level of US government security clearance held. Dependent upon role and/or federal government security clearance requirements, and in accordance with applicable laws, some background investigations may include a credit check. CGI will consider for employment qualified applicants with arrests and conviction records in accordance with all local regulations and ordinances. CGI will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with CGIs legal duty to furnish information.

Senior Data Engineer (Python, AWS, Glue, Scala)

Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you'll have the opportunity to be on the forefront of driving a major transformation within Capital One.

What You'll Do:

Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
Basic Qualifications:       Bachelor's Degree
At least 3 years of experience in application development (Internship experience does not apply)
At least 1 year of experience in big data technologies
Preferred Qualifications:       5+ years of experience in application development including Python, SQL, Scala, or Java
2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
3+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)
2+ year experience working on real-time data and streaming applications
2+ years of experience with NoSQL implementation (Mongo, Cassandra)
2+ years of data warehousing experience (Redshift or Snowflake)
3+ years of experience with UNIX/Linux including basic commands and shell scripting
2+ years of experience with Agile engineering practices

At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, or another type of work authorization).

The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.

Chicago, IL: $144,200 - $164,600 for Senior Data Engineer

McLean, VA: $158,600 - $181,000 for Senior Data Engineer

New York, NY: $173,000 - $197,400 for Senior Data Engineer

Plano, TX: $144,200 - $164,600 for Senior Data Engineer

Richmond, VA: $144,200 - $164,600 for Senior Data Engineer

Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate's offer letter.

This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.

Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the . Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.

This role is expected to accept applications for a minimum of 5 business days.

No agencies please. Capital One is an equal opportunity employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to sex (including pregnancy, childbirth or related medical conditions), race, color, age, national origin, religion, disability, genetic information, marital status, sexual orientation, gender identity, gender reassignment, citizenship, immigration status, protected veteran status, or any other basis prohibited under applicable federal, state or local law. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City's Fair Chance Act; Philadelphia's Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.

If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1- or via email at . All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.

For technical support or questions about Capital One's recruiting process, please send an email to

Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.

Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).

Job Number: R0215025 Data Engineer, Senior The Opportunity: Ever-expanding te chn ology like IoT, machine learning, and artifi cia l intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing big data can yield pivotal insights when it's gathered from disparate sources. We need an experienced data engineer like you to help our clients find answers in their big data to impact important missions-from fraud detection to cancer research to national intelligence. As a big data engineer at Booz Allen, you'll implement data engineering activities on some of the most mission-driven projects in the industry. You'll deploy and develop pipelines and platforms that organize and make disparate data meaningful. Here, you'll work with and guide a multi-disciplinary team of analysts, data engineers, developers, and data consumers in a fast-paced, agile environment. You'll use your experience in analytical exploration and data examination while you manage the assessment, design, building, and maintenance of scalable platforms for your clients. Work with us to use big data for good. Join us. The world can't wait. You Have: * Experience with SQL, Java, or Python and Spark
* Experience working with highly structured data
* Ability to manipulate data across different tables
* Knowledge of different data types, as well as the different sources of data
* Knowledge of modeling and how to make that data usable for meeting mission requirements
* TS/SCI clearance with a polygraph
* Bachelor's degree Nice If You Have: * Experience with advanced data modeling, including entity resolution Clearance: Applicants selected will be subject to a security investigation and may need to meet eligibility requirements for access to classified information; TS/SCI clearance with polygraph is required. Compensation At Booz Allen, we celebrate your contributions, provide you with opportunities and choices, and support your total well-being. Our offerings include health, life, disability, financial, and retirement benefits, as well as paid leave, professional development, tuition assistance, work-life programs, and dependent care. Our recognition awards program acknowledges employees for exceptional performance and superior demonstration of our values. Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen's benefit programs. Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits. We encourage you to learn more about our total benefits by visiting the Resource page on our Careers site and reviewing Our Employee Benefits page. Salary at Booz Allen is determined by various factors, including but not limited to location, the individual's particular combination of education, knowledge, skills, competencies, and experience, as well as contract-specific affordability and organizational requirements. The projected compensation range for this position is $77,600.00 to $176,000.00 (annualized USD). The estimate displayed represents the typical salary range for this position and is just one component of Booz Allen's total compensation package for employees. This posting will close within 90 days from the Posting Date. Identity Statement As part of the application process, you are expected to be on camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud. Work Model Our people-first culture prioritizes the benefits of flexibility and collaboration, whether that happens in person or remotely. * If this position is listed as remote or hybrid, you'll periodically work from a Booz Allen or client site facility.
* If this position is listed as onsite, you'll work with colleagues and clients in person, as needed for the specific role. Commitment to Non-Discrimination All qualified applicants will receive consideration for employment without regard to disability, status as a protected veteran or any other status protected by applicable federal, state, local, or international law.

Position Summary...   What you'll do...    **Please note that Sponsorship Support is NOT Available for Sunnyvale location.**
Walmart Global Tech is looking to hire a  Staff Data Engineer  in Sunnyvale/Bentonville. As a seasoned data engineer, you have a proven track record of building and maintaining scalable, highly available, and resilient data pipelines using Java/Python, containerization (Docker), messaging technologies (Kafka/Cloud Pub/Sub), and cloud platforms (Google Cloud Platform). With expertise in Big Data technologies like Spark, Hadoop, and Data Flow Orchestration (Airflow), you excel at handling large data sets and adhere to software engineering best practices like version control (Git), CI/CD, and automated unit testing.

About Team: Applied AI Data Engineering
We are a distributed team of  10 data engineers  supporting about 250+ data scientists and machine learning engineers to deliver various data science projects with huge business impact in billions of dollars. We are growing and looking for talented data engineers to help support business and help us build unified, foundational data sets for AI/ML algorithms. Everyone has data, but the sheer volume of data at Walmart can be limitless. In the Data Engineering team, we help Walmart manage this data by building pipelines and data lakes to prepare big data for analysis and unlocking actionable insights in real-time. We also use cross-departmental data and machine learning to build a holistic view of true profitability, saving millions of dollars across item categories and geographies while assisting our leadership in making better decisions faster. Our team's vision is to build foundational data for AI/ML algorithms and empower all verticals thereby enabling E2E optimization.
What you'll do:
Analyze, translate business requirements into strategies, initiatives, and projects and aligns them to business strategy and objectives, and drives the execution of deliverables.
Defines and identifies the most suitable sources for required data that is fit for purpose, referring to external sources as required.
Builds the infrastructure required for optimal transformation and integration from a wide variety of data sources using appropriate data integration technologies.
Uses modern tools, techniques, and architectures to automate the most-common, repeatable and tedious data preparation and integration tasks partially or completely.
Provides guidance to business stakeholders, peers, and junior associates on the implementation of data governance practices.
Collaborates with team members in solving business problems effectively.

What you'll bring:
7+ years of experience in software development, focusing on building large scale distributed systems.
You have experience in  building batch and streaming data pipelines  that are scalable, available and resilient.
You have experience with Java and/or Python, container technology (Docker), messaging technologies such as Kafka, Cloud Pub/Sub, Cloud platforms such as Google Cloud Platform, Big Data technologies such as Spark, Hadoop, Data flow orchestration such as Airflow.
You have experience with  SQL (BigQuery) and NoSQL technologies such as Redis
You have experience working with large data sets
You have experience working with software engineering best practices such as version control (Git), CI/CD, passion for QA and are familiar with automated unit testing and DevOps
You have exposure to machine learning modeling life cycle
About Walmart   Global Tech:
Imagine working in an environment where one line of code can make life easier for hundreds of millions of people. Thats what we do at Walmart Global Tech. Were a team of software engineers, data scientists, cybersecurity expert's and service professionals within the worlds leading retailer who make an epic impact and are at the forefront of the next retail disruption. People are why we innovate, and people power our innovations. We are people-led and tech-empowered. We train our team in the skillsets of the future and bring in experts like you to help us grow. We have roles for those chasing their first opportunity as well as those looking for the opportunity that will define their career. Here, you can kickstart a great career in tech, gain new skills and experience for virtually every industry, or leverage your expertise to innovate at scale, impact millions and reimagine the future of retail.

Walmarts culture is a competitive advantage, and its fostered by being together. Working together in person allows us to collaborate, align quickly and innovate with greater speed. We use our campuses to create purposeful connection rooted in deepening understanding and investing in the development of our associates.

Our hubs: Walmart is a global company with offices across the United States and around the world. Our global headquarters is in Bentonville, Arkansas, with primary hubs in the San Francisco Bay area and New York/New Jersey.

Benefits:
Benefits: Beyond our great compensation package, you can receive incentive awards for your performance. Other great perks include 401(k) match, stock purchase plan, paid maternity and parental leave, PTO, multiple health plans, and much more.

Equal Opportunity Employer:
Walmart, Inc. is an Equal Opportunity Employer By Choice. We believe we are best equipped to help our associates, customers and the communities we serve live better when we really know them. That means understanding, respecting and valuing diversity- unique styles, experiences, identities, ideas and opinions while being inclusive of all people.

The above information has been designed to indicate the general nature and level of work performed in the role. It is not designed to contain or be interpreted as a comprehensive inventory of all responsibilities and qualifications required of employees assigned to this job. The full Job Description can be made available as part of the hiring process.
At Walmart, we offer competitive pay as well as performance-based bonus awards and other great benefits for a happier mind, body, and wallet. Health benefits include medical, vision and dental coverage. Financial benefits include 401(k), stock purchase and company-paid life insurance. Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting. Other benefits include short-term and long-term disability, company discounts, Military Leave Pay, adoption and surrogacy expense reimbursement, and more.  ?
?
?
You will also receive PTO and/or PPTO that can be used for vacation, sick leave, holidays, or other purposes. The amount you receive depends on your job classification and length of employment. It will meet or exceed the requirements of paid sick leave laws, where applicable.  ?
For information about PTO, see https://one.walmart.com/notices.
?
?
Live Better U is a Walmart-paid education benefit program for full-time and part-time associates in Walmart and Sam's Club facilities. Programs range from high school completion to bachelor's degrees, including English Language Learning and short-form certificates. Tuition, books, and fees are completely paid for by Walmart.  ?
Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to a specific plan or program terms.  ?
For information about benefits and eligibility, see One.Walmart.
?
The annual salary range for this position is $110,000.00-$220,000.00  ?
Additional compensation includes annual or quarterly performance bonuses.  ?
Additional compensation for certain positions may also include:  ?
?
- Stock  ?
?
Minimum Qualifications...      Outlined below are the required minimum qualifications for this position. If none are listed, there are no minimum qualifications.
Option 1: Bachelors degree in Computer Science and 4 years' experience in software engineering or related field. Option 2: 6 years experience in software engineering or related field. Option 3: Master's degree in Computer Science and 2 years' experience in software engineering or related field.
3 years' experience in data engineering, database engineering, business intelligence, or business analytics.   Preferred Qualifications...      Outlined below are the optional preferred qualifications for this position. If none are listed, there are no preferred qualifications.
Data engineering, database engineering, business intelligence, or business analytics, ETL tools and working with large data sets in the cloud, Masters degree in Computer Science or related field and 4 years' experience in software engineering or related field, We value candidates with a background in creating inclusive digital experiences, demonstrating knowledge in implementing Web Content Accessibility Guidelines (WCAG) 2.2 AA standards, assistive technologies, and integrating digital accessibility seamlessly. The ideal candidate would have knowledge of accessibility best practices and join us as we continue to create accessible products and services following Walmarts accessibility standards and guidelines for supporting an inclusive culture.   Primary Location...   805 Se Moberly Ln, Bentonville, AR 72712, United States of America

Overview In today's rapidly evolving technology landscape, an organization's data has never been a more important aspect in achieving mission and business goals. Our data exploitation experts work with our clients to support their mission and business goals by creating and executing a comprehensive data strategy using the best technology and techniques, given the challenge. At Steampunk , our goal is to build and execute a data strategy for our clients to coordinate data collection and generation, to align the organization and its data assets in support of the mission, and ultimately to realize mission goals with the strongest effectiveness possible. For our clients, data is a strategic asset. They are looking to become a facts-based, data-driven, customer-focused organization. To help realize this goal, they are leveraging visual analytics platforms to analyze, visualize, and share information. At Steampunk you will design and develop solutions to high-impact, complex data problems, working with the best and data practitioners around. Our data exploitation approach is tightly integrated with Human-Centered Design and DevSecOps. Contributions We are looking for seasoned Data Engineer Lead to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines. We are looking for more than just a "Data Engineer". We are looking for a technologist with excellent communication and customer service skills and a passion for data and problem solving. * Lead and architect migration of data environments with performance and reliability. * Assess and understand the ETL jobs, workflows, BI tools, and reports. * Address technical inquiries concerning customization, integration, enterprise architecture and general feature / functionality of data products. * Experience in crafting database / data warehouse solutions in cloud (Preferably GCP. Alternatively Azure, AWS). * Key must have skill sets - Python. * Support an Agile software development lifecycle. * Act as an individual contributor and mentor more junior team members. * You will contribute to the growth of our Data Exploitation Practice! Qualifications * Ability to hold a position of public trust with the US government. * 8-10 years industry experience coding commercial software and a passion for solving complex problems. * 8-10 years direct experience in Data Engineering with experience in tools such as: * Big data tools: Hadoop, Spark, Kafka, etc. * Relational SQL and NoSQL databases, including Postgres, CloudSQL, MongoDB * Data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc. * AWS cloud services: EC2, EMR, RDS, Redshift (or Azure and GCP equivalents) * Data streaming systems: Storm, Spark-Streaming, etc. * Search tools: Solr, Lucene, Elasticsearch * Object-oriented/object function scripting languages: Python, Java, C++, Scala, etc. * Advanced working SQL knowledge and experience working with relational databases, query authoring and optimization (SQL) as well as working familiarity with a variety of databases. * Experience with message queuing, stream processing, and highly scalable 'big data' data stores. * Experience manipulating, processing, and extracting value from large, disconnected datasets. * Experience manipulating structured and unstructured data for analysis. * Experience constructing complex queries to analyze results using databases or in a data processing development environment. * Experience with data modeling tools and process. * Experience architecting data systems (transactional and warehouses). * Experience aggregating results and/or compiling information for reporting from multiple datasets. * Experience working in an Agile environment. * Experience supporting project teams of developers and data scientists who build web-based interfaces, dashboards, reports, and analytics/machine learning models. * Experience with BigQuery and Looker. Preferred: * Certifications: * Google Professional Data Engineer * Google Associate Cloud Engineer * AWS Certified Data Analytics * AWS Certified Solutions Architect * Azure Data Engineer Associate About steampunk Steampunk relies on several factors to determine salary, including but not limited to geographic location, contractual requirements, education, knowledge, skills, competencies, and experience. The projected compensation range for this position is $150,000 to $185,000. The estimate displayed represents a typical annual salary range for this position. Annual salary is just one aspect of Steampunk's total compensation package for employees. Learn more about additional Steampunk benefits here. Identity Statement As part of the application process, you are expected to be on camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud. Steampunk is a Change Agent in the Federal contracting industry, bringing new thinking to clients in the Homeland, Federal Civilian, Health and DoD sectors. Through our Human-Centered delivery methodology, we are fundamentally changing the expectations our Federal clients have for true shared accountability in solving their toughest mission challenges. As an employee owned company, we focus on investing in our employees to enable them to do the greatest work of their careers - and rewarding them for outstanding contributions to our growth. If you want to learn more about our story, visit http://www.steampunk.com . We are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, or any other characteristic protected by law. Steampunk participates in the E-Verify program.

Senior Data Engineer (Python, AWS, Snowflake)

Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you'll have the opportunity to be on the forefront of driving a major transformation within Capital One.

What You'll Do:

Be a part of team designing and building Enterprise Level scalable, low-latency, fault-tolerant streaming data platform that provides meaningful and timely insights
Build the next generation Distributed Streaming Data Pipelines and Analytics Data Stores using streaming frameworks (Flink, Spark Streaming) using programming languages like Java, Scala, Python
Be part of a group of engineers building data pipelines using big data technologies (Spark, Flink, Kafka, Snowflake, AWS Big Data Services, Snowflake, Redshift) on medium to large scale datasets
Work in a creative & collaborative environment driven by agile methodologies with focus on CI/CD, Application Resiliency Standards, and partnership with Cyber & Security teams
Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance
Basic Qualifications:       Bachelor's Degree
At least 3 years of experience in application development (Internship experience does not apply)
At least 1 year of experience in big data technologies
Preferred Qualifications:       5+ years of experience in application development including Python, SQL, Scala, or Java
2+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
3+ years experience with Distributed data computing tools (Kafka, Spark, Flink)
2+ year experience working on real-time data and streaming applications
2+ years of experience with NoSQL implementation (DynamoDB, OpenSearch)
2+ years of data warehousing experience (Redshift or Snowflake)
3+ years of experience with UNIX/Linux including basic commands and shell scripting
2+ years of experience with Agile engineering practices

At this time, Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, or another type of work authorization).

The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.

Plano, TX: $144,200 - $164,600 for Senior Data Engineer

Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate's offer letter.

This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.

Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the . Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.

This role is expected to accept applications for a minimum of 5 business days.

No agencies please. Capital One is an equal opportunity employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to sex (including pregnancy, childbirth or related medical conditions), race, color, age, national origin, religion, disability, genetic information, marital status, sexual orientation, gender identity, gender reassignment, citizenship, immigration status, protected veteran status, or any other basis prohibited under applicable federal, state or local law. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City's Fair Chance Act; Philadelphia's Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.

If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1- or via email at . All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.

For technical support or questions about Capital One's recruiting process, please send an email to

Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.

Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).

About the job Databricks Data Engineer OUR CLIENT Our client provides data-driven, action-oriented solutions to business problems through statistical data mining, cutting-edge analytics techniques, and a consultative approach. Leveraging proprietary methodology and best-of-breed technology, our client's analytics team takes an industry-specific approach to transform decision-making and embed analytics more deeply into their business processes. They have a global footprint of 2,000+ data scientists and analysts who assist client organizations with complex risk minimization methods, advanced marketing, pricing and CRM strategies, internal cost analysis, and cost and resource optimization within the organization. They serve the insurance, healthcare, banking, capital markets, utilities, retail and e-commerce, travel, transportation and logistics industries. ROLE We are seeking a Databricks Data Engineer. RESPONSIBILITIES: <ul><li>Lead and/or assist in designing and developing data systems, tailoring solutions to meet client-specific requirements</li><li>Design and implement databricks-based solutions with a focus on distributed data processing, data partitioning and optimization for parallelism</li><li>Engage with client to evaluate their current and future needs, crafting bespoke solution architectures and providing strategic recommendations</li><li>Develop comprehensive architecture solution roadmaps integrating client business processes and technologies</li><li>Define and enforce coding standards for ETL processes, ensuring maintainability, reusability, and adherence to best practices</li><li>Architect and implement CI/CD pipelines for Databricks notebooks and jobs, ensuring testing, versioning, and deployment</li><li>Disaster recovery strategies for Databricks environments, ensuring data resilience and minimal downtime in case of failure</li><li>Innovate and expand solution offerings to address data challenges</li><li>Advise stakeholders on data cloud platform architecture optimization, focusing on performance </li><li>Experienced with Scrum and Agile Methodologies to coordinate global delivery teams, run scrum ceremonies, manage backlog items, and handle escalations</li><li>Integrate data across different systems and platforms</li><li>Strong verbal and written communication skills to manage client discussions</li></ul> CANDIDATE PROFILE <ul><li>5+ years experience in architecture, design, and implementation using Databricks</li><li>Experience in designing and implementing scalable, fault-tolerant systems</li><li>Deep understanding of one or more of the big data computing technologies such as Databricks, snowflake</li><li>Demonstrated experience with the deployment of Databricks on cloud platforms, including advanced configurations</li><li>In-depth knowledge of spark internals, catalyst optimization, and Databricks runtime environment </li><li>Must have experience in implementing solutions using Databricks</li><li>Experience in Insurance (P&C) is good to have </li><li>Programming Languages SQL, Python</li><li>Technologies Databricks, Delta Lake storage, Spark (PySpark, Spark SQL).<ul><li>Good to have - Airflow, Splunk, Kubernetes, Power BI, Git, Azure DevOps</li></ul></li><li>Project Management using Agile, Scrum</li><li>B.S. Degree in a data-centric field (Mathematics, Economics, Computer Science, Engineering, or other science field), Information Systems, Information Processing, or engineering.</li><li>Excellent communication & leadership skills, with the ability to lead and motivate team members</li><li>Ability to work independently with some level of ambiguity and juggle multiple demands</li></ul>

Prescient Edge is seeking an Expert Data Engineer (EOB) to support a federal government client. Benefits: At Prescient Edge, we believe that acting with integrity and serving our employees is the key to everyone's success. To that end, we provide employees with a best-in-class benefits package that includes: * A competitive salary with performance bonus opportunities. * Comprehensive healthcare benefits, including medical, vision, dental, and orthodontia coverage. * A substantial retirement plan with no vesting schedule. * Career development opportunities, including on-the-job training, tuition reimbursement, and networking. * A positive work environment where employees are respected, supported, and engaged. Security Clearance: * Security clearance required TS/SCI with a CI POLY or the ability to obtain a CI POLY. Job Requirements Qualifications: * Designs, implements, and operates data management systems for intelligence needs. * Designs how data will be stored, accessed, used, integrated, and managed by different data regimes and digital systems. * Works with data users to determine, create, and populate optimal data architectures, structures, and systems. * Plans, Designs, and optimizes data throughout and query performance. * Participates in the selection of backend database technologies (e.g. SQL, NoSQL, HPC, etc.), their configuration and utilization, and the optimization of the full data pipeline infrastructure to support the actual content, volume, ETL, and periodicity of data to support the intended kinds of queries and analysis to match expected responsiveness. * Demonstrates ability to define problems, supervise studies and lead surveys to collect and analyze data to provide advice and recommend solutions. * Demonstrates analytic leadership and expertise in identifying, planning, developing, and executing analytic production methodologies, tradecraft and techniques aligned with labor category mission. * Demonstrates extensive ability to provide strategic advice, technical guidance and expertise to Defense planners and policymaker (e.g., Undersecretary level or higher). Desired Experience: * Minimum 20 years of experience conducting analysis relevant to the specific labor category with at least a portion of the experience within the last 2 years. Desired Education: * Master's degree in an area related to the labor category from a college or university accredited by an agency recognized by the U.S. Department of Education. Location: * Quantico, VA. Prescient Edge is a Veteran-Owned Small Business (VOSB) founded as a counterintelligence (CI) and Human Intelligence (HUMINT) company in 2008. We are a global operations and solutions integrator delivering full-spectrum intelligence analysis support, training, security, and RD&E support solutions to the Department of Defense and throughout the intelligence community. Prescient Edge is an Equal Opportunity Employer (EEO). All applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other characteristic that is protected by law. We strive to foster equity and inclusion throughout our organization because we believe that diversity of thought is critical for creating a safe and engaging work environment while also enabling the organization's success.

GAQ226R150
Location: San Francisco, CA or Mountain View, CA

At Databricks Information Technology, we are a product led organization transforming the way data is sourced, designed and used to help us scale seamlessly in face of incredible growth.

You will influence technological decision-making for business teams' data and AI strategy and roadmap. You will guide the business in identifying data needs and delivering data products for acquiring, processing and reporting such information to meet company objectives. You will be considered the go-to-expert for stakeholders on data warehousing and data intelligence. You will gather and maintain best practices that can be adopted across the broader data analytics community. You will be a part of the growing IT Data Team.

The impact you will have:
Design/Strategy:  The Staff Data Engineer is the technical owner of the data strategy and design that supports the business's lakehouse and schemas. In this capacity, the Staff Data Engineer will typically lead a team of data engineers to design and develop data products (data pipelines, BI and AI models) to serve a variety of business use-cases.
Collaboration:  The role of a Staff Data Engineer is highly collaborative - working closely with analysts, data scientists, and other data consumers within the business. The Staff Data Engineer also works closely with other disciplines/departments and teams across the company in coming up with simple, functional, and elegant solutions that balance data needs across the business
Analytics:  The Staff Data Engineer plays an analytical role in quickly and thoroughly analyzing business requirements for reporting and analysis and translating into good technical data designs. In this capacity, the Staff Data Engineer needs to have a strong sense of metrics and analytics to establish patterns and insights to help develop a well researched design.
What we look for:     8+ years of related experience with a Bachelor's degree; or 6+ years with a Master's degree; or 4+ years with PhD; or equivalent work experience.
Education degree in Computer Science, Statistics, Information Systems or another quantitative field.
Experience building and optimizing 'big data' data pipelines, architectures and data sets. In depth knowledge of data modeling and design of schemas for read and write performance. Apache Spark™ experience is a big plus
Advanced working knowledge and experience working with relational databases, query authoring as well as working familiarity with a variety of databases
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
Build processes supporting data transformation, data structures, metadata, dependency and workload management.
Knowledge of message queuing, stream processing, API based extraction and highly scalable 'big data' data stores.
Experience supporting and working with cross-functional teams in a dynamic environment.
Hands-on experience with Python and SQL is a must
Experience with building data pipelines from business applications like Salesforce, Marketo, NetSuite, Workday etc.
Prior hands-on technical leadership experience is a big plus.
Experience with Databricks Platform is a big plus
Experience with AI/ML/Data Science is a big plus
Knowledge of BI Tools like Tableau, Looker etc

Pay Range Transparency

Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents base salary range for non-commissionable roles or on-target earnings for commissionable roles. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks utilizes the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your location is in visit our page here.

Zone 1 Pay Range

$173,100-$265,500 USD

About Databricks

Databricks is the data and AI company. More than 10,000 organizations worldwide - including Comcast, Cond Nast, Grammarly, and over 50% of the Fortune 500 - rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook.

Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region, please visit https://www.mybenefitsnow.com/databricks.

Our Commitment to Diversity and Inclusion

At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.

Compliance

If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.

Your career starts now. We're looking for the next generation of health care leaders.
At AmeriHealth Caritas, we're passionate about helping people get care, stay well and build healthy communities. As one of the nation's leaders in health care solutions, we offer our associates the opportunity to impact the lives of millions of people through our national footprint of products, services and award-winning programs. AmeriHealth Caritas is seeking talented, passionate individuals to join our team. Together we can build healthier communities. If you want to make a difference, we'd like to hear from you.
Headquartered in Newtown Square, PA, AmeriHealth Caritas is a mission-driven organization with more than 30 years of experience. We deliver comprehensive, outcomes-driven care to those who need it most. We offer integrated managed care products, pharmaceutical benefit management and specialty pharmacy services, behavioral health services, and other administrative services.
Under the leadership of the Manager of Data Engineering & Automation, the Data Engineer Senior is responsible for automation of report production in Business Intelligence (BI) systems that integrate with databases, data warehouses/marts and data lakes. You will deliver data warehouse and business intelligence solutions by building data models, writing ETL processes, and administering systems to facilitate business intelligence tools. You will work closely with end users and IT development staff to ensure that new and existing data models and databases are consistent with approved data architecture standards. If you are a confident, skilled, and energetic professional and can complement a blended team, we want to meet you.
Responsibilities:
Develop, maintain and execute automation of plan and enterprise level reports.
Develop and maintain analytics data pipelines using SQL and/or Python in both on-prem and cloud (Azure Databricks) environments.
Develop high quality automation engineering best practices, test strategy and principles.
Design test plans, scenarios, scripts, and/or procedures to determine product quality or release readiness.
Partner with product owners to deliver high performing quality customer experiences that are engaging, purposeful and powerful in their simplicity.
Participate in automation script code reviews and provide guidance on their compliance with automation best practices.
Demonstrate skills using code repositories (git).
Identify interdependencies, ambiguities or omissions and make suggestions to improve requirements and ensure usability/testability.
Learn rapidly and enthusiastically, focusing on understanding the application/product/area in detail.
Ability to train and guide other Data Engineers and help develop best coding standards.
Qualifications / Education:
At least five to seven (5 – 7) years of experience in an automation of reporting environment.
At least five to seven (5 – 7) years of experience with report automation engineering, batch and real time processing, and agile methods.
Previous experience in the healthcare industry highly preferred.
Experience working in SQL and Python.
Ability to work with multiple database platforms, such as SQL Server and Oracle.
Understand data lake concepts and familiarity with Azure Databricks.
Experience working with source control and familiarity with Azure DevOps.
Familiarity with CI / CD concepts.
Bachelor’s Degree in Computer Science or related field.

#J-18808-Ljbffr

Kriddha technologies Data Engineer Interview Guide

Overview

Kriddha technologies Data Engineer Interview Process

Kriddha technologies Data Engineer Interview Questions

Kriddha technologies Data Engineer Jobs