One of our clients in Southern California (Irvine/Los Angeles) is looking for a Python Data Engineer with the following skills and experience:Job Description:Looking for a skilled Python Data Engineer to join our team. As a Data Engineer, you will primarily focus on building APIs, securing them efficiently, and constructing ETL pipelines. This role involves extracting data from various systems, including external vendor APIs, performing business logic, and transferring data to our data lake in AWS. You will play a crucial role in making data more accessible for our portfolio managers.Responsibilities:Develop APIs from scratch using Python, ensuring efficient and secure data access.Design and implement ETL pipelines to extract, transform, and load data into our data lake.Ensure the security of APIs, implementing measures to restrict access and protect sensitive data.Utilize airflow for orchestrating and automating ETL workflows.Develop REST APIs using Python for seamless integration with other systems.Utilize DASH or Streamlit for data visualization and dashboard creation.Work within an AWS environment, utilizing services such as S3, Athena, Lambda, EMR, Glue, and EKS.Implement Kubernetes for container orchestration and management.Utilize PostgreSQL for data storage and querying.Implement Terraform for infrastructure as code (IaC) to provision and manage AWS resources.Be adaptable to changes and open to learning new frameworks, languages, and projects.Requirements:5+ years of experience as a Python Engineer or Python Data Engineer, proficient in Python for various data engineering tasks.Strong experience in developing APIs from scratch, utilizing the appropriate language and framework.Experience with airflow for orchestrating ETL workflows.Experience in REST API development with Python.Familiarity with DASH or Streamlit for data visualization.Experience working in an AWS environment, including S3, Athena, Lambda, EMR, Glue, and EKS.Proficiency in Kubernetes for container orchestration.Experience with PostgreSQL for data storage and querying.Familiarity with Terraform for infrastructure as code (IaC).Understanding of security components for securing APIs and data access.Ability to adapt to changes and switch between frameworks, languages, and projects.Big Plusses:Background in financial services (Finserv BG preferred).Experience with Graph QL.Experience developing ETL pipelines, preferably with Spark.Interested candidates may submit their resumes online or call at 310-906-4780 for further information regarding the position.Beacon Hill is an Equal Opportunity Employer that values the strength diversity brings to the workplace. Individuals with Disabilities and Protected Veterans are encouraged to apply.If you would like to complete our voluntary self-identification form, please click here or copy and paste the following link into an open window in your browser: https://jobs.beaconhillstaffing.com/eeoc/Completion of this form is voluntary and will not affect your opportunity for employment, or the terms or conditions of your employment. This form will be used for reporting purposes only and will be kept separate from all other records.Company Profile:Beacon Hill Technologies, a premier National Information Technology Staffing Group, provides world class technology talent across all industries utilizing a complete suite of staffing services. Beacon Hill Technologies' dedicated team of recruiting and staffing experts consistently delivers quality IT professionals to solve our customers' technical and business needs.Beacon Hill Technologies covers a broad spectrum of IT positions, including Project Management and Business Analysis, Programming/Development, Database, Infrastructure, Quality Assurance, Production/Support and ERP roles.Learn more about Beacon Hill Staffing Group and our specialty divisions, Beacon Hill Associates, Beacon Hill Financial, Beacon Hill HR, Beacon Hill Legal, Beacon Hill Life Sciences and Beacon Hill Technologies by visiting www.beaconhillstaffing.com.We look forward to working with you.Beacon Hill. Employing the Future#J-18808-Ljbffrby Jobble

Required Skills:4+ experience Data EngineerMust have strong foundational development skills in SQL and cloud based data environments such as Azure, Azure Data Factory and Power BISolid knowledge of best practices surrounding data architecture, data quality, data governance, datawarehouse, ETL, BIExperience and passion for automating manual data processesAble to work independently, bring thought leadershipMake technical decisions without step-by-step directionsAble to effectively wear multiple hats whether it be gathering requirements with non-technical users, designing an application, actual hands on, development, testing and deploymentExcellent verbal and written communication skillsTeam PlayerStrong attention to detailFree thinkerDesired Skills:Experience leading data projectsExperience actually designing a data architecture or the design of a complex data project, a plus, not requiredDescription of Role/Responsibilities:Are you looking for a company that lives out their core values of responsibility and accountability that is rapidly growing, where you can be part of building key elements to their IT organization from the ground up than this role is for you. We are seeking a Data Engineer who would like to be part of building an enterprise data environment including having a say in data governance, data architecture, data quality, data engineering, ETL, datawarehouse and business intelligence. In this role you will spend your time doing actual hands on development and be part of the thought leadership behind all data decisions. You will be focused on taking manual data processes and automating them in order of priority. If you want to work for high quality leaders, be able to work on a modern technical stack, be able to make an immediate impact, interact with senior leadership of the company to help them grow this company into an enterprise organization apply today.Beacon Hill is an Equal Opportunity Employer that values the strength diversity brings to the workplace. Individuals with Disabilities and Protected Veterans are encouraged to apply.If you would like to complete our voluntary self-identification form, please click here or copy and paste the following link into an open window in your browser: https://jobs.beaconhillstaffing.com/eeoc/Completion of this form is voluntary and will not affect your opportunity for employment, or the terms or conditions of your employment. This form will be used for reporting purposes only and will be kept separate from all other records.Company Profile:Beacon Hill Technologies, a premier National Information Technology Staffing Group, provides world class technology talent across all industries utilizing a complete suite of staffing services. Beacon Hill Technologies' dedicated team of recruiting and staffing experts consistently delivers quality IT professionals to solve our customers' technical and business needs.Beacon Hill Technologies covers a broad spectrum of IT positions, including Project Management and Business Analysis, Programming/Development, Database, Infrastructure, Quality Assurance, Production/Support and ERP roles.Learn more about Beacon Hill Staffing Group and our specialty divisions, Beacon Hill Associates, Beacon Hill Financial, Beacon Hill HR, Beacon Hill Legal, Beacon Hill Life Sciences and Beacon Hill Technologies by visiting www.beaconhillstaffing.com.We look forward to working with you.Beacon Hill. Employing the Future (TM)#J-18808-Ljbffrby Jobble

NOTE: This is a onsite role in Irvine, California. One of our clients in Irvine, California is looking for a GenAI Data Engineer with the following skills and experience: Job Description:As a GenAI Data Engineer, you will play a crucial role in building new data products, aggregating data, and extracting insights to drive decision-making processes. Your primary responsibility will be to pull data on a daily basis, analyze trends, and contribute to the optimization of our data infrastructure using cutting-edge GenAI technologies.Responsibilities:<ul><li>Build new data products leveraging GenAI technologies to support business needs and objectives.</li><li>Aggregate data from various sources to create comprehensive datasets.</li><li>Pull data on a daily basis and perform trend analysis using GenAI tools to identify patterns and insights.</li><li>Work with Lakehouse Databricks platform integrated with GenAI to run reports and optimize data processing.</li><li>Utilize Spark, Python, SQL, and Databricks in conjunction with GenAI to test and validate data pipelines.</li><li>Optimize metadata in data lakes using GenAI methodologies to ensure efficiency and reliability.</li><li>Collaborate with cross-functional teams to understand requirements and deliver scalable data solutions powered by GenAI.</li><li>Develop and maintain documentation for data processes, workflows, and data models incorporating GenAI best practices.</li><li>Stay updated on emerging GenAI technologies and trends in data engineering and implement GenAI-driven best practices.</li></ul>Requirements:<ul><li>Bachelor's degree in Computer Science, Engineering, or related field.</li><li>Proven experience as a Data Engineer or similar role.</li><li>Strong proficiency in Python, SQL, and Spark.</li><li>Experience with Databricks platform and Lakehouse architecture, preferably integrated with GenAI.</li><li>Knowledge of data lakes, data warehousing, and ETL processes, with a GenAI-centric approach.</li><li>Ability to analyze data, identify trends, and extract insights using GenAI tools and methodologies.</li><li>Excellent problem-solving skills and attention to detail, with a GenAI-focused mindset.</li><li>Strong communication and collaboration skills.</li><li>Ability to work independently and in a team environment, leveraging GenAI capabilities.</li><li>Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform is a plus, with an emphasis on GenAI integration.</li></ul>Interested candidates may submit their resume online or call at 310-906-4780 for further information regarding the position. Beacon Hill is an Equal Opportunity Employer that values the strength diversity brings to the workplace. Individuals with Disabilities and Protected Veterans are encouraged to apply.If you would like to complete our voluntary self-identification form, please click here or copy and paste the following link into an open window in your browser: https://jobs.beaconhillstaffing.com/eeoc/Completion of this form is voluntary and will not affect your opportunity for employment, or the terms or conditions of your employment. This form will be used for reporting purposes only and will be kept separate from all other records. Company Profile: Beacon Hill Technologies, a premier National Information Technology Staffing Group, provides world class technology talent across all industries utilizing a complete suite of staffing services. Beacon Hill Technologies' dedicated team of recruiting and staffing experts consistently delivers quality IT professionals to solve our customers' technical and business needs. Beacon Hill Technologies covers a broad spectrum of IT positions, including Project Management and Business Analysis, Programming/Development, Database, Infrastructure, Quality Assurance, Production/Support and ERP roles. Learn more about Beacon Hill Staffing Group and our specialty divisions, Beacon Hill Associates, Beacon Hill Financial, Beacon Hill HR, Beacon Hill Legal, Beacon Hill Life Sciences and Beacon Hill Technologies by visiting www.beaconhillstaffing.com. We look forward to working with you. Beacon Hill. Employing the Futureby Jobble

NOTE: This is a onsite role in Irvine, California. One of our clients in Irvine, California is looking for a GenAI Data Engineer with the following skills and experience: Job Description:As a GenAI Data Engineer, you will play a crucial role in building new data products, aggregating data, and extracting insights to drive decision-making processes. Your primary responsibility will be to pull data on a daily basis, analyze trends, and contribute to the optimization of our data infrastructure using cutting-edge GenAI technologies.Responsibilities:<ul><li>Build new data products leveraging GenAI technologies to support business needs and objectives.</li><li>Aggregate data from various sources to create comprehensive datasets.</li><li>Pull data on a daily basis and perform trend analysis using GenAI tools to identify patterns and insights.</li><li>Work with Lakehouse Databricks platform integrated with GenAI to run reports and optimize data processing.</li><li>Utilize Spark, Python, SQL, and Databricks in conjunction with GenAI to test and validate data pipelines.</li><li>Optimize metadata in data lakes using GenAI methodologies to ensure efficiency and reliability.</li><li>Collaborate with cross-functional teams to understand requirements and deliver scalable data solutions powered by GenAI.</li><li>Develop and maintain documentation for data processes, workflows, and data models incorporating GenAI best practices.</li><li>Stay updated on emerging GenAI technologies and trends in data engineering and implement GenAI-driven best practices.</li></ul>Requirements:<ul><li>Bachelor's degree in Computer Science, Engineering, or related field.</li><li>Proven experience as a Data Engineer or similar role.</li><li>Strong proficiency in Python, SQL, and Spark.</li><li>Experience with Databricks platform and Lakehouse architecture, preferably integrated with GenAI.</li><li>Knowledge of data lakes, data warehousing, and ETL processes, with a GenAI-centric approach.</li><li>Ability to analyze data, identify trends, and extract insights using GenAI tools and methodologies.</li><li>Excellent problem-solving skills and attention to detail, with a GenAI-focused mindset.</li><li>Strong communication and collaboration skills.</li><li>Ability to work independently and in a team environment, leveraging GenAI capabilities.</li><li>Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform is a plus, with an emphasis on GenAI integration.</li></ul>Interested candidates may submit their resume online or call at 310-906-4780 for further information regarding the position. Beacon Hill is an Equal Opportunity Employer that values the strength diversity brings to the workplace. Individuals with Disabilities and Protected Veterans are encouraged to apply. If you would like to complete our voluntary self-identification form, please click here or copy and paste the following link into an open window in your browser: https://jobs.beaconhillstaffing.com/eeoc/ Completion of this form is voluntary and will not affect your opportunity for employment, or the terms or conditions of your employment. This form will be used for reporting purposes only and will be kept separate from all other records. Company Profile: Beacon Hill Technologies, a premier National Information Technology Staffing Group, provides world class technology talent across all industries utilizing a complete suite of staffing services. Beacon Hill Technologies' dedicated team of recruiting and staffing experts consistently delivers quality IT professionals to solve our customers' technical and business needs. Beacon Hill Technologies covers a broad spectrum of IT positions, including Project Management and Business Analysis, Programming/Development, Database, Infrastructure, Quality Assurance, Production/Support and ERP roles. Learn more about Beacon Hill Staffing Group and our specialty divisions, Beacon Hill Associates, Beacon Hill Financial, Beacon Hill HR, Beacon Hill Legal, Beacon Hill Life Sciences and Beacon Hill Technologies by visiting www.beaconhillstaffing.com. We look forward to working with you. Beacon Hill. Employing the Future™

Data Engineer Beacon Hill Staffing Group Jobs

Python Data Engineer Hybrid In La Or Irvine
April 28, 2024

Data Engineer
April 22, 2024

Data Engineer
April 20, 2024

Data Engineer
April 16, 2024

Azure Data Engineer Hybrid In Palo Altoca
April 14, 2024

Genai Data Engineer Onsite In Irvineca
April 11, 2024

Genai Data Engineer Onsite In Irvineca
April 7, 2024

Quick filters

Top companies

Data Engineer Beacon Hill Staffing Group Jobs

Python Data Engineer Hybrid In La Or IrvineApril 28, 2024

Data EngineerApril 22, 2024

Data EngineerApril 20, 2024

Data EngineerApril 16, 2024

Azure Data Engineer Hybrid In Palo AltocaApril 14, 2024

Genai Data Engineer Onsite In IrvinecaApril 11, 2024

Genai Data Engineer Onsite In IrvinecaApril 7, 2024