Are you a Data Engineer with experience using Microsoft data services including some of the most recent Azure services? This BI Developer role is with a well-established retail and distribution company based in Burnaby, with locations across BC. This role is well suited to an experienced data engineer who has been developing business business intelligence solutions for several years. There will be a particular focus on ETL processes, and integrating several data feeds from various information systems within the business (ERP, POS, etc). Experience with retail and distribution industries would be considered an asset. This is a full-time position, and includes a competitive base salary, paid vacation and extended health and dental benefits. In this role, you’ll work primarily on-site in the Burnaby, BC office. One of the attractive parts of this job is to get involved in all aspects of developing the BI solutions. On some days you’ll be gathering requirements from various stakeholders, and on other days you’ll be implementing your solutions in code. How to Apply A bit about myself - my name is Nathan Wawruck, and I am a recruitment consultant based in Vancouver, BC. I have over a decade of matching software professionals to job opportunities, and I am always looking to connect with like-minded people in the Vancouver area. If you're interested in pursuing this role, please apply to this posting online, and contact me for an initial discussion. This is a chance for us to discuss specifics, such as the company name, the key hiring managers, and the more in-depth job requirements. This is also a great opportunity to talk about your overall career goals and preferences. We can even discuss other potential roles which may fit what you're looking for. Please find me on LinkedIn by searching my name: Nathan Wawruck Requirements Here are some of the items that you'll bring to the table for this role: <ul><li>You are an experienced database developer with five or more years of experience with SQL server and T-SQL programming</li><li>You are comfortable with ETL and data integration processes</li><li>You have hands-on experience with PowerBI</li><li>You are comfortable speaking with various stakeholders to gather and clarify their requirements</li><li>You have the ability to document your solutions and create technical documentation</li><li>You reside in the Vancouver Lower Mainland, and you’re able to work on-site in Burnaby between Monday and Friday</li></ul>

We are seeking a highly motivated and experienced Data Ingestion Engineer to join our growing team. In this role, you will be responsible for designing, developing, and implementing data pipelines to ingest data from various sources, including structured (e.g., databases) and unstructured data (e.g., logs, social media). You will play a key role in ensuring the quality, consistency, and timeliness of data for downstream analytics and reporting. Responsibilities:<ul><li>Design and develop dbt models:</li><li>Create reusable dbt models to transform raw data into a consistent and well-defined format for Snowflake.</li><li>Utilize advanced dbt features like sources, transformations, tests, and documentation to ensure data quality and maintainability.</li><li>Implement CI/CD pipelines in Azure:</li><li>Configure Azure DevOps pipelines to automate the building, testing, and deployment of dbt models and data pipelines.</li><li>Integrate data pipeline execution with code version control for traceability and rollback capabilities.</li><li>Implement automated data quality checks and alerts within the CI/CD pipeline.</li><li>Design, develop, and maintain data pipelines using dbt and Azure Data Factory (ADF):</li><li>Extract, transform, and load (ETL) data from various sources including databases, APIs, cloud storage (Azure Blob Storage), and potentially mobile applications (Apple/Android).</li><li>Cleanse and validate data to ensure accuracy and consistency</li><li>Develop and implement data models for Snowflake</li><li>Leverage DevOps principles to automate data pipeline deployments and monitoring beyond CI/CD (e.g., infrastructure provisioning, configuration management)</li><li>Collaborate with business teams to understand data requirements</li><li>Work effectively in a team environment and mentor junior team members (including potential offshore team members)</li><li>Stay up-to-date with the latest data ingestion technologies and best practices</li></ul> Required Skills:<ul><li>Minimum 2 years of experience with dbt</li><li>Minimum 2 years of experience with Snowflake</li><li>Minimum 2 years of experience with the Azure platform, including Azure Data Factory (ADF), Azure Blob Storage, and Azure DevOps tools</li><li>Experience working with structured and unstructured data formats</li><li>Strong SQL and scripting skills (e.g., Python, Bash)</li><li>Excellent problem-solving and analytical skills</li><li>Strong communication and collaboration skills</li><li>Ability to work independently and as part of a team</li><li>Experience working with business teams to understand data requirements (a plus)</li><li>Experience with data integration from mobile applications (Apple/Android) (a plus)</li></ul>

Senior Data Engineer If you’re looking for the DNA of a start-up with the financial stability of a larger corporation, then you’ll love this! Why Join us?Our success is driven by the collective talent, expertise and enthusiasm of each unique employee working toward a common goal of delivering a superior customer experience. Yet, in spite of having one mission, we encourage individual contributions, ideas and challenges to ensure we’re always on the cutting edge of FinTech solutions that our clients won’t find anywhere else. ResponsibilitiesThe Senior Data Engineer works closely with Director of Data Engineering guiding best practices for data modeling, data warehousing and data ingestion. Key responsibilities include:<ul><li>Designs and implements dimensional data models and data warehousing features for business users and business processes.</li><li>Develops automated workflows, manages CICD for data engineering pipelines.</li><li>Develops tooling to facilitate data product development, deployment, and monitoring. </li><li>Collaborates with data engineers, software engineers, business analysts, and data scientists to develop data pipelines/products and automation solutions.</li><li>Creates and promotes best practices in data operations, including source to target, warehousing, and BI. </li><li>Helps contribute to a collaborative, open developer environment.</li><li>Leads improvements in methodology or initiatives to address capability gaps or increase efficiency.</li><li>Offers advice and guidance to junior associates for sake of continuous improvement.</li></ul> QualificationsEducation and Required Experience<ul><li>Bachelor’s degree in computer science or a quantitative field. Master's degree preferred.</li><li>Five (5) years of Data Engineering experience.</li><li>Demonstrated experience with data and software engineering best practices and implementing data and software development lifecycles.</li><li>Demonstrated experience with designing and implementing data models (conceptual, logical, physical).</li><li>Demonstrated experience with implementing data ingestion/testing automation solutions.</li><li>Must have programming languages: SQL, Python.</li></ul>Preferred Experience<ul><li>Java, Scala.</li><li>Experience developing RESTful APIs.</li><li>Experience with Docker/Kubernetes.</li><li>Experience delivering and scaling data products in production.</li></ul>Technical Skills/Abilities<ul><li>In-depth experience with cloud technologies such as Snowflake, dbt, AWS, Airflow.</li><li>Experience with modern data tools such as Spark, Kubernetes, Docker.</li><li>Experience with micro-service architecture and web-services.</li><li>Working knowledge of data engineering pipelines, common data deployment pitfalls, and inherent complexities when managing data at scale.</li><li>Experience using a data visualization tool like Looker, Tableau or PowerBI.</li></ul> Benefits offers a full benefits package including:<ul><li>Medical insurance options, including an HSA plan</li><li>Telemedicine</li><li>401k with company matching</li><li>Surgical and Imaging assistance</li><li>Employer paid Life Insurance</li><li>Vision Insurance</li><li>Dental Insurance Options</li><li>Short and Long Term Disability Options</li><li>Critical Illness and Accident Options</li><li>Employee Assistance Program</li><li>Health and Wellness Program</li><li>Onsite gym</li><li>Parental leave</li><li>PTO policy</li></ul>

Top 3 Must Haves:1. Database Design (Microsoft shop)2. Familiarization cloud base infrastructure - Azure (but open to AWS and GCP)3. Reporting (examples not exclusive to power bi or tableau)4. Understanding business needs and how to present and organize data to non-technical stakeholders. Overview: We are seeking an IT Director to lead our technological initiatives, ensuring alignment with business goals and optimizing IT infrastructure for current and future needs. The ideal candidate will possess expertise in cloud technologies, databases, reporting, data warehousing, and analytics, along with strong leadership skills to drive innovation and maintain high standards of data security and accessibility.Responsibilities:Strategic Leadership: Develop and execute the company's IT strategy in alignment with overall business objectives. Hands-On Leadership: Lead technical projects and provide guidance to the IT team. Project Management: Effectively allocate resources to meet project and operational requirements. Cloud Optimization: Utilize experience with cloud platforms to enhance infrastructure and services. Data Warehousing: Establish and maintain efficient data warehousing solutions. Data Governance: Oversee implementation and maintenance of cloud databases to ensure accuracy, availability, and security. Reporting Systems: Drive development and enhancement of reporting systems for data-driven decision-making. Analytics Implementation: Promote use of advanced analytics for improved business operations. Compliance Assurance: Ensure IT systems comply with industry standards and regulations. Vendor Relationship Management: Manage relationships with IT vendors to maximize organizational value. Travel: Some travel may be required for conferences, meetings, and on-site support. Requirements:Bachelor's degree in Information Technology, Computer Science, or related field (Master's degree preferred). 5+ years of experience in IT leadership roles with successful project and team management. Expertise in cloud platforms, particularly Microsoft Azure and Amazon Web Services. Strong proficiency in cloud database management, reporting tools, data warehousing, and analytics. Familiarity with data analytics tools (e.g., Tableau, Power BI) and data warehousing technologies. Excellent communication and collaboration skills. Strong problem-solving and decision-making abilities. Knowledge of cybersecurity best practices and compliance standards. Customer-centric approach to IT solutions. Proficiency in project management and budgeting. Industry certifications (e.g., AWS Certified Solutions Architect, Microsoft Certified Azure Administrator) are advantageous. Benefits:Comprehensive Medical, Dental, and Vision Insurance for Full-Time Team Members Generous Paid Time Off for Full-Time Team Members 401K Retirement Plan with Company Matching Training Opportunities Vibrant Company Culture Focused on Growth and Advancement Values Rooted in Trust, Action, Service, Growth, and Purpose

The roleThis is a great opportunity to join one of the largest integrated energy and commodity trading companies in the world.We are looking for a hands-on Lead Data Engineer with experience in the Power & Gas Commodity markets of North America. You will work on full stack applications to support Front Office Trading across commodities and must be passionate about technology with experience developing enterprise-wide solutions.You will need to partner with end-users to understand process, requirements and analyze problems to design solutions and ultimately deliver tangible business value & benefit.Key responsibilities<ul><li>for development and operations of Front Office Data warehouse hosted in Amazon Web Services (AWS).</li><li>and design scalable data pipelines and infrastructure to support the organization&#39;s data needs.</li><li>a team of data engineers in developing, testing, and deploying data pipelines and ETL processes.</li><li>with cross-functional teams, including data scientists, analysts, and product managers, to understand data requirements and deliver solutions.</li><li>best practices and standards for data engineering processes and ensure adherence to them.</li><li>and implement new technologies and tools to improve the efficiency and effectiveness of data pipelines.</li><li>and optimize performance of data systems to ensure reliability, scalability, and cost-effectiveness.</li><li>technical leadership and mentorship to junior members of the data engineering team.</li><li>and resolve issues related to data pipeline failures, data quality, and performance bottlenecks.</li><li>closely with DevOps and infrastructure teams to deploy and manage data systems in production environments.</li><li>updated on industry trends and emerging technologies in data engineering and apply them to enhance existing systems.</li></ul>Skill and Experience<ul><li>or MS in Computer Science or relevant experience.</li><li>10+ years of experience in designing, building, and deploying large-scale data pipelines and ETL processes.</li><li>& Gas Commodities background is a plus.</li><li>proficiency in programming languages such as Python.</li><li>Server expert with experience in Database Administration (DBA). In-depth knowledge of data modeling, database design.</li><li>with modern day data warehouse platforms like Snowflake and Data bricks</li><li>with AWS cloud platform.</li><li>with containerization technologies such as Docker and orchestration tools like Kubernetes.</li><li>problem-solving and analytical skills.</li><li>communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams.</li><li>experience in a leadership or mentoring role is preferred.</li><li>in relevant technologies (e.g., AWS Certification) are a plus.</li></ul>

Position Overview: Our client is looking for an experienced Data Engineer to join their team. The selected candidate will play a crucial role in designing and implementing data architecture patterns for large-scale data warehouses. Responsibilities:<ul><li>Design, develop, and maintain scalable data pipelines and workflows to support various data engineering and analytics initiatives.</li><li>Implement and optimize data architecture patterns, ensuring data integrity, reliability, and performance.</li><li>Collaborate with cross-functional teams to understand data requirements and develop solutions that meet business needs.</li><li>Provide technical guidance and mentoring to junior data engineers and business users.</li><li>Conduct training sessions to educate business users on best practices for utilizing reporting solutions like PowerBI effectively.</li><li>Stay up-to-date with emerging technologies and trends in data engineering and analytics, recommending new tools and techniques as appropriate.</li></ul> Qualifications:<ul><li>Bachelor's degree in Computer Science, Information Technology, or a related field. Master's degree preferred.</li><li>years of experience in data engineering, with a focus on designing data architecture for large data warehouses.</li><li>Proficiency in SQL, Python, and other relevant programming languages and tools.</li><li>Hands-on experience with cloud-based data platforms such as AWS, Azure, or Google Cloud Platform.</li><li>Experience with Azure Data Factory, Azure Data Lake, and Azure Synapse.</li><li>Strong understanding of data modeling principles and data management best practices.</li><li>Excellent communication and interpersonal skills, with the ability to effectively collaborate with technical and non-technical stakeholders.</li><li>Experience providing training and mentoring to business users for reporting solutions like PowerBI is a plus.</li></ul> The interview process:A bit about myself - my name is Swarndeep Gill, and I am a recruitment consultant based in Vancouver, BC. I am constantly working on IT and creative roles, and I am always looking to meet new people. If you're interested in pursuing this role, please apply to this posting. If you are selected for the next stage, I will contact you for an initial discussion. This will be a chance for us to discuss the job requirements in greater detail, as well as your career goals and preferences for your next position. We can also discuss other opportunities which may fit what you're looking for. Please feel free to reach out and find me on LinkedIn by searching my name: Swarndeep Gill Compensation & benefits:This is a full-time and permanent position that includes a competitive base salary, extended health and dental benefits, and paid vacation. <ul><li>Preference will be given to candidates who are currently in Canada with proper working permission to work in Canada</li><li>No relocation or VISA sponsorship support will be offered for this role</li></ul>

Do you have experience as a Data Analyst or had the responsibilities similar as a Data Analyst? Do you have a passion for marketing analytics and would love the opportunity to help drive consumers towards a specific product? The ideal candidate will turn data into information, information into insight and insight into business decisions. Some responsibilities of the Data Analyst include conducting full lifecycle analysis to include requirements, activities and design, as well as developing analysis and reporting capabilities both within MS Excel and MS Power BI. If this sounds like you, then don't hesitate and apply today. Major responsibilities:<ul><li>Monitor data to identify changes in marketing and business trends</li><li>Regularly examine data reports to locate and resolve mistakes throughout</li><li>Assemble business reports that provide insight into key data points</li><li>Assemble data recording systems and business analysis for the department to use</li><li>Communicate data analysis findings to managers in written and verbal form</li><li>Accurately analyze and collect data for various types of business reports</li><li>Support database updates and maintain accuracy</li><li>Support various departments, including marketing and sales, in reaching their goals through analysis</li></ul>What you bring to the table:<ul><li>Comfortable with business operations, objectives, strategies, process and information flow</li><li>Bachelor's Degree, Advanced Microsoft Excel and 2 + Years of hands-on experience with Microsoft Power BI</li><li>Tendency to pay close attention to small details that could impact results</li><li>Demonstrated ability to manage time and prioritize projects to meet deadlines</li><li>Must be able to effectively relate data to coworkers using verbal and written communication skills</li><li>Demonstrated ability to create pivot tables, graphs, and charts from data tools</li><li>Experience with object-oriented programming and other data analysis programs</li><li>Analytical skills that allow for the development of data-driven reports</li><li>Excellent critical thinking skills to help solve business problems and make decisions</li></ul>

<ul><li>Formulate and execute ELT / ETL strategies to transfer data from internal sources to operational data stores, Azure data lake, and data warehouse.</li><li>Devise APIs, data structures, and schemas for effective data storage and retrieval.</li><li>Sustain data mappings, definitions, and architectural diagrams.</li><li>Ensure data integrity through validation and testing mechanisms.</li><li>Conduct feasibility studies to assess new processes and technologies.</li><li>Oversee code deployment across various environments.</li><li>Identify and resolve data-related issues and defects.</li><li>Enhance database performance and optimize query execution.</li><li>Participate in code reviews and offer guidance to team members.</li><li>Document code and develop templates adhering to industry standards.</li></ul>

Data Engineer Robert Half Jobs

Azure Data Engineer
May 1, 2024

Data Engineer
April 21, 2024

Senior Data Engineer
April 20, 2024

Data Engineer
April 20, 2024

Data Engineer
April 17, 2024

Lead Data Engineer
April 16, 2024

Data Engineer
April 14, 2024

Data Engineer
April 12, 2024

Data Engineer
April 7, 2024

Quick filters

Top companies

Data Engineer Robert Half Jobs

Azure Data EngineerMay 1, 2024

Data EngineerApril 21, 2024

Senior Data EngineerApril 20, 2024

Data EngineerApril 20, 2024

Data EngineerApril 17, 2024

Lead Data EngineerApril 16, 2024

Data EngineerApril 14, 2024

Data EngineerApril 12, 2024

Data EngineerApril 7, 2024