Job Details
PeerSource is currently recruiting for multiple Senior Azure Data Engineers on a Direct Hire basis. This position is fully remote but candidate must be presently located in 1 of the following states: FL, NC, TX, VA, CO, HI, GA, TN, PA, AZ, WA, IL, MA.
Summary
This individual will be working with AI and Analytics teams, delivering data-related products, features, and functionality that serves business and technical leaders. This Engineer will have a strong Microsoft and Azure data background, defining high volume data processing pipelines in a multi-tenant environment, verifying data integrity and curating data for consumption by data warehouse, third-party data analytics tools and machine learning models. You will be involved in the design and development efforts for our big data solutions including data lake, Business Intelligence Solutions, Machine Learning, Data Pipeline, and cloud-based data warehouse products.
Responsibilities
- Work with clients to understand data analytics requirements. Analyze data to ensure it meets specific data management, data governance, and data quality assurance requirements before processing the data within the Data Lake and data warehouse
- Work with the Product Managers, Database Architect or BI Architect to understand data pipeline and data life cycle processing requirements and patterns
- Install and configure data sources for use by the data pipelines
- Work with the Database Architect to define data management, data governance, and data quality assurance requirements to manage the entire data processing life cycle
- Acts as a key contributor to all phases of the design and development lifecycle of analytic applications utilizing Microsoft Azure and BI technology platforms
- Curates data for analyses, business reviews, and operational data analysis demands
- Use an agile approach to define requirements, design and develop data pipeline solutions to enable near real-time change data capture (CDC) and data consumption
Required Skills
- 10+ years of experience with designing and developing complex data analytics solutions with advance SQL development skills
- 5+ years of experience with Microsoft Big Data solutions with experience in SQL Server (2017 or higher), Azure SQL technologies (Azure Data Lake Gen2, Azure Databricks, Azure Databricks Unity Catalog, Databricks API, Databricks Row-level security, Databricks error logging, Azure SQL Server, and Azure Analysis Services), and a broad experience with related tools (CDC, Columnstore Index, In-memory Table, SSAS Tabular, DAX, T-SQL, SSIS)
- Experience in Power BI, Power BI Embedded, Power BI Services, Power BI Gateway, and Power BI Dataflow
- Experience using Azure DevOps and CI/CD as well as Agile tools and processes including Git, Jenkins, Jira, and Confluence
- Experience with data integration through APIs, Web Services, SOAP, and/or REST services
- Experience with Lakehouse architecture and design for multi-tenant, OLTP data modeling, dimensional data modeling, composite modeling, data transformation, row-level security, and designing the most optimal analytical data structures for near real-time data analytics
- Adept at using large data sets to find opportunities for product and process optimization and using models to test the effectiveness of different courses of action
- Bachelor's degree in Computer Science
- Additional programming experience is a plus (preferably.NET) or other languages such as Python, Scala, R.
No third parties. H1 sponsorship is not available.
PeerSource is a nationwide technology recruiting firm that prioritizes building strong relationships with the talented professionals we are fortunate to serve. We offer contract, contract-to-hire, and direct hire opportunities throughout the US and support W2 as well as independent consultants working on a Corp-to-Corp basis. W2 benefits with PeerSource include health, dental, vision, and life insurance as well as a matching retirement plan. Contact us for more details!