Lead Data Engineer

Company: Artisan Design Group
Location: Dallas
Posted on: March 21, 2023

Job Description:

Job Description:

Job Description Description: COMPANY OVERVIEW Artisan Design Group - or ADG - is a leading supply chain partner to homebuilders throughout the United States. Over 3,000 ADG employees operating out of 135 facilities in 25 states provide a full range of design, procurement, and installation services along with products from the top manufacturers of flooring, cabinets and countertops. Formed in 2016 by the merging of two industry leaders, ADG then acquired over 20 additional companies - each a leader in the geography it serves. We are the premier interior finishings organization in the United States. Our expansive trajectory has been rapid, and we continue to experience explosive growth, thanks to our dedication to high quality work. JOB SUMMARY We are looking for a savvy Lead Data Engineer to join our growing Data Governance team. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder, Azure and data wrangler who enjoys optimizing data systems and building them from the ground up. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. ESSENTIAL DUTIES AND RESPONSIBILITIES include the following. Other duties may be assigned.Support our ETL developer, Power BI Analyst, and data analysts on data initiativesEnsure optimal data delivery architecture is consistent throughout ongoing projectsOptimizing data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. Plays a critical role with our current ERP Migration Project.Optimizing and re-designing our company's data architecture to support our next generation of products and data initiatives.Requirements: EDUCATION, EXPERIENCE & QUALIFICATIONS To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. Required Qualifications:This position can be remote, with occasional travel to the Corporate HQ's in Dallas. Bachelor's degree or Will also consider 5 years of dynamic experience in the specialty in lieu of every year of education.Experience in supply chain, construction, etc. a plusExperience in designing solution and ability to drive an independent project from a development standpoint5+ years of hands-on IT experience in design and development of complex data systemsAt least 3+ years of hands-on experience in cloud native architecture design, implementation of distributed, fault tolerant enterprise applications for cloudDemonstrable experience in using Azure services including aspects like compute, network, storage, and security Preferred Qualifications:Experience with Agile development methodologiesExperience with design and implementation of ETL/ELT framework for sophisticated warehouses/marts. Knowledge of large data sets and experience with performance tuning and troubleshootingHands-on development mentality, with a willingness to fix and tackle sophisticated problemsExperience in leading teams across multiple locations.CI / CD exposureExperience with large scale technical projects, sophisticated environments.Azure professional cloud developer or equivalent certificationExcellent verbal and written communication skills and interaction ability.Should have development and integration experience using ADF V2.0. Knowledge about Integration Runtime etc.Sound knowledge of SQL Pool, Spark Pool and Serverless Pool capabilities of Azure Synapse Analytics serviceAzure Storage services knowhow primarily Table, File and Blob storageKnowledge about Azure security features RBAC, Azure AD, NSGs, Firewall, Azure Key Vault, Shared Security ServicesExperience with Java / Scala. Experience with Hadoop and HivePython experience requiredExperience on Data Stores dealing with raw Blob storage and files formats like ParquetExperience in creating warehouses what allow for incremental load and dimensional conformance (raw modelling)Some experience with Azure Delta Lake is a plusExperience with Lakehouse architecture and implementationGood interpersonal and partnership skillsFlexible to new situations and challenges PHYSICAL DEMANDS The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.Ability to sit at computer monitor for long periods throughout the day.Must possess the ability to stand for long periods of time; to reach with hands and arms; to move among and between offices; to handle mail and documents; to sit, stoop, kneel and crouch; to lift and move up to 10 pounds; to see well enough to discern differences in quality of documents and files. WORK ENVIRONMENT The work environment characteristics described here are representative of those an employee encounters while performing the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.Remote Occasional travel to corporate office in DallasGeneral working conditionsMay have to meet tight deadlines OUR BENEFITSHealth Insurance (Medical, Prescription, Dental, and Vision)Life InsurancePaid Holidays and Time Off401(k) Plan with company matching Artisan Design Group is committed to a policy of equal employment opportunity for applicants and employees. It is the policy of Artisan Design Group to apply recruiting, hiring, training, promotion, compensation, and professional development practices without regard to actual or perceived race, color, religion, sex (including pregnancy, sexual orientation and gender identity), national origin, age (40 or older), disability or certain classifications based on genetic information, or any other characteristic protected by federal, state or local laws, regulations or ordinances. PI208074934

Keywords: Artisan Design Group, Dallas , Lead Data Engineer, Engineering , Dallas, Texas