Director Data Engineering
Company: Nexus Staff
Location: Dallas
Posted on: May 28, 2023
|
|
|
Job Description:
Our team believes that data should be used to create
transparency and generate value for communities. As a member of our
team, you will be responsible for leading the development of
technical architecture, data services, and data engineering aspects
in line with our product roadmap and defined features. You will
also manage the implementation of large-scale data platforms to
meet the analytical and operational needs of various
organizations.
In this role, you will design and manage batch and real-time data
pipelines using the latest technologies available on cloud
platforms such as Microsoft Azure, Google Cloud Platform, and AWS.
As a technical domain expert, you will be knowledgeable in topics
such as device data management, data persistence across public
clouds, data quality, real-time data integration, ELT patterns, and
serverless architecture.
You will contribute to the creation of relevant documentation and
engage in knowledge exchange sessions with various stakeholders to
articulate solution design and implementation roadmaps. You will
ensure data accuracy and completeness while producing high-quality
data management software with scalable data services to address
business needs. Additionally, you will build products and
frameworks that can be reused across different use-cases to
increase efficiency in coding and agility in solution
implementation.
As part of your responsibilities, you will build streaming
ingestion processes to efficiently read, process, analyze, and
publish data for real-time applications and data science models.
You will perform analyses of large structured and unstructured data
to solve multiple and complex business problems, and understand
business use cases to design engineering routines that affect the
outcomes.
In this role, you will also review and assess data frameworks and
technology platforms with the goal of suggesting and implementing
improvements on the existing frameworks and platforms. To qualify
for this position, you should be a manager who has managed multiple
data platform implementations across modern technologies, a lead
engineer interested in designing solutions in both streaming and
batch processing environments, and a tech-enthusiast excited to
work with cloud-based technologies like GCP, Azure, and
Kubernetes.
You should be curious about analytics frameworks and well-versed in
the advantages and limitations of various big data architectures
and technologies. As a technologist, you should be committed to
ensuring the accuracy of data across solutions provided. Above all,
you should be a believer in transparency and communication.
The Tools We Use
To give you a flavor of our current tools:
Language: Python, Scala, Java, SQL Streaming: Spark Streaming,
Pub/sub, Kafka Database software:
Cloud Technologies: GCP (BigQuery, Cloudproc, Cloudflow, BigQuery,
Compute Engine), Azure (HDInsight, data factory)
Keywords: Nexus Staff, Dallas , Director Data Engineering, Executive , Dallas, Texas
|
Click
here to apply!
|
