DallasRecruiter Since 2001
the smart solution for Dallas jobs

Big data Engineer

Location: Frisco
Posted on: March 19, 2023

Job Description:

Job Description

  • Hands on experience on Big Data ecosystem
  • Mastering/Leading in the development of applications/tools using Sqoop, Spark, Python, Scala packages
  • Good understanding of BI tools (Tableau/Power BI, MicroStrategy) for Big Data
  • Knowledge on Big suites Hive, Oozie, Kafka, good experience in Hadoop (Native) Big Data processing
  • Experience of writing Hive queries
  • Familiarity with development best practices such as code reviews and unit testing.
  • Experience in designing the automation framework using Python, Perl and Shell scripting.
  • Leading, guiding and helping the team members with the challenges faced during the project development process and problem solving.
  • Have flexibility and ability to learn and use new technologies and to work in team environment as wells as independently to get things done
  • Excellent communications skill
  • Experience in working with client and handle the pressure
  • Diagnosing software issues and engineering workarounds
  • Experience in working with users, user roles using Ranger
  • Good understanding on security and administration Technology -
    • Big data (Native) Ecosystem
    • OS: CentOS/Linux/Unix
    • Tool/Programs: Sqoop, Spark, Impala, Python, Scala
    • Database: Hive, HBase, NoSQL Qualification -

      Bachelor's Degree in Computer Science or equivalent

      Primary Responsibilities
      • Act as a Big data subject/solution matter expert and liaison to Big Data users and IT
      • Serve as an escalation point for production and/or platform issues and acts as lead liaison with Technical Support to resolve outstanding issues within the Big Data environment
      • Execute actions necessary to achieve and maintain optimum Big Data platform performance, reliability and availability Identify bottlenecks in production systems and provide solutions
      • Provide Big Data Platform capacity planning, metrics, and performance tuning recommendations
      • Use Big Data Management tools (Ranger)
          • Creating Users/Groups/Roles
          • Creating and using Access Control Templates
          • Creating, deployment and scheduling jobs
          • Defining connections to data sources, libraries, metadata objects, and folder structures Qualifications
            • 5+ years of experience working with and maintaining IT Application support.
            • 3+ years of experience with Big Data Engineer
            • Experience in production data loads and data/storage management for multiple data sources.
            • Knowledge of change management procedures and version control is required
            • Experience/Knowledge of application security, performance and tuning
            • Passion about technology and continuous learning and mastering computer-related technologies
            • Strong communication skills and ability to work as a team Good to have
              • Strong knowledge of Big Data open-source communities.

Keywords: MICASA GLOBAL, Dallas , Big data Engineer, Engineering , Frisco, Texas

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category

Log In or Create An Account

Get the latest Texas jobs by following @recnetTX on Twitter!

Dallas RSS job feeds