Distinguished Data Engineer in Irving, TX at honor foundations

Date Posted: 8/23/2024

Job Snapshot

  • Employee Type:
    Full-Time
  • Location:
    Irving, TX
  • Job Type:
  • Experience:
    Not Specified
  • Date Posted:
    8/23/2024

Job Description



When you join Verizon

Verizon is one of the world’s leading providers of technology and communications services, transforming the way we connect around the world. We’re a human network that reaches across the globe and works behind the scenes. We anticipate, lead, and believe that listening is where learning begins. In crisis and in celebration, we come together—lifting up our communities and striving to make an impact to move the world forward. If you’re fueled by purpose, and powered by persistence, explore a career with us. Here, you’ll discover the rigor it takes to make a difference and the fulfillment that comes with living the #NetworkLife. As a Distinguished Engineer- Cloud within the Artificial Intelligence and Data Organization (AI&D), you will be strategizing, identifying and driving state-of-the-art technologies for Platform Rationalization and Work with leadership and help align on strategies across the enterprise. You will be defining a blueprint for GCP’s adoption and GCP’s services and come up with high-level design to implement solutions and Partner with stakeholders to identify real business opportunities and build a roadmap. You will be a good thought leader with innovation in every thought. You are a good team player and have a go-getter kind of attitude with good interpersonal skills. Understanding the Latest happening in Cloud technologies, Generative AI, Datascience, ML and Model Operations area and building good work culture with stakeholders including, Business, Enterprise architects, Data Engineers, Data Scientists. Adhering to the organization priorities and policies. Building external stakeholder communication with Business user and Data ScientistsThe work you'll be doing will be Architecting, Build & support at AI&D platforms, which is going to enhance the experience for Data scientists and ML engineers to build world class solutions at scale.



What you’ll be doing...

  • Performing the Proof of Concepts (POCs) & Proof of Technologies (POTs) with new services/technologies in cloud, on-prem & open source technologies/ 

  • Developing hybrid solutions to effectively utilize the GPUs across on-prem & cloud by lowering the operational costs. 

  • Working closely with the Enterprise architects, AI&D Leaders,  network & security teams and application teams to build the scalable platforms that meets both business and technical requirements within the budget. 

  • Influencing the stakeholders to get the desired outcome. 

  • Performance GCP Bigquery administration, workload management & BQ tuning. 

  • Providing support for the engineering team on Kubernetes Clusters, Dataproc, Kafka, HDP and CDP cluster related issues.

  • Identifying the opportunities to automate the platform engineering activities including but not limited to Security compliance, platform remediation & governance. 

  • Creating tools and assets for managing data products,   Creating and maintaining documentation for platform configurations, changes, and issues.

  • Designing and recommending solution frameworks for teams to develop self-serve / auto-heal  solutions in GCP & On Prem Hadoop Platform.

  • Developing and deploying Python based custom solutions using Cloud Functions, Pubsub, BQ etc services in GCP.

  • Creating GCP infrastructure using Terraform and optimize the custom terraform modules.

  • Developing ansible scripts and integrate with Terraform as part of application environment provisioning in GCP / On Pem.

  • Collecting, integrating and Developing platform observability dashboards .

  • Analyzing and designing SRE solutions on top of existing GCP networks spanning across different GCP projects and on Prem Hadoop.

  • Resolving user issues for data services in Hadoop, Spark and GCP like dataproc, dataflow, composer, GKE, storage, Compute,  BQ, cloud functions to name a few.

  • Handling production support activities and following the incident management process.

Where you'll be working:

In this hybrid role, you'll have a defined work location that includes work from home and assigned office days set by your manager.



What we’re looking for...

You’ll need to have:

  • Bachelor's degree or four or more years of work experience.

  • Six or more years of relevant work experience.



Even better if you have one or more of the following:

  • 4 or more years of experience as Platform/solution/Enterprise architect. 

  • Deep hands-on experience with Spark, Hive,  big data & open source technologies . 

  • DevOps / SRE / Hadoop experience. 

  • 2 or more years experience in GCP cloud technologies

  • Experience in a modern scripting language (preferably Python / shell scripting ) for automation of build tasks. ​Two or more years ​Experience with Big Data on GCP – Dataproc, dataflow, Cloud Function, BigQuery, Composer, GKE, IA, etc.

  • Experience in working with REST APIs and event based Architecture

  • Experience in distributed processing (Hadoop / Spark ) Framework , resource management and optimization techniques.

  • Strong analytical and troubleshooting skills.

  • Generative AI certification & implementation experience.

  • Experience in optimizing the complex SQLs .

  • Experience in Git , Jenkins CI/CD, Python and GCP client libraries.

  • GCP Cloud Architect certification(s) or equivalent public cloud certifications.

If Verizon and this role sound like a fit for you, we encourage you to apply even if you don’t meet every “even better” qualification listed above.



Where you’ll be working

In this hybrid role, you'll have a defined work location that includes work from home and a minimum eight assigned office days per month that will be set by your manager.

Scheduled Weekly Hours

40

Equal Employment Opportunity 

We’re proud to be an equal opportunity employer - and celebrate our employees’ differences, including race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, and Veteran status. At Verizon, we know that diversity makes us stronger. We are committed to a collaborative, inclusive environment that encourages authenticity and fosters a sense of belonging. We strive for everyone to feel valued, connected, and empowered to reach their potential and contribute their best. Check out our diversity and inclusion page to learn more.