Lead Data Engineer Job at Openkyber, Atlanta, GA

  • Openkyber
  • Atlanta, GA

Job Description

Role: Senior Data Engineer Location: Dallas, TX (Onsite)



Responsibilities
  • Design and Implement scalable solutions for ever-increasing data volumes, using big data/cloud technologies like Pyspark, Kafka, etc.
  • Collaborate with cross-functional teams to understand data requirements and provide effective solutions.
  • Implement real-time data ingestion and processing solutions
  • Develop and maintain ETL/ELT processes to support data analytics and reporting.
  • Implement best practices for data security, integrity, and quality.
  • Developing data integration and migration strategies to move data from legacy systems to Cloud
  • Monitoring and troubleshooting the performance and availability of the data systems and implementing strategies to improve their reliability and scalability
  • Managing security and access controls for the data systems, including managing roles and permissions, implementing encryption, and complying with regulatory requirements.


Requirements
  • Bachelor's in Engineering / Master's degree in Computer Science, Information Systems or related field
  • Minimum of 5 - 9 years of experience in data engineering.
  • Experience with databases and data warehouse implementations (Preferred Snowflake, PostGreSQL)
  • Strong SQL skills with experience in writing and optimising complex queries
  • Working knowledge of Data warehousing, Data Governance, Data Quality and Data Architecture
  • Experience in Data Modelling
  • Ability to handle large scale structured and unstructured data from internal and third-party sources
  • Hands On Experience in Python, Pyspark, Kafka
  • Experience with data engineering tools/technologies in Google Cloud Platform Cloud environment
  • Proficiency in designing and maintaining scalable data architectures
  • Experience with CICD Tools like GitHub

For applications and inquiries, contact:hirings@openkyber.com

Job Tags

Similar Jobs

Star Pro Security

Unarmed Security Guard Job at Star Pro Security

 ...Location : Orange County, CA Pay : $17-19/HR Job Type : Part-Time Scheduled Shift : Saturday - Sunday 4:00pm - 12:30am (16...  ...Weekly Pay (every Thursday) Training and Development Health insurance Pay rate: $17-19 Job Type: Permanent, Part/Full-Time... 

Openkyber

Lead Data Engineer Job at Openkyber

 ...job summary: We are seeking an experienced Databricks Data Engineer to join our high-performing Data & AI practice in Phoenix, AZ. In this role, you will be responsible for designing and deploying enterprise-grade Lakehouse solutions on Google Cloud Platform (Google Cloud... 

State Compensation Insurance Fund

SENIOR WORKERS' COMPENSATION CLAIMS ADJUSTER Job at State Compensation Insurance Fund

 ...management, corporate policies & procedures and DWC laws and regulations Proactively and independently, manage, finalize and control (adjust) an inventory Collaborate with a team of claims professionals and other stakeholders Serve as a resource to other team... 

Clipper Courier Logistics

Owner Operator Drivers Needed (CAR, SUV, MINIVAN, VAN, SPRINTER) Job at Clipper Courier Logistics

 ...Job Description Drivers Needed! - Work Available on ALL SHIFTS!!! At Clipper Courier Logistics, Inc. our mission is to provide exceptional...  ...and dependability. We are proud to have partnered with our local and nationwide clients in successfully completing millions of on... 

Hart & Hickman

Mid-Level Environmental Consultant Job at Hart & Hickman

 ...At Hart & Hickman, we're looking for an Environmental Consultant who's ready to step into a larger leadership role. With 510 years of experience, you've built a solid technical foundation and proven you can deliver. Now you're looking for a firm where your contributions...