Senior Big Data Engineer

Beyond Limits is a pioneering Artificial Intelligence engineering company creating advanced software solutions that go beyond conventional AI. Founded in 2014 with a legacy in space exploration, Beyond Limits is transforming proven technologies from Caltech and NASA’s Jet Propulsion Laboratory into advanced AI solutions, hardened to industrial strength, and put to work for forward-looking companies on earth. We leverage this unparalleled innovation portfolio, along with proprietary cognitive technologies, to help companies solve tough, complex, mission-critical problems and transform their business. We apply a unique hybrid approach to AI, combining numeric AI techniques like machine learning with higher-order symbolic AI and expert human knowledge to deliver intuitive cognitive reasoning and information. Our cognitive computing technology mimics human thought processes and provides explainable reasoning to aid human-like decision-making.  

Position Overview:

We are seeking a highly skilled Senior Big Data Engineer to join our dynamic team in Jordan. The ideal candidate will have extensive experience in designing, developing, and implementing large-scale data processing systems. They will be responsible for architecting and building robust data pipelines, optimizing data workflows, and ensuring the scalability, reliability, and performance of our big data infrastructure.

Job Duties/Responsibilities:

  • Design, develop, and maintain scalable big data pipelines and workflows to ingest, process, and analyze large volumes of data from various sources.
  • Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions.
  • Implement data processing algorithms and machine learning models for predictive analytics and data-driven decision-making.
  • Optimize data storage, retrieval, and processing techniques to improve system performance and efficiency.
  • Perform data quality assessments, data validation, and data cleansing to ensure accuracy, completeness, and integrity of the data.
  • Troubleshoot and debug issues in the big data infrastructure and provide timely resolutions to minimize downtime and disruptions.
  • Stay up-to-date with emerging technologies and industry trends in big data processing, distributed computing, and data engineering best practices.
  • Mentor junior engineers and provide technical guidance and leadership in big data technologies and methodologies. 

Minimum Qualification: 

  • 14+ years of experience in big data engineering, data warehousing, or related field.
  • Bachelor's in Engineering, or related field.
  • Proficiency in programming languages such as Java, Scala, Python, or similar.
  • Hands-on experience with big data technologies and frameworks such as Hadoop, Spark, Kafka, Hive, HBase, etc.
  • Strong understanding of distributed computing principles and experience with cloud-based big data platforms (e.g., AWS, Azure, GCP).
  • Experience in designing and implementing data processing pipelines.
  • Knowledge of relational and NoSQL databases, data modeling techniques, and SQL querying.
  • Excellent problem-solving skills, attention to detail, and ability to work independently and collaboratively in a fast-paced environment.
  • Strong communication and interpersonal skills, with the ability to effectively communicate technical concepts to non-technical stakeholders.

Preferred Qualifications: 

  • Experience in Oil & Gas or a similar field.
  • Experience with containerization technologies such as Docker, Kubernetes, etc.
  • Familiarity with DevOps practices and tools for automated deployment, continuous integration, and continuous delivery.
  • Certification in relevant technologies or methodologies (e.g., AWS Certified Big Data Specialty, Google Professional Data Engineer, etc.).

Beyond Limits provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability or genetics. In addition to federal law requirements, Beyond Limits complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.  
  
Beyond Limits expressly prohibits any form of workplace harassment based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status. Improper interference with the ability of Beyond Limit’s employees to perform their job duties may result in discipline up-to and including discharge.