Design, develop, and maintain scalable data pipelines for the efficient collection, storage, and processing of large datasets.
Develops and design best practices around data collection and maintain orchestration of data flows, for batch, near-real time data.
Develop and design best practices of CDC and SCD for existing systems to maintain data consistency
Participates in evaluation and deployment of big data tools, relevant to the development.
Ability to identify different platforms, techniques, and methodology used in big data platforms, and demonstrate for various system in the organization.
Optimize and tune data systems for performance and reliability.
Develop and implement data models and schemas to support business intelligence and analytics needs.
Monitor and troubleshoot data pipelines to ensure smooth and efficient operation.
Stay up-to-date with the latest advancements in data engineering and incorporate them into our data infrastructure.
Document data engineering architectures and follow best practices.
Qualifications
Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field.
5+ years of experience as a Data Engineer, Data Architect, Big Data Administrator or similar role.
Strong programming skills in Python.
Experience with UNIX system administration using command line.
Experience with data processing frameworks such as Airflow, Airbyte, DBT, Hadoop, Spark, Hive, and Kafka
Proficiency in SQL and experience with relational databases.
Knowledge of data modeling, ETL processes, and data warehousing solutions.
Knowledge of Structuring data in various schemas suitable for a data lake, warehouse, or marts.
Experience in implementing scalable, reliable, and efficient data storage solutions with PostgreSQL, MinIO.
Experience in enhancing the performance of big data applications, including optimizing system operations.
Excellent problem-solving skills and the ability to work independently or as part of a team.
Strong communication skills and the ability to explain complex technical concepts to non-technical audiences.
#J-18808-Ljbffr
إنشاء تنبيه وظيفي لهذا البحث
Data Engineer • Riyadh, Riyadh Region, Saudi Arabia
وظائف ذات صلة
عَرْضٌ مُرَوَّجٌ له
IoT Data Engineer
CanonicalRiyadh, Riyadh Region, Saudi Arabia
Be among the first 25 applicants.Canonical is a leading provider of open source software and operating systems to the global enterprise and technology markets.
Our platform, Ubuntu, is very widely u...أظهر المزيدآخر تحديث: 10 منذ أيام
عَرْضٌ مُرَوَّجٌ له
BigData Engineer
Visible Stars, Inc.Riyadh, Riyadh Region, Saudi Arabia
Build PySpark based applications for both batch and streaming requirements on Cloudera Distributed systems, utilizing in-depth knowledge of Hadoop and NoSQL databases.
Develop and execute data pipel...أظهر المزيدآخر تحديث: منذ أكثر من 30 يومًا
عَرْضٌ مُرَوَّجٌ له
Junior Data Engineer
CanonicalRiyadh, Saudi Arabia
Canonical Join to apply for the.Bring your data analytics and data mining skills to a unique team seeking to understand and shape the future of marketing technology.
We are interested in technology ...أظهر المزيدآخر تحديث: منذ أكثر من 30 يومًا
Data Engineer (Saudi-based only)
LucidyaRiyadh, Riyadh Province, SA
Quick Apply
The Data Engineer will play a crucial role in building and maintaining the data infrastructure at Lucidya.This role involves designing, developing, and managing scalable and robust data pipelines t...أظهر المزيدآخر تحديث: منذ أكثر من 30 يومًا
عَرْضٌ مُرَوَّجٌ له
Principal Data Engineer
ToptalRiyadh, Riyadh Region, Saudi Arabia
Toptal launches HireGlobal The most competitively priced global workforce payroll platform.Toptal is a global network of top talent in business, design, and technology that enables companies to sca...أظهر المزيدآخر تحديث: 11 منذ أيام
Data Engineer
Müller`s SolutionsRiyadh, Riyadh Province, SA
Quick Apply
Müller's Solutions is seeking a talented Data Engineer with expertise in Talend to join our growing team.As a Data Engineer, you will play a critical role in building and maintaining data pipelines...أظهر المزيدآخر تحديث: منذ أكثر من 30 يومًا
عَرْضٌ مُرَوَّجٌ له
Data Engineer
Compunet ConnectionsRiyadh, Riyadh Region, Saudi Arabia
Location : Riyadh, Saudi Arabia (On-site preferred).Build and maintain scalable data pipelines and ETL workflows.Integrate multiple data sources, ensuring accuracy and timeliness.Support analytics a...أظهر المزيدآخر تحديث: 10 منذ أيام
Data Engineer
Arbete CareersRiyadh, Saudi Arabia
Quick Apply
One of our Client is hiring for the position of Data Engineer in Riyadh.Job Title : Data Engineer .Build and maintain scalable data pipelines and ETL workflows.Integrate multiple dat...أظهر المزيدآخر تحديث: 29 منذ أيام
عَرْضٌ مُرَوَّجٌ له
Data Engineer
Lucidya LLC.Riyadh, Saudi Arabia
The Data Engineer will play a crucial role in building and maintaining the data infrastructure at Lucidya.This role involves designing, developing, and managing scalable and robust data pipelines t...أظهر المزيدآخر تحديث: منذ أكثر من 30 يومًا
عَرْضٌ مُرَوَّجٌ له
Data Engineer
Master WorksRiyadh, Riyadh Region, Saudi Arabia
Develop and maintain robust data architectures that support business needs and provide reliable data accessibility.Collaborate with cross-functional teams to define data requirements and deliver sc...أظهر المزيدآخر تحديث: منذ أكثر من 30 يومًا
عَرْضٌ مُرَوَّجٌ له
Data Engineer
DenodoRiyadh, Saudi Arabia
Job Description Denodo is always looking for technical, passionate people to join our Customer Success team.We want a professional who will travel, consult, develop, train and troubleshoot to enhan...أظهر المزيدآخر تحديث: منذ أكثر من 30 يومًا
عَرْضٌ مُرَوَّجٌ له
Data Engineer Microsoft Azure (m / w / d), Permanent contract
Devoteam Alegri GmbHRiyadh, Riyadh Region, Saudi Arabia
Do you want to not only experience but actively shape the unique.Our core business is cloud-based enterprise customer projects, where we drive the most modern Microsoft technologies.The building bl...أظهر المزيدآخر تحديث: 2 منذ أيام
عَرْضٌ مُرَوَّجٌ له
Data Engineer
Devoteam Alegri GmbHRiyadh, Riyadh Region, Saudi Arabia
Devoteam is a leading consulting firm focused on digital strategy, tech platforms, and cybersecurity.By combining creativity, tech, and data insights, we empower our customers to transform their bu...أظهر المزيدآخر تحديث: 15 منذ أيام
Data Engineer
Master-WorksRiyadh, Riyadh Province, SA
Quick Apply
Develop and maintain robust data architectures that support business needs and provide reliable data accessibility.Collaborate with cross-functional teams to define data requirements and deliver sc...أظهر المزيدآخر تحديث: منذ أكثر من 30 يومًا
AI & Data Engineer
Innovative SolutionsRiyadh, Ar Riyāḍ, SA
Quick Apply
Innovative Solutions (IS) is a leading cybersecurity company in the GCC since 2003, now expanding into the broader digital world of opportunities.
As we transcend beyond cybersecurity’s legacy of ri...أظهر المزيدآخر تحديث: 6 منذ أيام
عَرْضٌ مُرَوَّجٌ له
Data Engineer (Saudi-based only)
Lucidya | لوسيدياRiyadh, Riyadh Region, Saudi Arabia
The Data Engineer will play a crucial role in building and maintaining the data infrastructure at Lucidya.This role involves designing, developing, and managing scalable and robust data pipelines t...أظهر المزيدآخر تحديث: 24 منذ أيام
عَرْضٌ مُرَوَّجٌ له
Data Engineer
DatabornRiyadh, Saudi Arabia
Our team of over 350+ professionals worldwide is dedicated to delivering best-in-class solutions to large corporations in the financial, telco, oil & gas and retail industries.We leverage advanced ...أظهر المزيدآخر تحديث: منذ أكثر من 30 يومًا
عَرْضٌ مُرَوَّجٌ له
Data Engineer – FinTech AI / Stock Market Data Pipelines
UMATRRiyadh, Riyadh Region, Saudi Arabia
Data Engineer – FinTech AI / Stock Market Data Pipelines.Data Engineer – FinTech AI / Stock Market Data Pipelines.Apache Kafka, PySpark, TimescaleDB, PostgreSQL / MySQL, Snowflake / BigQuery / Redshift, ...أظهر المزيدآخر تحديث: 13 منذ أيام