4 Spark Developer jobs in Bahrain
Senior Data Engineer, Big Data Platforms
Posted today
Job Viewed
Job Description
Key Responsibilities:
- Design, build, and maintain scalable data pipelines and ETL/ELT processes.
- Develop and optimize data warehousing solutions on cloud platforms.
- Implement data quality checks and data governance frameworks.
- Collaborate with data scientists and analysts to support their data needs.
- Write efficient, production-ready code in Python, Scala, or Java.
- Manage and monitor data infrastructure, ensuring reliability and performance.
- Work with various data sources, including relational databases, NoSQL databases, and streaming data.
- Troubleshoot and resolve data-related issues promptly.
- Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field.
- 6+ years of experience in data engineering or software development with a focus on data.
- Expertise in distributed data processing frameworks (e.g., Spark, Hadoop, Flink).
- Proficiency in SQL and experience with various database technologies (e.g., PostgreSQL, Cassandra, MongoDB).
- Strong programming skills in Python, Scala, or Java.
- Experience with cloud data services (e.g., AWS Redshift, S3, EMR; Azure Data Lake, Databricks; Google BigQuery, GCS).
- Knowledge of data modeling, data warehousing, and data architecture principles.
- Familiarity with CI/CD pipelines and infrastructure as code.
- Excellent problem-solving and analytical abilities.
Senior QA Engineer - Big Data (Auto & Be Testing)
Posted today
Job Viewed
Job Description
Work closely with team members (Developers, Product Manager and all other partners) to design, develop, test and deliver high quality products.
Prevent, report, analyze and track issues in an effective and efficient manner.
Improve test strategy to reduce manual test efforts - Design, develop and execute Automation scripts.
**Requirements**:
- At least 6+ years of QA engineering experience in Automation and familiar with Backend Testing + Coding (Intermediate coding ability in Python or Java).
- Experience in writing clear and comprehensive test plans and test cases.
- Experience in testing Backend services such as APIs, Databases, distributed services. Strong SQL testing, understanding different SQL statements.
- Experience working in an Agile/Scrum development process.
- Bonus: Knowledge in the Blockchain or Web3 domain.
- Bonus: Big Data middle-wares testing (Hadoop, Hive, Spark, Kafka, Flink).
Working at Binance: Be a part of the world's leading blockchain ecosystem that continues to grow and offers excellent career development opportunities. Work alongside diverse, world-class talent in an environment where learning and growth opportunities are endless. Tackle fast-paced, challenging and unique projects. Work in a truly global organization, with international teams and a flat organizational structure. Competitive salary and benefits. Flexible working hours, remote-first, and casual work attire.
Learn more about how Binancians embody the organization's core values, creating a unified culture that enables collaboration, excellence, and growth.
This job has been sourced from an external job board.
Engineering Manager - Data Platform
Posted 6 days ago
Job Viewed
Job Description
Canonical is building a comprehensive suite of multi-cloud and on-premise data solutions for the enterprise. We want to make it easy to operate any database on any cloud, or on premise. The data platform team covers the full range of data stores and data technologies, spanning from big data, NoSQL, cache-layer capabilities, and analytics; all the way to structured SQL engines like Postgres and MySQL. We aim to deliver fault-tolerant mission-critical distributed systems, and the world's best data platform.
We are looking for technical Engineering Managers to lead teams focused on Big Data and MySQL databases. We write code in Python and encode modern operational practices for data applications at scale on Kubernetes and cloud machines.
Location: This role can be filled in European, Middle East, African or any American region / time zone.
What your day will look like
- You will lead a team building scalable data solutions for Kubernetes and cloud machines
- You will hire, coach, mentor, provide feedback, and lead your team by example
- You will demonstrate sound engineering skill by directly contributing code when needed
- Effectively set and manage expectations with other engineering teams, senior management, and external stakeholders
- Advocate modern, agile software development practices
- Develop and evangelize great engineering and organizational practices
- Ensure that your team delivers excellent products that users love by maintaining a culture of quality and engineering excellence
- Grow a healthy, collaborative engineering culture aligned with the company's values.
- Be an active part of the leadership team and collaborate with other leaders in the organization
- Work from home with global travel twice yearly, for internal events of one or two weeks duration
- A software engineering background, preferably with Python and Golang experience
- Experience running in production and at scale, preferably Big Data or MySQL
- Excellent judgement about people - their motivations, abilities, developmental needs, and prospects for success
- Proven ability to build high-quality, open-source software
- Proven to drive good engineering practices around performance and quality
- An open-minded attitude to new technologies and the drive to push the boundaries of what is possible
- The ambition to build products that improve how people operate software and infrastructure everywhere
- Love developing and growing people and have a track record of doing it
- Knowledgeable and passionate about software development
- Specialist knowledge in one or more of Spark, Superset, MySQL, or similar
- Prior experience working with open source and a will to build products with the community
Your base pay will depend on various factors including your geographical location, level of experience, knowledge and skills. In addition to the benefits above, certain roles are also eligible for additional benefits and rewards including annual bonuses and sales incentives based on revenue or utilisation. Our compensation philosophy is to ensure equity right across our global workforce.
In addition to a competitive base pay, we provide all team members with additional benefits, which reflect our values and ideals. Please note that additional benefits may apply depending on the work location and, for more information on these, please ask your Talent Partner.
- Fully remote working environment - we've been working remotely since 2004!
- Personal learning and development budget of 2,000USD per annum
- Annual compensation review
- Recognition rewards
- Annual holiday leave
- Parental Leave
- Employee Assistance Programme
- Opportunity to travel to new locations to meet colleagues at 'sprints'
- Priority Pass for travel and travel upgrades for long haul company events
Canonical is a pioneering tech firm that is at the forefront of the global move to open source. As the company that publishes Ubuntu, one of the most important open source projects and the platform for AI, IoT and the cloud, we are changing the world on a daily basis. We recruit on a global basis and set a very high standard for people joining the company. We expect excellence - in order to succeed, we need to be the best at what we do.
Canonical has been a remote-first company since its inception in 2004. Work at Canonical is a step into the future, and will challenge you to think differently, work smarter, learn new skills, and raise your game. Canonical provides a unique window into the world of 21st-century digital business.
Canonical is an equal opportunity employer
We are proud to foster a workplace free from discrimination. Diversity of experience, perspectives, and background create a better work environment and better products. Whatever your identity we will give your application fair consideration.
#J-18808-Ljbffr
Engineering Manager - Data Platform
Posted 7 days ago
Job Viewed
Job Description
Join to apply for the Engineering Manager - Data Platform role at Canonical
3 days ago Be among the first 25 applicants
Join to apply for the Engineering Manager - Data Platform role at Canonical
Get AI-powered advice on this job and more exclusive features.
Canonical is building a comprehensive suite of multi-cloud and on-premise data solutions for the enterprise. We want to make it easy to operate any database on any cloud, or on premise. The data platform team covers the full range of data stores and data technologies, spanning from big data, NoSQL, cache-layer capabilities, and analytics; all the way to structured SQL engines like Postgres and MySQL. We aim to deliver fault-tolerant mission-critical distributed systems, and the world's best data platform.
We are looking for technical Engineering Managers to lead teams focused on Big Data and MySQL databases. We write code in Python and encode modern operational practices for data applications at scale on Kubernetes and cloud machines.
Location: This role can be filled in European, Middle East, African or any American region / time zone.
What your day will look like
- You will lead a team building scalable data solutions for Kubernetes and cloud machines
- You will hire, coach, mentor, provide feedback, and lead your team by example
- You will demonstrate sound engineering skill by directly contributing code when needed
- Effectively set and manage expectations with other engineering teams, senior management, and external stakeholders
- Advocate modern, agile software development practices
- Develop and evangelize great engineering and organizational practices
- Ensure that your team delivers excellent products that users love by maintaining a culture of quality and engineering excellence
- Grow a healthy, collaborative engineering culture aligned with the company's values.
- Be an active part of the leadership team and collaborate with other leaders in the organization
- Work from home with global travel twice yearly, for internal events of one or two weeks duration
- A software engineering background, preferably with Python and Golang experience
- Experience running in production and at scale, preferably Big Data or MySQL
- Excellent judgement about people - their motivations, abilities, developmental needs, and prospects for success
- Proven ability to build high-quality, open-source software
- Proven to drive good engineering practices around performance and quality
- An open-minded attitude to new technologies and the drive to push the boundaries of what is possible
- The ambition to build products that improve how people operate software and infrastructure everywhere
- Love developing and growing people and have a track record of doing it
- Knowledgeable and passionate about software development
- Specialist knowledge in one or more of Spark, Superset, MySQL, or similar
- Prior experience working with open source and a will to build products with the community
Your base pay will depend on various factors including your geographical location, level of experience, knowledge and skills. In addition to the benefits above, certain roles are also eligible for additional benefits and rewards including annual bonuses and sales incentives based on revenue or utilisation. Our compensation philosophy is to ensure equity right across our global workforce.
In addition to a competitive base pay, we provide all team members with additional benefits, which reflect our values and ideals. Please note that additional benefits may apply depending on the work location and, for more information on these, please ask your Talent Partner.
- Fully remote working environment - we've been working remotely since 2004!
- Personal learning and development budget of 2,000USD per annum
- Annual compensation review
- Recognition rewards
- Annual holiday leave
- Parental Leave
- Employee Assistance Programme
- Opportunity to travel to new locations to meet colleagues at 'sprints'
- Priority Pass for travel and travel upgrades for long haul company events
Canonical is a pioneering tech firm that is at the forefront of the global move to open source. As the company that publishes Ubuntu, one of the most important open source projects and the platform for AI, IoT and the cloud, we are changing the world on a daily basis. We recruit on a global basis and set a very high standard for people joining the company. We expect excellence - in order to succeed, we need to be the best at what we do.
Canonical has been a remote-first company since its inception in 2004. Work at Canonical is a step into the future, and will challenge you to think differently, work smarter, learn new skills, and raise your game. Canonical provides a unique window into the world of 21st-century digital business.
Canonical is an equal opportunity employer
We are proud to foster a workplace free from discrimination. Diversity of experience, perspectives, and background create a better work environment and better products. Whatever your identity we will give your application fair consideration.
Seniority level
- Seniority level Mid-Senior level
- Employment type Full-time
- Job function Engineering and Information Technology
- Industries Software Development
Referrals increase your chances of interviewing at Canonical by 2x
Get notified about new Engineering Manager jobs in Manama, Capital Governorate, Bahrain .
Manama, Capital Governorate, Bahrain 4 months ago
Engineering Manager - Solutions EngineeringManama, Capital Governorate, Bahrain 3 days ago
Software Engineering Manager - Sustaining EngineeringManama, Capital Governorate, Bahrain 3 days ago
Manama, Capital Governorate, Bahrain 3 days ago
Manama, Capital Governorate, Bahrain 3 days ago
Manama, Capital Governorate, Bahrain 3 months ago
Manama, Capital Governorate, Bahrain 3 months ago
Manama, Capital Governorate, Bahrain 3 days ago
Technical Manager - Automotive and IndustrialManama, Capital Governorate, Bahrain 9 months ago
Manama, Capital Governorate, Bahrain 3 days ago
Manama, Capital Governorate, Bahrain 2 months ago
Manama, Capital Governorate, Bahrain 4 months ago
Manama, Capital Governorate, Bahrain 1 month ago
Engineering Manager - Build and Release InfrastructureManama, Capital Governorate, Bahrain 3 days ago
Engineering Manager - Public Cloud, Python, GolangManama, Capital Governorate, Bahrain 2 months ago
Manama, Capital Governorate, Bahrain 3 weeks ago
Engineering Manager - Build and Release InfrastructureManama, Capital Governorate, Bahrain 1 month ago
Manama, Capital Governorate, Bahrain 4 months ago
Manama, Capital Governorate, Bahrain 3 weeks ago
Salesforce Engineering Manager, Commercial SystemsManama, Capital Governorate, Bahrain 3 days ago
Software Engineering Manager - Desktop and Embedded Linux OptimisationManama, Capital Governorate, Bahrain 6 months ago
Manama, Capital Governorate, Bahrain 3 days ago
Software Engineering Manager, Ubuntu GamingManama, Capital Governorate, Bahrain 1 month ago
Software Engineering Manager - Ubuntu Linux KernelManama, Capital Governorate, Bahrain 5 days ago
Engineering Manager for IAM (Identity and Access Management)Manama, Capital Governorate, Bahrain 2 weeks ago
Software Platform Engineering Manager - Ubuntu for Next-Gen SiliconManama, Capital Governorate, Bahrain 3 months ago
Embedded Linux Field Engineering ManagerManama, Capital Governorate, Bahrain 2 weeks ago
Manama, Capital Governorate, Bahrain 3 days ago
Engineering Manager - Security Standards and HardeningManama, Capital Governorate, Bahrain 3 days ago
Linux Enablement - Software Engineering ManagerManama, Capital Governorate, Bahrain 1 month ago
Ubuntu Enablement - Software Engineering ManagerManama, Capital Governorate, Bahrain 1 month ago
Manama, Capital Governorate, Bahrain 1 month ago
Revenue Accounting Manager - Software Industry, IFRS 15, NetSuiteManama, Capital Governorate, Bahrain 3 weeks ago
Manama, Capital Governorate, Bahrain 1 month ago
Manama, Capital Governorate, Bahrain 7 months ago
Product Manager - Industrial Sector LeadManama, Capital Governorate, Bahrain 3 days ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-LjbffrBe The First To Know
About the latest Spark developer Jobs in Bahrain !