Remote/ On-site Spark Developer - Варна

Описание

A custom development company, MentorMate is a design and software powerhouse with mature and established practices in Enterprise Web & Mobile Development, Human-Centered Design, Cloud & DevOps, Advanced Data Мanagement & Analytics. For our Data & Analytics Center of Excellence (DCOE) we are looking to hire an experienced Spark Developer.

As a Spark Developer in DCOE, your primary goal will be to offer non-standard solutions and unlock the potential of our clients. Through expert-level data management and analysis, the DCOE team facilitates resource management, database migration to new engine types, data unification, and company mergers. SQL reports optimization, Business Intelligence reports, and troubleshooting of data flows are another significant part of our day-to-day responsibilities. Our software solutions tackle specific tech challenges across several industries. While our roots are in education, nearly half of our current projects are focused on healthcare. We also innovate in finance, real estate, commerce, IoT, and others.

As a top engineering employer, run by engineers, MentorMate provides challenging careers in a friendly, people-oriented environment. We value our employees and share our success through competitive pay and benefits, advancement opportunities, and flexible working models.
Responsibilities
• Align architecture with business requirements
• Analyze, re-architect, and re-platform data warehouses
• Guide strategic customers as they implement transformational big data projects, including end-to-end design, build and deployment of industry-leading big data and AI applications
• Identify ways to improve data reliability, efficiency, and quality
• Develop, construct, test, and maintain data pipelines for multiple analytics functions
• Use your expertise in data engineering best practices to guide customers to do the same
Requirements
• 3+ years of experience with databases and data warehousing
• 3+ years of experience with ETL, data modeling, and data architecture
• Experience in using of Python/ PySpark and/or Scala for data engineering
• Experience with any Big Data technologies such as Databricks, Spark, Hadoop, Kafka, Flink, Storm
• Кnowledge on Apache Spark internals
• Experience in developing simple Spark notebooks to analyze customer usage data
• Experience in operating very large data warehouses or data lakes
• Experience with building data pipelines and applications to stream and process large datasets at low latencies
• AWS/ Azure or OCI
• Ability and desire to learn new languages and technologies
• Attention to detail and strong documentation skills
• Fluent English both written and verbal
A significant advantage would be an experience with
• SQL/SparkSQL/Python/PySpark/Scala
• ETL tools like Airflow, Talend, Mattilion, Informatica, ODI, SSIS
• Delta Lake and MLflow
• Oracle, MS SQL Server, MySQL, PostgreSQL, AWS Redshift, Azure Synapse, Snowflake, DynamoDB
• Designing and implementing batch and stream data processing pipelines
• Certification of SQL, PL/SQL, T-SQL, Python, Databricks
Career
Development
• Professional growth in a global company
• Meaningful enterprise projects
• Latest technologies to choose from
• Work side-by-side with top engineers
• Challenging problems to solve
• A career path with regular salary increases
• Individual learning budget
• Internal technical and soft skills trainings
• Leadership program
• Business English classes
Work &
Life Balance
• Remote or hybrid working model
• Five offices in Bulgaria to work from
• Additional paid time off for loyal employees
• Regular team gatherings
• Employee Referral program
• Gamification incentive program
• Diverse working environment
• State-of-the-art offices
• Internal communities of interest
• Charity and volunteer activities
• Metro Station next to the office (Sofia)
• MentorBikes to use
Flexible
Benefits
• Additional health and dental insurance
• Investment savings account plan
• Additional voluntary pension insurance
• Different types of insurances to choose from
• Covered transport expenses
• Parking (Sofia)
• Multisport card
• Qualified electronic signature

Изисквания към кандидата

Езикови познания:
Английски език

Трудов опит:
С професионален опит над 3 г.

Образование:

Ние предлагаме

Вид заетост:
Пълен работен ден

Срок на заетост:
Постоянна

Договор:

Ниво в йерархията:

Категория:

ИТ и Компютърни специалисти

Държава:

България

Населено място:

Гр. Варна

Адрес:

гр. София, бул.\"Проф. Цветан Лазаров\\\\\\\" 67

Дата:

02.02.2022

Организация:

MentorMate
Фирма/Организация - Директно търсеща служители

Детайли за организацията:

Повече информация за MentorMate може да получите ТУК