Data engineer ( Databricks )

Role Category: Programming & Design
Role: Data engineer
Job Location: Jaipur or Remote
Experience: 0-3 years 

Job Description

We are seeking a skilled and motivated Data Engineer with Databricks certification to join our team. In this role, you will play a key part in designing, building, and maintaining data pipelines and infrastructure that support our analytics and business intelligence initiatives. Your expertise with Databricks and data engineering will be critical in driving data-driven decision-making and optimizing data processes.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines and ETL processes to support data ingestion, transformation, and storage.
  • Work with Databricks to create and manage robust data processing workflows and optimize the performance of data applications.
  • Implement and maintain data lakes and data warehouses on cloud platforms (e.g., AWS, Azure, or GCP).
  • Collaborate with data scientists, analysts, and other stakeholders to understand data needs and provide reliable data solutions.
  • Ensure data quality, integrity, and security across all data engineering processes.
    Monitor, troubleshoot, and optimize data pipelines to ensure high availability and performance.
  • Stay current on industry best practices and tools in data engineering and Databricks.

Requirements

  • Databricks certification (e.g., Databricks Certified Data Engineer Associate or Professional).
  • Proven experience in data engineering, with a strong understanding of ETL/ELT processes.
  • Hands-on experience with Databricks, Spark, and cloud platforms (AWS, Azure, or GCP).
  • Proficiency in SQL and experience with Python or Scala for data processing.
  • Experience with data warehousing concepts and tools (e.g., Snowflake, Redshift, BigQuery).
  • Familiarity with CI/CD processes and version control (e.g., Git).
  • Strong problem-solving skills and ability to work collaboratively in a team environment.

Preferred Qualifications

  • Experience with data lake architectures and big data technologies.
  • Knowledge of data governance and best practices in data management.
  • Excellent communication skills to work effectively with cross-functional teams.