JOIN OUR TEAM
Responsibilities
  • Develop and maintain data pipelines implementing ETL processes.
  • Take responsibility for Hadoop development and implementation.
  • Work closely with a data science team implementing data analytic pipelines.
  • Help define data governance policies and support data versioning processes.
  • Maintain security and data privacy working closely with Data Protection Officer internally.
  • Analyse a vast number of data stores and uncover insights.
Skillset Required
  • Ability to design, build and unit test the applications in Pyspark.
  • Experience with Python development and Python data transformations.
  • Experience with SQL scripting on one or more platforms Hive, Oracle, PostgreSQL, MySQL etc.
  • In-depth knowledge of Hadoop, Spark, and similar frameworks.
  • Strong knowledge of Data Management principles.
  • Experience with normalizing/de-normalizing data structures, and developing tabular, dimensional and other data models.
  • Have knowledge about YARN, cluster, executor, cluster configuration.
  • Hands on working in different file formats like Json, parquet, csv etc.
  • Experience with CLI on Linux-based platforms.
  • Experience analysing current ETL/ELT processes, define and design new processes.
  • Experience analysing business requirements in BI/Analytics context and designing data models to transform raw data into meaningful insights.
  • Good to have knowledge on Data Visualization.
  • Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources.
Apply For Pyspark Developer

    Your Details





    About You


    Your Career & Experience




    THE VALUES WE SHAREWhy To Join Our Team
    People

    Our people are simply the best! we make sure that everyone feels seen, satisfied, appreciated, listened to, and fulfilled.

    Teamwork

    Several heads are better than one – in teams, we get to know different perspectives, exchange experiences, and motivate each other. you can do far more with a loyal squad.

    A partnership approach

    Everyone’s voice in the company is equally important. When you fell that you have a real influence on the company, you enrich your creativity, confidence, and motivation.