Data Engineer

  • Develop, implement, and maintain data pipelines involving multiple data source and huge data volume
  • Identify trends and opportunities for growth through analysis of complex data sets Create best-practice reports based on data mining, analysis, and visualization
  • Create and maintain rich interactive visualizations through data interpretation and analysis integrating various reporting components from multiple data sources.

Skills and Qualification

  • Bachelor's degree in Mathematics, Computer Science
  • 3+ year experience mining data as a data engineer
  • Strong SQL, Excel, Java, Python skills with the ability to learn other tools
  • Hands on Linux CLI & scripting
  • Experience in Spark bigdata framework and data warehouses like Redshift/Snowflake
  • Experience of working in AWS cloud environment
  • Experience of working with Airflow job scheduler