- Develop, implement, and maintain data pipelines involving multiple data source and huge data volume
- Identify trends and opportunities for growth through analysis of complex data sets Create best-practice reports based on data mining, analysis, and visualization
- Create and maintain rich interactive visualizations through data interpretation and analysis integrating various reporting components from multiple data sources.
Skills and Qualification
- Bachelor's degree in Mathematics, Computer Science
- 3+ year experience mining data as a data engineer
- Strong SQL, Excel, Java, Python skills with the ability to learn other tools
- Hands on Linux CLI & scripting
- Experience in Spark bigdata framework and data warehouses like Redshift/Snowflake
- Experience of working in AWS cloud environment
- Experience of working with Airflow job scheduler