Data Engineer

Core Java: advanced level competency, should have worked on projects with core Java development. Linux shell : advanced level competency, work experience with Linux shell scripting, knowledge and experience to use important shell commands Rdbms, SQL: advanced level competency, Should have expertise in SQL query language syntax, should be well versed with aggregations, joins of SQL query language. Data structures and problem solving: should have ability to use appropriate data structure. AWS cloud : Good to have experience with aws serverless toolset along with aws infra Data Engineering ecosystem : Good to have experience and knowledge of data engineering, ETL, data warehouse (any toolset) Hadoop, HDFS, YARN : Should have introduction to internal working of these toolsets HIVE, MapReduce, Spark: Good to have experience developing transformations using hive queries, MapReduce job implementation and Spark Job Implementation. Spark implementation in Scala will be plus point. Airflow, Oozie, Sqoop, Zookeeper, Kafka: Good to have knowledge about purpose and working of these technology toolsets. Working experience will be a plus point here.