Data Engineer For Python
Job Description
We are looking for a smart candidate with: Strong Python Coding skills and OOP skills Should have worked on Big Data product Architecture Should have worked with any one of the SQL-based databases like MySQL, PostgreSQL and any one of NoSQL-based databases such as Cassandra, Elasticsearch etc. Hands on experience on frameworks like Spark RDD, DataFrame, Dataset Experience on development of ETL for data product Candidate should have working knowledge on performance optimization, optimal resource utilization, Parallelism and tuning of spark jobs Working knowledge on file formats: CSV, JSON, XML, PARQUET, ORC, AVRO Good to have working knowledge with any one of the Analytical Databases like Druid, MongoDB, Apache Hive etc. Experience to handle real-time data feeds (good to have working knowledge on Apache Kafka or similar tool) Key Skills: Python and Scala (Optional), Spark / PySpark, Parallel programming
Job Information
Get Jobs Like This
New A2Tech Consultants jobs and similar roles, straight to your inbox.
Weekly digest. Unsubscribe anytime.
Considering Relocating for This Job?
Before you apply, see how far your salary will go in Pune. Compare take-home pay, rent, food & transport costs vs other tech cities.