Data Engineer (Remote)
Job Description
Experience with Cloud native Data tools/Services such as AWS Athena, AWS Glue, Redshift Spectrum, AWS EMR, AWS Aurora, Big Query, Big Table, S3, etc. Strong programming skills in at least one of the following languages: Java, Scala, C++. Familiarity with a scripting language like Python as well as Unix/Linux shells. Comfortable with multiple AWS components including RDS, AWS Lambda, AWS Glue, AWS Athena, EMR. Equivalent tools in the GCP stack will also suffice. Strong analytical skills and advanced SQL knowledge, indexing, query optimization techniques. Experience implementing software around data processing, metadata management, and ETL pipeline tools like Airflow. Experience with the following software/tools is highly desired: Apache Spark, Kafka, Hive, etc. SQL and NoSQL databases like MySQL, Postgres, DynamoDB. Workflow management tools like Airflow. AWS cloud services: RDS, AWS Lambda, AWS Glue, AWS Athena, EMR. Familiarity with Spark programming paradigms (batch and stream-processing). RESTful API services.
Job Information
Get Jobs Like This
New The Hub jobs and similar roles, straight to your inbox.
Weekly digest. Unsubscribe anytime.
Considering Relocating for This Job?
Before you apply, see how far your salary will go in India. Compare take-home pay, rent, food & transport costs vs other tech cities.