Position / Designation: Big Data Administrator
Experience: 3 to 5 years
Qualification: Any Graduate
Job Type: Permanent with SRIK || Job location: Bangalore // Pune
Big Data Administration experience on below technologies.
1. Azure Data lake Gen 1
2. Azure Data Factory
3. Kubernetes
4. Apache Airflow
5. Apache Hive
6. Apache Spark
Key Skills / Responsibilities:
Azure resources creation for the spring Boot or other modules through terraform scripts, which were being in the bit bucket repo.
· Azure Kubernetes, clusters level in all prod and non-prod regions workloads with svc, ingress through yaml files of jenkins job auto deployment.
· App gateway integration with AKS clusters of ingress ip's routing values, along with health actuators of prod and non-prod customised domain URL's.
· Storage accounts integration with key vaults of the Service principals.
· metrics logging integration with datadog for the aks clusters through scripts and commands.
· Service bus integration of queues, topics->subscriptional filters with module specific.
- Deploying a Hadoop cluster, maintaining a Hadoop cluster, adding and removing nodes using cluster monitoring tools like Ganglia Nagios or Cloudera Manager etc.
- Monitor Hadoop cluster connectivity and security.
- Monitor the health of the platforms Generate Performance Reports and Monitor and provide continuous improvements.
- Perform optimization, debugging and capacity planning of a Big Data cluster
- Working closely with development, engineering and operation teams, jointly work on key deliverables ensuring production scalability and stability.
Comments
Post a Comment