Job Description
Job Duties and Responsibilities Primary responsibilities fall into the following categories bull Deploy enterprise-ready, secure and compliant data-oriented solutions leveraging Data Warehouse, Big Data and Machine Learning frameworks bull Optimizing data engineering and machine learning pipelines bull Reviews architectural designs to ensure consistency alignment with defined target architecture and adherence to established architecture standards bull Support data and cloud transformation initiatives bull Contribute to our cloud strategy based on prior experience bull Understand the latest technologies in a rapidly innovative marketplace bull Independently work with all stakeholders across the organization to deliver point and strategic solutions bull Assist solution providers with the definition and implementation of technical and business strategies Skills - Experience and Requirements A successful Solution Lead will have the following bull Should have prior experience in working as a Data warehouseBig Data architect. bull Experience in advanced Apache Spark processing framework, spark programming languages such as ScalaPythonAdvanced Java with sound knowledge in shell scripting. bull Should have experience in both functional programming and Spark SQL programming dealing with processing terabytes of data bull Specifically, this experience must be in writing Big Data data engineering jobs for large scale data integration in AWS. Prior experience in writing Machine Learning data pipelines using Spark programming language is an added advantage. bull Advanced SQL experience including SQL performance tuning is a must. bull Should have worked on other big data frameworks such as MapReduce, HDFS, HiveImpala, AWS Athena. bull Experience in logical physical table design in Big Data environment to suite processing frameworks bull Knowledge of using, setting up and tuning resource management framework such as Yarn, Mesos or standalone spark. bull Experience in writing spark streaming jobs (producersconsumers) using Apache Kafka or AWS Kinesis is required bull Should have knowledge in variety of data platforms such as Redshift, S3, Teradata, Hbase, MySQLPostgres, MongoDB bull Experience in AWS services such as EMR, Glue, S3, Athena, DynamoDB, IAM, Lambda, Cloud watch and Data pipeline bull Must have used the technologies for deploying specific solutions in the area of Big Data and Machine learning. bull Experience in AWS cloud transformation projects are required. bull Telecommunication experience is an added advantage Thanks, Omprakash M Anira Solutions, Inc
Posting ID: 600638158Posted: 2021-01-19