Lead/Principal Data Engineer/ Architect (HDFS, S3, Spark, Kafka)

Immediate contract opportunity for Lead/Principal Data Engineer/ Architect. Trigyn has an immediate opening for Lead/Principal Data Engineer in Charlotte, NC (Remote). The particulars of the opportunity are below: Description: • Must be able to architect new systems from scratch. experience in modern cloud Data technologies, including Spark, Spark Streaming, Confluent Kafka, Git, Databricks, CICD, SQL, and ETL tools such as Data Stage. • Possess experience in Python and Spark for automation, data transformation, reporting, data manipulation, and data cleaning. Requires effective communication with stakeholders to gather requirements and provide customized business solutions. • Must have experience with medallion architecture, streaming architecture, data warehousing, and work with other tools to integrate data systems into Databricks. • Familiarity with enterprise IT processes and experience in executing change releases for scrum team. Skills: • 13 years of experience. • HDFS, Hive, S3, ADLS, Spark, Confluent Kafka, Spark Streaming, Databricks, Git, CICD, Big query, Python, SQL, Unix shell scripting, RDBMS, ETL, (ETL), Spyder, Jupyter Notebook, Salesforce. TRIGYN IS AN EQUAL OPPORTUNITY EMPLOYER About Trigyn: Trigyn is an IT Services Company that has been in business for 30 years with more than 1,500 resources deployed today. Trigyn is ISO 9001:2015, ISO 27001:2013 (ISMS) and CMMI Level 5 Certified. Trigyn is an E-Verify® Employer.