BIG DATA ENGINEER Responsibilities
Designs, modifies, develops, writes and implements software systems. Participates in software and systems testing, validation, and maintenance processes through test witnessing, certification of software, and other activities as directed. Provides support to senior staff on projects/programs. Familiar with standard concepts, practices, and procedures within a variety of fields related to the project. This position takes direction from senior technical leadership. The Big Data Engineer (BDE) is responsible for building the next generation of web applications and systems focusing on capability delivery to end users. The BDE is a member of a "big data" team of specialists within the multi-disciplinary agile development team. The BDE will manage requirements collection, software design, development, and delivery - full lifecycle - in support of analysts. The BDE helps manage effective processes associated with the architecture. The BDE collaborates closely with the Agile Software Developer (ASDs), Technical Targeting Developer (TTDs), and the end user analysts to write and implement cutting-edge, big data algorithms and analytics. The BDE engages in software solution planning and creation to ensure capabilities are delivered using the latest available technologies and methods. The BDE will operate in a "RAD/JAD" environment in which tasks are rapidly defined and then executed to ensure maximum user input, feedback, and adoption. The BDE ensures the interoperability of the in-house capability with outside partners. Qualifications
We welcome all applications. Minimum Qualifications: Five years of experience Proficiency in two or more of the following programming languages: C#, Java, .NET, Python, Perl, Ruby, or similar Familiarity with current Agile methods roficiency with the following: Multiple operating systems including: UNIX, Linux, Windows, Cisco IOS, etc. Machine learning, data mining, and knowledge discovery Analytic algorithm design and implementation ETL processes, including document parsing techniques Networking, compute, and storage technologies Using or designing RESTful APIs, SOAP, XML Developing large cloud software projects, preferably in Java, Python or C++ language Java/J2EE, multithreaded, and concurrency systems Multi-threaded, big data, distributive cloud architectures and frameworks including Hadoop, MapReduce, Cloudera, Hive, Spark, Elasticsearch, etc. for the purposes of conducting analytic algorithm design and implementation NoSQL database such as Neo4J, Titan, Mongo, Cassandra, and hBase AWS Services (EC2, Network, ELB, S3/EBS, etc) Processing and managing large data sets (multi-PB scale) Web services environment and technologies such as XML, KML, SOAP, and JSON Proficiency in troubleshooting in very complex distributed environments, including following stack traces back to code and identifying a root cause Preferred Qualifications: Education - Masters Degree in Computer Science or related field (e.g. Statistics, Mathematics, Engineering) - but a technical Bachelor of Science degree will suffice Distributed computing-based certifications Proficiency with the following: Management/tracking utilities such as Jira, Redmine, or similar Running Internet facing or Service Level Agreement (SLA'd) auto-deployed environments Real-time media protocols (Real-time Transport Protocol (RTP), Secure Real-time Transport Protocol (SRTP)) Data transfer systems such as NiFi Text processing: NPL, NER, entity retrieval (e.g. Solr/Lucene), topic extraction, summarization, clustering, etc. Certification from an Agile certified institute, International Consortium for Agile, Scaled Agile Academy, Scrum Alliance, Scrum.org, International Scrum Institute, ScrumStudy, Project Management Institute - Agile Certified Practitioner, or similar XP/Scrum certification or training is desired Support to SOF; previous experience with technology, intelligence, and cyber under the umbrella of USSOCOM Education: Bachelor of Arts or Bachelor of Science in Computer Science or related fields (e.g. Statistics, Mathematics, Engineering), or equivalent in years of experience, or demonstrates adequate knowledge for the position.