HADOOP Engineer

Company: Decisive Point Consulting
Location: Chantilly
Posted on: August 4, 2022

Job Description:

Program Mission--- The CDF program is an evolution for the way DoD programs, services, and combat support agencies access data by providing data consumers (e.g., systems, app developers, etc.) with a "one-stop shop" for obtaining ISR data. The CDF significantly increases the DI2E's ability to meet the ISR needs of joint and combined task force commanders by providing enterprise data at scale. The CDF serves as the scalable, modular, open architecture that enables interoperability for the collection, processing, exploitation, dissemination, and archiving of all forms and formats of intelligence data. Through the CDF, programs can easily share data and access new sources using their existing architecture. The CDF is a network and end-user agnostic capability that enables enterprise intelligence data sharing from sensor tasking to product dissemination. Essential Functions: Primarily responsible for operating and sustaining an MDM Platform-as-a-Service (Paas) instance in support of a Data Transformation team and their customers. In this role, you will:

• Deploy and maintain platform in accordance with network, compute, government, and network infrastructure requirements
• Monitor and manage the fielded platform to include any newly developed data integration capabilities, ensuring the highest availability factor for the platform
• Work closely with the MDM Platform Security Accreditation Specialist to achieve and maintain an Authority to Operate (ATO), to include full support for continuous monitoring (ConMon)
• Coordinate with appropriate vendors for all required professional services needed in support of software / tools / technologies deployed within the MDM PaaS
• Aid Developers in designing solutions for customer required transformations
• Document SOPs related to MDM instance deployments, configurations, transforms/crosswalks, maintenance, and monitoring requirements Required Experience
  • Active TS/SCI CI Poly clearance
  • DoD 8570 IAT Level II Certification
  • Experience conducting technical evaluations and trade studies
  • Understanding of foundational ETL concepts and COTS/FOSS ETL tools.
  • Strong understanding and experience with Solr & Java
  • Demonstrable CentOS command line knowledge, and working knowledge of RESTful APIs
  • Advanced organizational skills with the ability to handle multiple assignments
  • Strong written and oral communication skills
  • Years of Experience : 12 years of experience or more. Education : Bachelor's degree in systems engineering, computer engineering, or a related technical field
  • Clearance : Active TS/SCI w/ ability to obtain CI Poly Desired Experience:
    • A minimum of 10 years of experience with programming and software development including analysis, design, development, implementation, testing, maintenance, quality assurance, troubleshooting and/or upgrading of software systems
    • Full Stack Back End Java Software Development
    • A minimum of 5 years of experience with Solr to include ingest, management, & tuning.
    • A minimum of 3 year of experience designing and implementing automated build and deployment pipelines and supporting platform
    • Working understanding of HBase, WebHDFS, and Apache Zookeeper.
    • Responsible for using best practices, such as unit test integration, to ensure high code quality standards are met
    • Strong understanding of AWS cloud infrastructure
    • Working knowledge of web services environments, languages, and formats such as RESTful APIs, SOAP, FTP/SFTP, HTML, JavaScript, XML, and JSON
    • Experience in Java and Spring frameworks to develop enterprise applications
    • Experience with testing frameworks and tools
    • Working knowledge of agile lifecycle management tools such as JIRA and Confluence
    • Experience working with source code repositories/Git.
    • Experience on most phases of application development activities with minimal supervisory guidance
    • Experience with unit and integration testing of the developed software
    • Coordinates and performs requirements and implementation analysis, design, development, testing and enhancement of application software Location : Chantilly, VA EEO Minority/Disabled/Veteran/Female PI186509445

Keywords: Decisive Point Consulting, Chantilly , HADOOP Engineer, Engineering , Chantilly, Virginia