ETL Engineer III

Company: ABBTECH Professional Resources
Location: Chantilly
Posted on: March 17, 2023

Job Description:

ETL Engineer III
Location: Chantilly, VA (Hybrid)
Clearance: TS/SCI
Data Engineer who can leverage experience and expertise in data exploration, engineering, and ETL to explore, architect, develop, and deploy scripts for processing structured and unstructured data into usable data formats for long term storage, search, and analysis.

• 
  
• 
  Creating a custom ingest pipeline to a Big Data platform with consistent performance and scalability
  
  
• 
  Understanding of programming and data engineering concepts and best practice.
  
  
• 
  Experience working with both structured, semi-structured, and unstructured data to include data parsing, transformation, schema definition, and query/analysis.
  
  
• 
  Ability to manage and organize data while identifying trends and inconsistencies that will impact downstream analytics
  
  
• 
  Ability to work both independently and collaboratively.
  
  
• 
  High levels of curiosity, creativity, and problem-solving capabilities.
  
  
• 
  Strong written and verbal communication skills.
  
  
• 
  Experience with data pipelines or be willing to learn a pipeline from bottom to top
  
  
• 
  Be able to trouble shoot files against an architecture to see where the upload process is failing.
  
  
• 
  Be able to understand unit tests and add to them to increase stability to the entire pipeline.
  
  
• 
  Be prepared to use, GIT, JIRA, Confluence, Anaconda, Spyder, and Microsoft tools.
  
  
• 
  Be prepared to express ideas and solutions and walk together with teammates through coding challenges
  
  
  Qualifications
  Required Qualifications:
  
  • 
    
  • 
    Six years experience with ETL with experience in following:
    
    
  • 
    Oracle 11g/12c, Sun Solaris OS, Linux (CentOS, Red Hat), and Windows environments
    
    
  • 
    Performing software and scripting engineering for data ingest with Java or Python for ETL
    
    
  • 
    Web services and/or microservices
    
    
  • 
    ETL tools such as NiFi or Informatica
    
    
  • 
    Using software repository tools such as GIT or SVN
    
    
  • 
    A current Top Secret security clearance with SCI eligibility and the ability to obtain a polygraph.
    
    
    Desired Qualifications:
    
    • 
      
    • 
      Have knowledge of Databricks, Scala, Python, and PySpark
      
      
    • 
      Have experience tuning complex SQL queries
      
      
    • 
      Experience with the AWS and Data Ingest/Transformation processes
      
      
    • 
      Have?worked in an Agile?environment.?
      
      
    • 
      You have worked on teams that practice Agile methodologies.?
      
      
      ABBTECH is an EOE/Minorities/Women/Disabled Individuals/Veterans

Keywords: ABBTECH Professional Resources, Chantilly , ETL Engineer III, Engineering , Chantilly, Virginia