ETL Engineer (Hybrid) TS/SCI

Company: Abbtech Professional Resources
Location: Chantilly
Posted on: March 19, 2023

Job Description:

Data Engineer who can leverage experience and expertise in data exploration, engineering, and ETL to explore, architect, develop, and deploy scripts for processing structured and unstructured data into usable data formats for long term storage, search, and analysis.

• Creating a custom ingest pipeline to a Big Data platform with consistent performance and scalability
• Understanding of programming and data engineering concepts and best practice.
• Experience working with both structured, semi-structured, and unstructured data to include data parsing, transformation, schema definition, and query/analysis.
• Ability to manage and organize data while identifying trends and inconsistencies that will impact downstream analytics
• Ability to work both independently and collaboratively.
• High levels of curiosity, creativity, and problem-solving capabilities.
• Strong written and verbal communication skills.
• Experience with data pipelines or be willing to learn a pipeline from bottom to top
• Be able to trouble shoot files against an architecture to see where the upload process is failing.
• Be able to understand unit tests and add to them to increase stability to the entire pipeline.
• Be prepared to use, GIT, JIRA, Confluence, Anaconda, Spyder, and Microsoft tools.
• Be prepared to express ideas and solutions and walk together with teammates through coding challenges

Keywords: Abbtech Professional Resources, Chantilly , ETL Engineer (Hybrid) TS/SCI, Engineering , Chantilly, Virginia