ChantillyRecruiter Since 2001
the smart solution for Chantilly jobs

Senior Data Engineer - TS/SCI CI Poly

Company: Blackspoke
Location: Chantilly
Posted on: July 29, 2022

Job Description:

Customer DescriptionOur Government customer develops and operates unique and innovative reconnaissance systems and conducts intelligence-related activities for U.S. National Security. IT within our customer plays a key role in the success of the WarFighter "boots on the ground" and within the Intelligence Community in order to share actionable intelligence on both mission-enabled systems and those centered on the day to day business aspects within the agency.Program DescriptionProvides services to an Intelligence Community agency with a focus in security and counterintelligence. Program focus areas include analytical services, insider threat analysis support, counterintelligence IT architectures, development, and maintenance, counterintelligence inquiries and referent activities, and surge support on various other counterintelligence initiatives.Team DescriptionOur Insider Threat Detection program is manned by a multi-disciplinary team of system and data engineers, data scientists, software developers, intelligence analysts, and investigators to provide insider threat detection and counterintelligence services. Team members work closely with esteemed customers to develop solutions that allow them to carry out high-stakes national security missions. Our technology stack is built on cutting edge hardware and software with multiple Windows and Linux environments interfacing with multi-petabyte data processing and analytic platforms - all designed, built, and maintained by our team.Job DescriptionThe Data Engineer will help expand and optimize the data ingestion pipeline architecture, develop strategies for efficient ingestion, processing, storage, structuring, and access. The Engineer will support data analysts, data scientists, and big data engineers in identifying data sources, performing exploratory data analysis, developing data structures, ensuring data cleanliness and accuracy to provide new Insider Threat behavioral insights. This position provides an opportunity to further advance the cutting-edge technology that supports some of our nation's core defense/intelligence services and systems. Additional taskings include: Support data science team by designing, developing and implementing scalable ETL process for disparate datasets into a Hadoop infrastructure Design, develop, implement and maintain data ingestion process from various disparate datasets using StreamSets Develop processes to identify data drift and malformed records Modernize the data ingestion architecture Develop technical documentation and standard operating procedures Mentor new and junior data engineers Leads technical tasks for small teams or projectsQualifications TS/SCI Clearance w/ability to obtain CI Poly Bachelor s degree in Engineering, Computer Science, Statistics, Applied Math, or a related technical field is required plus a minimum of 10 years of relevant experience; or Master's degree plus a minimum of 8 years of relevant experience. Agile experience preferred.Desired Core Skills: Working knowledge of entity resolution systems Experience with messages systems like Kafka Experience with Python Experience with NoSQL and/or graph databases like MongoDB or ArangoDB Any of the following databases: SQL, MongoDB, Oracle, Postgres Working experience with ETL processing SQL Server SSIS Recommendations for schema improvements Working experience with data workflow products like StreamSets or NiFi Working experience with Python RESTful API services, JDBC Experience with Hadoop and Hive/Impala Experience with Cloudera Data Science Workbench is a plus Understanding of pySpark Leadership experience Creative thinker Ability to multi-task Excellent use and understanding of data engineering concepts, principles, and theoriesJob Type: Full-timePay: $175,000.00 - $190,000.00 per yearBenefits: 401(k) 401(k) matching Dental insurance Flexible schedule Flexible spending account Health insurance Life insurance Paid time off Parental leave Referral program Retirement plan Tuition reimbursement Vision insuranceSchedule: Monday to FridayApplication Question(s): Do you have an active CI Polygraph?Experience: Python: 5 years (Preferred) Hadoop: 5 years (Preferred) Kafka: 5 years (Preferred) Cloudera: 3 years (Preferred) Data Streams: 3 years (Preferred) ETL: 5 years (Preferred) SSIS: 3 years (Preferred)Security clearance: Top Secret (Required)Work Location: One location

Keywords: Blackspoke, Chantilly , Senior Data Engineer - TS/SCI CI Poly, Engineering , Chantilly, Virginia

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category

Log In or Create An Account

Get the latest Virginia jobs by following @recnetVA on Twitter!

Chantilly RSS job feeds