Cleared Data Engineer

OptiSource. We are professional, agile and our goal is to We are a fast growing company with existing funded contracts. We are always looking for talent in data engineering field. Currently we are teamed up with high end research groups and university to build innovative AI/ML solutions to be deployed in an enterprise. The opportunity allows building of cutting edge skill and ability to work with decision makers one on one. Clearance Requirement TS/SCI/CI Poly preferred but will entertain qualified candidates with TS Clearance Work Locations - Reston or Washington DC Job Overview We are seeking a talented Data Engineer to join our team. The ideal candidate will play a crucial role in designing, developing, and maintaining data pipelines, data stores, and infrastructure to support data analytics and machine learning initiatives. Responsibilities - Build entity extraction capabilities within existing data pipeline or build new data pipeline - Design and implement scalable data pipelines for both batch and real-time processing - Develop and maintain data engineering processes to move data between systems - Collaborate with cross-functional teams to understand data requirements and provide solutions - Build and optimize data models for analytics and reporting purposes - Implement data security and privacy measures - Monitor system performance and troubleshoot issues proactively Skills - Proficiency in Agile methodologies for software development - Experience implementing NLP, NLU, NLG and LLM preferred - Experience with tools like Apache NiFi, Airflow, AWS, Spark for big data processing - Strong understanding of data warehouse concepts and best practices. Primary data stores of interest are Postgres and SQL Server - Knowledge of Elasticsearch and MongoDB is preferable - Knowledge of Python for building robust applications - Familiarity with model training techniques and analytics processes If you are a passionate Data Engineer with a strong background in ETL, big data technologies, and software development methodologies, we encourage you to apply. Join us in driving innovation through data-driven solutions.