Data by YubHub
Data Engineer
Leidos
Sponsorship not confirmed
You apply on the original listing. Flieva never charges you to apply and never asks for payment for a job.
About the job
The Homeland Sector at Leidos currently has an opening for a Data Engineer with a strong background in data analytics to support an exciting DHS software development program. The Data Engineer is responsible for designing, developing, implementing, and maintaining the data architecture, pipelines, integrations, and data structures required to transform raw operational data into reliable, accessible, and analysis-ready information. Data Architecture and Engineering Design logical and physical data models appropriate for analytical workloads. Develop data structures that integrate information from multiple applications, databases, files, APIs, logs, and external data sources. Evaluate existing data architectures and recommend improvements to reliability, scalability, performance, maintainability, and accessibility. Support the design and implementation of data warehouses, data marts, data lakes, lakehouses, and other analytical data repositories as appropriate. Data Integration and Pipelines Design, develop, test, deploy, and maintain ETL/ELT processes and automated data pipelines. Extract and integrate data from relational databases, applications, APIs, flat files, logs, and other structured and semi-structured sources. Develop repeatable processes for transforming raw transactional data into standardized, analysis-ready datasets. Implement scheduling, orchestration, monitoring, error handling, and recovery capabilities for data pipelines. Develop interfaces and data feeds supporting downstream reporting, dashboards, analytics platforms, and external systems. Data Transformation and Quality Clean, normalize, deduplicate, validate, and transform data. Investigate data discrepancies and work with application developers, database administrators, analysts, and business users to determine root causes. Implement controls that prevent data-quality problems from propagating into downstream reports and analytical products. Business Intelligence and Analytics Support Develop curated datasets and data models optimized for BI, reporting, visualization, and analytical workloads. Work with BI analysts and business stakeholders to translate business questions into data requirements. Support development of common definitions and calculation methodologies for enterprise metrics and key performance indicators (KPIs). Support ad hoc analytical requests when new data sources or transformations are required. Assist analysts in understanding data lineage, relationships, limitations, and appropriate use. Data Governance and Documentation Document data sources, transformations, interfaces, business rules, dependencies, lineage, and data definitions. Maintain technical documentation for data pipelines, models, interfaces, and analytical repositories. Support development and maintenance of data dictionaries and metadata repositories. Database and Performance Engineering Develop and optimize complex SQL queries, stored procedures, views, and data transformations. Analyze and improve performance of analytical queries and data-processing workloads. Work with Database Administrators (DBAs) to optimize database structures supporting analytical requirements. Recommend indexing, partitioning, aggregation, caching, or other techniques where appropriate. Ensure analytical workloads do not adversely affect production transactional systems. Security and Compliance Implement data-engineering solutions consistent with organizational cybersecurity and privacy requirements. Apply appropriate access controls to sensitive data. Support data classification, encryption, auditing, logging, retention, and protection requirements. Work with cybersecurity personnel to ensure data movement and storage comply with applicable security requirements. Support protection of sensitive information, including PII and other controlled or restricted data. Software Engineering and DevSecOps Develop maintainable data-engineering code using established software development practices. Mainta
More jobs like this
Recruiter, CommunicationsAnthropicSan Francisco, CA | New York City, NY · United StatesSponsorship stated in listingResearch Scientist, Discovery (Engineering & Applied Sciences)AnthropicSan Francisco, CA | New York City, NY · United StatesSponsorship stated in listingResearch Engineer, Cybersecurity RLAnthropicSan Francisco, CA | New York City, NY · United StatesSponsorship stated in listingSecurity Engineer (Research Infrastructure)ResolutionBerkeley, California · United StatesSponsorship stated in listing
Flieva