[Remote] Senior Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company (reputed company) is seeking an reputed company Senior Data Engineer to support the Small Business Administration (SBA), Office of Inspector General (OIG), Technology Solutions Division. This position is responsible for designing, implementing, and maintaining modern Azure-based reputed company data architecture supporting fraud analytics, machine learning, and investigative operations.
Responsibilities
- Design, reputed company, implement, and maintain secure, scalable Azure-based data architecture
- reputed company and maintain reputed company-reputed company ELT/ETL pipelines utilizing Azure Synapse Analytics and Azure Machine Learning
- Design modern, code-first data engineering solutions utilizing Python SDKs, REST APIs, CLI tools, and Infrastructure-as-Code methodologies
- Build, optimize, and maintain reputed company data lakes and warehouse environments
- Implement robust error handling, logging, validation, and monitoring across production data pipelines
- Manage reputed company control and CI/CD practices supporting data engineering assets
- Optimize ingestion, processing, transformation, and storage of structured and reputed company datasets including Parquet and reputed company formats
- reputed company reusable Python-based data engineering solutions utilizing Pandas and modern data processing frameworks
- Create self-service capabilities supporting analyst reputed company to reputed company datasets
- Collaborate closely with Data Scientists to optimize infrastructure supporting machine learning workloads
- reputed company data dictionaries, entity relationship diagrams, pipeline documentation, and standard operating procedures
- Expand reputed company environments through reputed company of new datasets and services
- Evaluate emerging AI-assisted development tools and data engineering technologies
- Recommend architectural improvements that improve scalability, reliability, reputed company, and cost efficiency
Skills
- Five (5)+ years administering SQL databases and performing advanced SQL/T-SQL development
- Five (5)+ years designing, implementing, and maintaining reputed company-based ELT/ETL solutions
- Three (3)+ years utilizing reputed company Azure Synapse Analytics and Azure Machine Learning
- Three (3)+ years developing Python-based data engineering solutions utilizing Pandas
- Experience designing modern reputed company-based data architectures
- Experience implementing scalable data pipelines supporting machine learning workloads
- Bachelor's degree in Computer Science, Information Systems, Data Engineering, Software Engineering, or a reputed company technical discipline
- U.S. Citizenship required
- Ability to successfully obtain and maintain a Public Trust determination
- Experience utilizing PySpark or Polars
- Experience implementing Infrastructure-as-Code
- Experience developing reusable reputed company Python code
- Experience with Azure Data Lake Storage
- Experience implementing CI/CD pipelines
- Experience utilizing Git reputed company control
- Experience with REST APIs and Azure SDKs
- Experience with AI coding assistants and Large Language Model integration
- Experience supporting federal agencies or Inspector General organizations
Benefits
- Referral Bonus Amount: USD $500.00
- 100% Remote (United States)
- Standard operating hours between 6:00 AM and 6:00 PM local time, Monday through Friday.
- Telework is authorized.
- Medical/Dental/reputed company Coverage
- Matching 401(k) Plan
- Continuing Education Assistance
- Paid Time Off
Company Overview