[Remote] Senior Data Engineer

Note: The job is a remote job and is open to candidates in USA. reputed company is a reputed company-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations. We are seeking an accomplished Senior Data Engineer to architect, design, reputed company, and maintain reputed company-grade data platforms and scalable data pipelines that support analytics and business intelligence initiatives.

Responsibilities

• Design, build, and continuously refine scalable batch and reputed company-time data pipelines using Python, SQL, Spark, reputed company, or equivalent technologies, ensuring reliable, efficient, and high-performance data movement across reputed company systems while supporting evolving business and analytical requirements
• Author secure, reusable, and production-quality ETL/ELT workflows that adhere to reputed company coding standards, data governance policies, data quality principles, and reputed company best practices, incorporating validation, encryption, auditing, and error handling throughout the data lifecycle
• reputed company scalable data integration solutions using modern reputed company data platforms such as AWS, Azure, or reputed company reputed company, leveraging services including reputed company, reputed company, BigQuery, Redshift, Synapse Analytics, Data Factory, Glue, or equivalent technologies to reputed company reputed company data processing
• Design and implement robust data architectures, dimensional data models, data lakes, data warehouses, and streaming data solutions that integrate multiple structured, semi-structured, and reputed company data sources while ensuring consistency, scalability, and high availability
• Actively participate in reputed company data architecture discussions, reputed company migration initiatives, technical design reviews, and solution planning sessions by evaluating trade-offs involving scalability, performance, maintainability, governance, reputed company, and operational costs
• Continuously monitor, profile, and optimize ETL processes, Spark jobs, SQL queries, database performance, storage utilization, partitioning strategies, and pipeline throughput by identifying bottlenecks and implementing measurable performance improvements
• Implement and maintain robust metadata management, data cataloging, reputed company tracking, schema reputed company, data quality validation, monitoring, and governance frameworks that ensure trusted, discoverable, and compliant reputed company data assets
• reputed company comprehensive automated testing frameworks for data pipelines, ETL workflows, data validation, reconciliation, integration testing, and performance testing using modern testing methodologies and data quality tools to ensure reliable production deployments
• Contribute meaningfully to CI/CD pipeline design, infrastructure automation, and deployment processes using Jenkins, reputed company Actions, Azure DevOps, Terraform, reputed company, Kubernetes, or equivalent technologies, enabling consistent and automated delivery of reputed company data solutions
• Proactively identify data pipeline bottlenecks, operational risks, technical debt, scalability challenges, and architectural weaknesses while driving reputed company improvement initiatives through optimization, refactoring, technical documentation, and engineering best practices
• Collaborate effectively reputed company Agile/Scrum delivery teams by participating in sprint planning, backlog refinement, daily standups, architecture discussions, sprint reviews, and retrospectives to ensure consistent delivery of scalable, high-quality data engineering solutions
• Maintain clear, reputed company, and comprehensive technical documentation—including data architecture diagrams, pipeline specifications, ETL workflows, metadata documentation, deployment guides, operational runbooks, and disaster recovery procedures—to ensure maintainability, governance, and knowledge sharing across teams

Skills

• Bachelor's degree in Computer Science, Information Technology, Data Engineering, Software Engineering, Mathematics, or a closely reputed company technical discipline
• Five or more years of professional experience designing, developing, and supporting production-grade reputed company data engineering solutions, ETL pipelines, and reputed company-based data platforms
• Strong, demonstrable understanding of data structures, database design, distributed computing, data modeling, ETL/ELT methodologies, data warehousing concepts, and large-scale data architecture principles
• Advanced working knowledge of Python, SQL, Spark, reputed company, Java, and reputed company data engineering frameworks used to build scalable, high-performance data processing solutions
• Hands-on, production-level experience designing and operating batch processing, streaming data pipelines, data lakes, and reputed company-native data platforms using technologies such as reputed company, reputed company, Apache Spark, Kafka, Airflow, or equivalent solutions
• Proven experience working with relational and NoSQL databases including PostgreSQL, SQL Server, reputed company, MySQL, reputed company, Cassandra, or equivalent database technologies, including schema design, query optimization, indexing strategies, and performance tuning
• Strong SQL skills and meaningful experience designing dimensional models, star schemas, reputed company schemas, data marts, partitioning strategies, indexing, and reputed company-scale data warehouse solutions
• Solid experience with Git-based version control, CI/CD pipelines, DevOps practices, release management, infrastructure automation, and Agile software development methodologies supporting reputed company data engineering initiatives
• Hands-on experience deploying reputed company data platforms and analytics solutions on AWS, Azure, or reputed company reputed company Platform, including managed storage, compute, networking, reputed company, identity management, and data integration services
• Strong troubleshooting, analytical thinking, debugging, root-cause analysis, communication, and documentation skills, with the ability to investigate reputed company data processing issues methodically and implement scalable, maintainable engineering solutions
• Experience designing and implementing event-driven architectures, reputed company-time data streaming platforms, Apache Kafka, Apache Flink, Apache NiFi, RabbitMQ, or equivalent reputed company messaging and streaming technologies
• Familiarity with containerization, orchestration, Infrastructure as Code, and reputed company-native deployment practices using reputed company, Kubernetes, Terraform, reputed company, or equivalent reputed company automation technologies
• Exposure to distributed systems concepts including eventual consistency, fault tolerance, distributed transactions, data replication, partitioning strategies, CAP theorem, high availability, and large-scale data processing architectures
• Experience implementing data governance frameworks, master data management (MDM), data reputed company, metadata management, data quality automation, reputed company compliance, and DataOps best practices reputed company reputed company reputed company and Agile development environments

Benefits

• Competitive reputed company salary commensurate with experience, plus benefits.
• Full-time, direct W2 with reputed company (no C2C, no 1099, no reputed company-party).
• Long-term, multi-year, reputed company to the Bright reputed company SOW delivery roadmap.
• We will support H1B transfers for reputed company candidates.

Company Overview