BigQuery Developer / GCP Data Engineer
Description Role Type Contract position. Engagement options available on W2 or C2C basis. Location Primarily remote. Occasional onsite presence may be required based on project needs. Preference will be given to candidates within driving distance of Woonsocket, RI. Job Title BigQuery Developer / GCP Data Engineer Job Summary We are looking for a motivated and detail-oriented BigQuery Developer with hands-on experience in Google Cloud Platform to support and enhance our enterprise data warehouse and analytics solutions. The ideal candidate will have strong SQL , BigQuery and Python development experience, along with working knowledge of Dataflow, Cloud Composer, GitHub, and CI/CD practices. This role requires strong analytical skills, problem-solving ability, and effective communication to work with cross-functional teams. Key Responsibilities · BigQuery Development (Primary Focus) · Develop, maintain, and optimize BigQuery datasets, tables, views, procedures and queries. · Write efficient and scalable SQL for reporting and analytics. · Implement partitioning and clustering to improve query performance. · Support data warehouse design and data modeling activities. · Monitor query performance and optimize cost usage. · Troubleshoot and resolve data-related issues in BigQuery. · Support data validation and quality checks. Data Pipeline Development · Develop and maintain batch pipelines using Python and Google Cloud Dataflow (Apache Beam). · Load, transform, and integrate data from various sources into BigQuery. · Work on ETL/ELT processes and ensure reliable data processing. · Assist in debugging and performance tuning of pipelines. Workflow Orchestration · Develop and maintain workflows using Cloud Composer (Apache Airflow). · Integrate workflows with Tidal Job Scheduler for enterprise scheduling. · Monitor production jobs and support issue resolution. Version Control & CI/CD · Use GitHub for source control and collaboration. · Contribute to CI/CD pipelines using GitHub Actions. · Follow best practices for code versioning and peer reviews. Collaboration & Communication · Work closely with data analysts, business users, and technical teams. · Translate business requirements into efficient BigQuery solutions. · Document data flows, technical designs, and operational processes. · Provide production support as needed. Requirements · 3–5 years of experience in data engineering or data development. · Strong hands-on experience with BigQuery. · Strong SQL skills (joins, aggregations, window functions, performance tuning). · Experience with Google Cloud Platform (GCP). · Experience building batch pipelines using Python and Dataflow. · Experience with Cloud Composer (Airflow). · Working knowledge of GitHub and GitHub Actions. · Experience with enterprise job schedulers such as Tidal. · Understanding of data warehousing concepts. · Strong analytical and problem-solving skills. · Good verbal and written communication skills. Apply tot his job Apply To this Job Apply To This Job