Data Engineer
Job Description: Data Engineer Experience: 3 -5 Years Location: Remote (Bengaluru) Employment Type: Full-time Notice Period: Immediate Joiner Role Overview We are seeking a skilled Data Engineer with 3+ years of experience in building and maintaining scalable data solutions. The ideal candidate will have hands-on experience across data engineering, data analysis, and visualization, with strong programming fundamentals and the ability to work independently in a remote environment.
Key Responsibilities
Design, develop, and maintain ETL pipelines using PySpark, Apache Airflow, and Azure Data Factory (ADF). Build and optimize distributed data processing jobs using PySpark. Orchestrate and schedule workflows using Apache Airflow. Develop and manage data ingestion and transformation pipelines in Azure Data Factory. Write clean, efficient, and reusable code using Python . Develop and optimize complex SQL queries for MySQL and PostgreSQL databases. Work with MongoDB for handling semi-structured and unstructured data. Perform data analysis using Pandas and NumPy to support business insights. Create basic to intermediate data visualizations using Matplotlib, Power BI, and Streamlit. Monitor data pipelines, troubleshoot issues, and ensure data quality and performance. Collaborate with cross-functional teams including analysts, data scientists, and product teams. Required Skills & Qualifications Programming Languages Proficiency in Python Databases Strong experience with MySQL and PostgreSQL Hands-on exposure to MongoDB Data Engineering Experience building ETL/ELT pipelines Hands-on with PySpark for large-scale data processing Experience using Apache Airflow for workflow orchestration Experience with Azure Data Factory (ADF) Data Analysis & Visualization Hands-on experience with Pandas and NumPy Ability to create visualizations using Matplotlib Experience with Power BI for dashboards and reporting Exposure to Streamlit for building data-driven applications Good to Have Experience with Azure data services (Azure Data Lake, Synapse Analytics). Familiarity with Git and version control best practices. Basic understanding of data warehousing concepts. Exposure to cloud-based deployments and CI/CD pipelines. Apply To This Job