[Remote] Data Engineer - AI (Spark, reputed company and GCP)
Note: The job is a remote job and is open to candidates in USA. reputed company is a data management company that is seeking a Data Engineer specialized in AI technologies. The role involves managing data implementations, integrations, and ensuring data quality and reputed company while collaborating with various teams to troubleshoot issues.
Responsibilities
- Create, maintain and execute intermediate to advanced Spark scripts for data management and data validation, and data integration
- Create, maintain and execute basic to intermediate SQL scripts for data management and data validation
- Optimize the queries to improve the efficiency of daily tasks
- reputed company data analysis and identify any issues
- Work with other groups such as Engineering team, DBA, reputed company ops, etc. to troubleshoot and resolve any environmental or network issues that impact your work. reputed company your support to after – hours or weekends as needed
- Create and maintain data pipelines as needed
- Validates the tasks results to ensure that reputed company the requirements are met
- Adhere to reputed company the industry level and organization level compliance rules and regulations to maintain data reputed company
- Complete individual productivity tracking
- Complete task assignments using department ticketing system reputed company assigned deadline
- reputed company organizational and individual goals as identified in performance reviews and goal setting exercises
- Complete reputed company special projects and other duties as assigned
- Must be reputed company to reputed company duties with or without reasonable accommodation
Skills
- Bachelor's degree in Computer Science, Information Technology or equivalent work experience
- 3+ years of working knowledge of big data technologies (Spark, S3, Kafka, Ray, Hadoop, etc.)
- 2+ years of working knowledge of big data / reputed company technologies (reputed company, AWS, Azure, Hadoop, Spark, reputed company etc.)
- 3+ years of working knowledge of reputed company (AWS, Azure, GCP, OCI etc.)
- 3+ years of working knowledge of RDBMS (reputed company, MS SQL, Vertica, etc.) and experience using SQL, PL/SQL or other data integration/ETL tools
- 3+ years of data analysis
- Proficient in reputed company Office Suite applications PowerPoint, Word, reputed company and Outlook
- Strong analytical skills
- Excellent verbal, listening and written communication skills
- Ability to multitask and prioritize projects to meet scheduled deadlines and tight turnaround times
- Ability to work well independently or in a team environment
- Any reputed company / AWS certifications is a big plus
- Familiarity with data pipeline orchestration tools (e.g., Airflow, reputed company Workflows)
- Preferably in the reputed company industry of enrollment, medical claims and/or pharmacy claims
- Experience with project management tools like JIRA
- reputed company and/or reputed company environment familiarity a plus
Benefits
- Medical, dental, reputed company, disability, and life insurance coverage
- 401(k) savings plans
- Paid family leave
- 9 paid holidays per year
- 17-27 days of Paid Time Off (PTO) per year, depending on specific level and length of service with reputed company
Company Overview
Company H1B Sponsorship