Senior Big Data Software Engineer – Remote – Lead Hadoop, Spark, AWS, Data Pipeline Architecture at arenaflex

About arenaflex

arenaflex is a global leader in financial technology and data‑driven solutions, empowering millions of customers worldwide with secure, innovative, and reliable services. With a culture rooted in diversity, inclusion, and continuous learning, arenaflex invests heavily in cutting‑edge infrastructure and talent that can transform massive data sets into actionable insights. As a remote‑first organization, arenaflex offers flexible work arrangements, collaborative virtual teams, and a commitment to employee well‑being that rivals any on‑site office environment.

Why This Role Matters

In today’s data‑centric economy, the ability to ingest, process, and analyze petabytes of information in real time is a competitive advantage. As a Senior Big Data Software Engineer at arenaflex, you will be at the heart of this transformation, designing and delivering robust data pipelines that power critical business decisions, risk management, and customer experiences. Your work will directly influence the scalability, reliability, and security of arenaflex’s data ecosystem, ensuring that the organization stays ahead of industry trends and regulatory requirements.

Key Responsibilities

• Lead the design, development, and deployment of large‑scale data processing solutions using Hadoop, Spark, and related technologies.
• Architect end‑to‑end data pipelines that integrate sources such as Teradata, MongoDB, AWS S3, and on‑premise relational databases.
• Write clean, maintainable code in Python, Scala, and Shell, adhering to best practices for version control (GitHub, Bitbucket) and CI/CD pipelines.
• Collaborate with data scientists, product owners, and compliance teams to translate business requirements into technical specifications.
• Perform deep‑dive technical audits, identify performance bottlenecks, and implement optimizations for latency, throughput, and cost efficiency.
• Mentor junior engineers, provide technical guidance, and foster a culture of knowledge sharing across distributed teams.
• Develop and maintain automation scripts using Ansible, ensuring consistent environment provisioning and configuration management.
• Participate in on‑call rotations, troubleshoot production incidents, and drive root‑cause analysis to prevent recurrence.
• Document architecture decisions, data flow diagrams, and operational runbooks to support governance and audit requirements.
• Stay current with emerging big‑data technologies, evaluate their applicability, and propose pilot projects that could enhance arenaflex’s data capabilities.

Required Qualifications

• Education: Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related field.
• Minimum 3 years of hands‑on programming experience in a professional setting, demonstrated through work experience, academic projects, or military training.
• At least 3 years of active experience with Hadoop ecosystem components (HDFS, MapReduce, YARN, Hive, Pig).
• Proficiency with Teradata and MongoDB for large‑scale data storage and retrieval.
• Solid background in AWS services (EC2, S3, EMR, Lambda) and cloud‑native data processing.
• Demonstrated expertise with version control platforms such as GitHub and Bitbucket.
• Experience designing, coding, testing, troubleshooting, and documenting complex data projects.
• Strong command of Python, Unix/Shell scripting, Scala, and familiarity with tools like HBase, Oozie, Flume, Kafka.
• Hands‑on experience with Ansible for infrastructure automation.
• Excellent verbal and written communication skills, capable of interacting with technical and non‑technical stakeholders at all levels.

Preferred Qualifications

• Experience building ETL pipelines using SQL Server SSIS, extracting data from SQL Server, Oracle, or Access, and loading into data warehouses.
• Knowledge of data governance, security, and compliance frameworks relevant to the financial services industry.
• Prior exposure to risk‑management or regulatory reporting environments.
• Certification in AWS (e.g., AWS Certified Solutions Architect) or Hadoop (e.g., Cloudera Certified Professional).
• Demonstrated ability to lead cross‑functional teams in a remote or hybrid setting.

Core Skills & Competencies

• Analytical Thinking: Ability to dissect complex data problems, propose scalable solutions, and evaluate trade‑offs.
• Collaboration: Proven track record of working effectively in highly collaborative, distributed teams.
• Leadership: Experience guiding junior engineers, setting technical direction, and fostering a culture of continuous improvement.
• Adaptability: Comfortable navigating fast‑changing priorities and emerging technologies.
• Problem‑Solving: Strong debugging skills, with a systematic approach to incident resolution.
• Communication: Ability to translate technical concepts into clear business value for stakeholders.

Career Growth & Learning Opportunities

arenaflex is committed to your professional development. In this role you will:

• Access a robust learning platform offering courses on advanced big‑data architectures, cloud security, and machine‑learning integration.
• Participate in internal hackathons, innovation labs, and mentorship programs designed to accelerate career progression.
• Work alongside senior architects and data leaders who will sponsor your growth into roles such as Data Platform Lead, Solutions Architect, or Technical Program Manager.
• Benefit from a clear promotion pathway that rewards technical expertise, leadership impact, and contribution to business outcomes.

Work Environment & Culture at arenaflex

arenaflex embraces a flexible, remote‑first culture that values work‑life balance, diversity, and inclusion. Our teams are:

• Globally Distributed: Collaborate across time zones using state‑of‑the‑art communication tools.
• Inclusive: A workplace where every voice is heard, and diverse perspectives drive innovation.
• Outcome‑Driven: Focused on delivering measurable results rather than clock‑watching.
• Supportive: Access to employee assistance programs, mental‑health resources, and wellness initiatives.

Compensation, Perks & Benefits

arenaflex offers a competitive compensation package that reflects your experience and expertise, including:

• Hourly rate ranging from $20–$30 (commensurate with skill set and market benchmarks).
• Performance‑based bonuses and equity participation opportunities.
• Comprehensive health, dental, and vision coverage.
• Retirement savings plans with company matching contributions.
• Generous paid time off, parental leave, and flexible scheduling.
• Professional development stipend, certification reimbursements, and access to industry conferences.
• Home office allowance to support remote work ergonomics.

How to Apply

If you are passionate about building world‑class data platforms, thrive in a collaborative remote environment, and want to make a tangible impact at a forward‑thinking organization, we want to hear from you. Click the link below to submit your application and join arenaflex’s mission to redefine data excellence.

Apply Now

Closing Statement

arenaflex believes that great ideas come from great people. By joining our team, you will be part of a vibrant community that celebrates curiosity, encourages innovation, and rewards achievement. Take the next step in your career—apply today and help shape the future of data at arenaflex.