Lead Big Data Engineer – Enterprise Data Platform Development & Predictive Analytics (Full-Time, Remote-Eligible)

Join arenaflex as a Lead Big Data Engineer – Shape the Future of Data-Driven Innovation

Are you ready to leverage massive-scale data to transform how a Fortune-class retailer makes critical business decisions? arenaflex is seeking a visionary Lead Big Data Engineer to architect and build next-generation data platforms thatpower predictive analytics, machine learning, and real-time decision-making across our entire organization. This is a unique opportunity to work with petabytes of data, cutting-edge technologies, and a world-class team of data scientists and engineers.

At arenaflex, we believe data is the foundation of every great customer experience. From personalized recommendations to optimized supply chain operations, our data engineers build the infrastructure that makes it all possible. As our Lead Big Data Engineer, you'll be at the forefront of this transformation, designing systems that process billions of transactions and enable actionable insights in real-time.

About arenaflex

arenaflex is a leading retailer committed to delivering exceptional value and convenience to millions of customers nationwide. With a focus on innovation, sustainability, and community engagement, we operate hundreds of stores and a robust digital platform. Our technology team is driving rapid digital transformation, leveraging data science, cloud computing, and AI to redefine retail for the modern era.

Our data infrastructure powers critical business functions including marketing personalization, supply chain optimization, inventory management, fraud detection, and customer experience enhancement. We process massive volumes of data daily, and we're continuously investing in expanding our big data capabilities to stay ahead of emerging trends.

Role Overview

The Lead Big Data Engineer reports to our Director of Data Engineering and plays a pivotal role in designing, developing, and maintaining our enterprise big data platform. This position offers an exciting blend of technical leadership, architectural design, and hands-on development. You'll mentor a team of engineers, collaborate with data scientists and analysts, and drive the evolution of our data ecosystem.

You'll work across multiple teams including Marketing Analytics, Supply Chain Optimization, Cybersecurity, and Personalization to build the algorithms and data pipelines that power decision-making at scale. Your expertise will directly impact our ability to deliver personalized experiences, optimize operations, and maintain competitive advantage.

Key Responsibilities

• Architectural Leadership: Design and define the technical architecture for distributed, scalable big data solutions that meet current and future business requirements
• Platform Development: Lead the development of high-performance, distributed computing systems using technologies such as Hadoop, Spark, NoSQL databases, and cloud-native data platforms
• Data Pipeline Engineering: Build, optimize, and maintain robust ETL/ELT pipelines that ensure data quality, reliability, and accessibility across the organization
• Performance Optimization: Analyze and optimize query performance, data processing workflows, and system resource utilization to handle web-scale data volumes efficiently
• Collaboration: Partner with data scientists, business analysts, and product teams to understand requirements and deliver data solutions that address complex business challenges
• Code Development: Program, debug, and maintain complex data processing applications and new product features in distributed, large-scale analytical environments
• Documentation: Create and maintain comprehensive technical documentation, data dictionaries, and process guides to ensure consistency and compliance across the organization
• Dashboard Development: Develop interactive dashboards, reports, and analytical templates that enable business stakeholders to derive actionable insights from data
• Ad-hoc Analytics Support: Provide on-demand access to large datasets and support complex analytical queries for business-critical initiatives
• System Enhancement: Implement and continuously improve core data infrastructure, identifying opportunities for automation and efficiency gains
• Technical Consultation: Serve as a subject matter expert and technical advisor to software teams and business stakeholders on data architecture and design decisions
• Innovation Research: Research and evaluate emerging technologies, coding standards, and industry best practices to advance our data capabilities

Required Qualifications

• Education: Bachelor's degree in Computer Science, Software Engineering, Mathematics, Statistics, or a related technical field
• Experience: Minimum of 5+ years of professional experience in big data engineering, software development, or data platform architecture
• Technical Proficiency: Strong programming skills in at least one of the following languages: Java, Scala, Python, or equivalent
• Big Data Technologies: In-depth experience with big data ecosystems including Hadoop, Apache Spark, Kafka, and distributed computing frameworks
• NoSQL & Data Stores: Hands-on experience with NoSQL databases (such as Cassandra, MongoDB, DynamoDB) and big data storage solutions
• Distributed Systems: Strong understanding of distributed systems principles, data partitioning strategies, and fault tolerance mechanisms
• Data Pipeline Experience: Proven experience designing and implementing ETL/ELT pipelines and data workflows at scale
• Cloud Platforms: Experience with cloud-based big data platforms (AWS, Azure, or GCP) and containerization technologies
• Problem-Solving: Excellent analytical and problem-solving skills with the ability to troubleshoot complex distributed system issues
• Communication: Strong verbal and written communication skills with the ability to explain technical concepts to non-technical stakeholders

Preferred Qualifications

• Advanced degree (Master's or PhD) in Computer Science, Data Science, or related field
• Experience with real-time streaming data processing (Apache Kafka, Apache Flink, or similar technologies)
• Knowledge of machine learning frameworks and MLOps practices
• Experience in the retail or e-commerce industry
• Certification in cloud platforms (AWS, Azure, or Google Cloud)
• Familiarity with data governance, privacy regulations, and compliance frameworks
• Experience with orchestration tools such as Apache Airflow or Dagster
• Knowledge of columnar databases and OLAP solutions (Apache Druid, ClickHouse, Snowflake)

Skills & Competencies

• Technical Leadership: Ability to lead technical discussions and make architecture decisions that balance performance, scalability, and maintainability
• Cross-Functional Collaboration: Proven ability to work effectively with diverse teams including data scientists, business analysts, and product managers
• Mentorship: Experience mentoring junior engineers and fostering a culture of technical excellence
• Agile Methodology: Familiarity with Agile development practices and DevOps principles
• Quality Focus: Commitment to code quality, testing, and documentation best practices
• Innovation Mindset: Curiosity and enthusiasm for exploring new technologies and approaches to data challenges
• Business Acumen: Ability to translate business requirements into technical solutions that deliver measurable value

Career Growth Opportunities

At arenaflex, we invest in the professional development of our team members. As our Lead Big Data Engineer, you'll have access to:

• Technical Advancement: Opportunities to work with cutting-edge technologies including AI/ML platforms, real-time streaming analytics, and cloud-native data architectures
• Leadership Path: Clear career progression toward Principal Engineer, Engineering Manager, or Director-level roles
• Continuous Learning: Access to industry conferences, training programs, and certification sponsorship
• Cross-Functional Exposure: Opportunities to collaborate with teams across Marketing, Supply Chain, Engineering, and Product organizations
• Innovation Projects: involvement in groundbreaking initiatives that shape the future of retail technology

Work Environment & Culture

arenaflex fosters a collaborative, inclusive, and innovative work environment where diverse perspectives are valued. Our data engineering team is known for its technical excellence, creative problem-solving, and commitment to delivering impactful solutions. We embrace flexible work arrangements and support work-life balance.

Our Minnesota headquarters features state-of-the-art facilities, but we also support remote work eligible positions for qualified candidates. You'll have access to modern collaboration tools, comfortable workspaces, and wellness programs designed to support your professional and personal well-being.

Compensation & Benefits

We offer competitive compensation and comprehensive benefits including:

• Base Salary: $28.00 per hour (equivalent to approximately $58,240 annually for full-time employment)
• Performance Bonuses: Annual incentive bonuses based on individual and company performance
• Health Benefits: Comprehensive medical, dental, and vision insurance
• Retirement Plans: 401(k) with company match and retirement planning resources
• Paid Time Off: Generous vacation, personal, and sick leave policies
• Parental Leave: Paid maternity and paternity leave for growing families
• Professional Development: Tuition reimbursement and career development programs
• Employee Discounts: Access to exclusive employee discounts on arenaflex products and services
• Wellness Programs: Fitness memberships, mental health resources, and wellness stipends
• Community Involvement: Paid volunteer time off and involvement in local community programs

Equal Opportunity Employer

arenaflex is committed to creating a diverse and inclusive workplace. We are an equal opportunity employer and welcome applicants of all backgrounds. We prohibit discrimination and harassment of any kind based on race, color, religion, sex, national origin, age, disability, genetic information, or any other protected characteristic.

In accordance with the Americans with Disabilities Act (ADA), arenaflex will provide reasonable accommodations to qualified individuals with disabilities during the application process or employment, unless doing so would impose an undue hardship on our operations. If you require accommodations to participate in the application process, please contact our HR team to discuss your needs.

Ready to Make an Impact?

If you're passionate about working with massive-scale data, building innovative solutions, and making a tangible impact on how a leading retailer operates, we want to hear from you. Join arenaflex and be part of a team that's transforming retail through data-driven innovation.

Apply now to take the first step toward an exciting career as our Lead Big Data Engineer. We review applications on a rolling basis and encourage early applications.