Job Details
As a Lead Data Engineer you will collaborate with a team to design robust data systems in an environment that values strong engineering practices, agile methodologies, and code quality. Your work will empower small business owners by providing lending options for payroll, scaling operations, and making crucial purchases.
Responsibilities:
- Develop and maintain optimal data pipeline architecture.
- Create complex data sets meeting business requirements.
- Implement process improvements: automate tasks, enhance data delivery, and scale infrastructure.
- Establish ETL/ELT infrastructure using SQL, NoSQL, and AWS 'big data' technologies.
- Build analytics tools for actionable insights into customer acquisition and business performance metrics.
- Craft data tools for analytics teams, aiding in product optimization.
- Collaborate closely with Product Management for system enhancements.
Qualifications:
- BS/MS in Computer Science or related field.
- 7+ years of experience (10+ preferred) in data engineering.
- Proficient in SQL, relational databases, and NoSQL.
- Skilled in building and optimizing 'big data' pipelines and architectures.
- Experience with unstructured datasets, data warehousing, and governance.
- Strong organizational and leadership abilities.
- Tech proficiency in Python, Snowflake, Datamart, ML libraries, Spark, Kafka, Postgres, Cassandra, Airflow, AWS (EC2, S3, RDS, etc.), and container technologies.
Preferred Experience:
- Bitbucket/GitHub or similar version control systems.
If you're passionate about impactful data engineering within a collaborative, dynamic setting, we invite you to apply.