Job Details
Role: GCP Lead
Location Seattle, Washington (Hybrid)
About Tredence
Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale. Head quartered in the San Francisco Bay Area, we serve clients in the US, Canada, Europe, and South East Asia.
We are looking for a Big Data Engineer that will work on the collecting, storing, processing, and analyzing of huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across our clients.
Primary Roles and Responsibilities:
Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities
Develop and maintain data pipelines implementing ETL process, monitoring performance and advising any necessary infrastructure changes
Translate complex technical and functional requirements into detailed designs
Investigate and analyze alternative solutions to data storing, processing etc. to ensure most streamlined approaches are implemented
Serve as a mentor to junior staff by conducting technical training sessions and reviewing project outputs
Skills and Qualifications:
Strong understanding of data warehousing and data modeling techniques.
Proficient understanding of distributed computing principles - Hadoop v2, MapReduce, HDFS
Strong data engineering skills on GCP cloud platforms
Experience with building stream-processing systems, using solutions such as Storm or Spark- Streaming
Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
Experience with Spark, SQL, and Linux.
Knowledge of various ETL techniques and frameworks, such as Flume, Apache NiFi, or DBT.
Experience with various messaging systems, such as Kafka or RabbitMQ.
Good understanding of Lambda Architecture, along with its advantages and drawbacks
Why join Tredence?
There is a reason we are one of the fastest growing private companies in the country! You will have the opportunity to work with some of the smartest, friendliest, hardest working people in the data analytics space. You will work with the latest technologies and interface directly with the key decision stakeholders at our clients, some of the largest and most innovative businesses in the world. We offer a 401k match; full medical, dental and vision benefits, a fun team atmosphere and a work life balance. Our people are our greatest asset and we value every one of them. Come see why were so successful in one of the most competitive and fastest growing industries in the world.
Tredence 5 core values
Think Impact
Be Entrepreneurial
Constantly curious
Do the right thing
Pursue Excellence
Tredence is an equal opportunity employer. We celebrate and support diversity and are committed to creating an inclusive environment for all employees.
Visit our Website, YouTube page, LinkedIn page for more details