Data Engineer

The role

As a Data Engineer, you’ll play a key role in shaping both client projects and internal product development, utilising your analytical, technical, and problem-solving skills. Join a dynamic team that values creativity, innovation, and a hands-on approach to data.

A typical work day will consist of:

• Building data pipelines using tools such as Airflow, DBT 
• Developing a data ingestion tool, translating business requirements into code, and leveraging cloud technology for scalability
• Implementing SQL for business logic and Python complex data transformation and comprehensive system integration
• Use code versioning tool like git & be across CI/CD
• Collaborating closely with our Lead Data Engineer 
• Presenting results to stakeholders
• Experience using AI & it’s application towards code development & maintenance

About you

You’re passionate about data and the nuances of software engineering. With a strong foundation in both areas, you’re ready to tackle new challenges and contribute to building innovative data solutions. Your problem-solving skills, coupled with a commitment to innovation, make you an ideal fit for our collaborative and dynamic team. Most importantly, you love sharing your ideas with the team, helping others around you and having a laugh! 

Criteria

• Degree in Data Science, Mathematics, Statistics, Computer Science, or a related field
• Advanced SQL
• Experience with Python (PySpark, Pandas), or similar programming language & packages  (1 to 3 years)
• Experience in cloud computing (Azure, GCP or AWS) (1 to 3 years)
• Experience with cloud-based data warehouses or lakehouses e.g., Databricks, Snowflake or Microsoft Fabric. (1 to 3 years)
• Experience or exposure to tools like DBT or Airflow
• Knowledge-of and ideally experience working with Big Data and real-time streaming data pipelines (preferred)
• Understanding of data modelling, data warehousing, and database design best practices and design patterns

Company background

At EdgeRed, where our passion for unleashing the power of data meets boundless enthusiasm, we’re not just shaping the landscape of analytics; we’re dedicated to nurturing emerging talent. As a boutique analytics firm deeply engaged in cutting-edge projects with industry giants, we offer a distinctive space for your personal and professional evolution. Come aboard, and let your experience with EdgeRed be an exhilarating journey, propelling your career forward while actively contributing to the thrilling world of data analytics.

Benefits

• Hybrid work-from-home and in-office approach in our relaxed Sydney and Melbourne offices
• Join a supportive and enthusiastic team with an active social calendar
• Annual bonus/profit-sharing schemes
• Dedicated days for training or technical certifications