This is a Senior Data Engineer role with Simple Machines based in Darlinghurst, NSW, AU

-- Simple Machines --

Simple Machines is a leading independent boutique technology firm with a global presence, including teams in London, Sydney, San Francisco, and New Zealand. We specialise in creating technology solutions at the intersection of data, AI, machine learning, data engineering, and software engineering. Our mission is to help enterprises, technology companies, and governments better connect with and understand their organisations, their people, their customers, and citizens.

Role Seniority - Senior

More about the Senior Data Engineer role at Simple Machines

Requirements

The Principal / Senior Data Engineer at Simple Machines is a dynamic, hands-on role focused on building real-time data pipelines and implementing data mesh architectures to enhance client data interactions. This position blends deep technical expertise in modern data engineering methods with a client-facing consulting approach, enabling clients to effectively manage and utilise their data. Within a team of top-tier engineers, the role involves developing greenfield data solutions that deliver tangible business outcomes across various environments.

Technical Responsibilities

Developing Data Solutions : Implement and enhance data-driven solutions integrating with clients' systems using state-of-the-art tools such as Databricks, Snowflake, Google Cloud, and AWS. Embrace modern data architecture philosophies including data products, data contracts, and data mesh to ensure a decentralized and consumer-oriented approach to data management.

Data Pipeline Development : Develop and optimise high-performance, batch and real-time data pipelines employing advanced streaming technologies like Kafka, and Flink. Utilise workflow orchestration tools such as Dataflow and Airflow.

Database and Storage Optimization : Optimize and manage a broad array of database technologies, from traditional relational databases (e.g., PostgreSQL, MySQL) to modern NoSQL solutions (e.g., MongoDB, Cassandra). Focus on strategies that enhance data accessibility, integrity, and performance.

Big Data Processing & Analytics : Utilise big data frameworks such as Apache Spark and Apache Flink to address challenges associated with large-scale data processing and analysis. These technologies are crucial for managing vast datasets and performing complex data transformations and aggregations.

Cloud Data Management : Implement and oversee cloud-specific data services including AWS Redshift, S3, Google BigQuery, and Google Cloud Storage. Leverage cloud architectures to improve data sharing and interoperability across different business units.

Security and Compliance : Ensure all data practices comply with security policies and regulations, embedding security by design in the data infrastructure. Incorporate tools and methodologies recommended for data security and compliance, ensuring robust protection and governance of data assets.

Consulting Responsibilities

Client Advisory : Provide expert advice to clients on optimal data practices that align with their business requirements and project goals.

Training and Empowerment : Educate client teams on the latest technologies and data management strategies, enabling them to efficiently utilise and maintain the solutions we have developed.

Professional Development : Keep up with the latest industry trends and technological advancements, continually upgrading skills and achieving certifications in the technologies Simple Machines implements across its client base.

Professional Experience And Qualifications

Professional Experience: At least 5+ years of data engineering or equivalent experience in a commercial, enterprise, or start-up environment. Consulting experience within a technology consultancy or professional services firm is highly beneficial.

Educational Background: Degree or equivalent experience in computer science or a related field.

Before we jump into the responsibilities of the role. No matter what you come in knowing, you’ll be learning new things all the time and the Simple Machines team will be there to support your growth.

🟢 Please consider applying even if you don't meet 100% of what’s outlined 🟢

Key Responsibilities

• 🔧 Developing data solutions
• 💬 Client advisory
• 📚 Training and empowerment

Key Strengths

• 💻 Data engineering expertise
• ☁️ Cloud data management
• 📊 Big data processing
• 🖥️ Programming languages
• 🔄 CI/CD implementation
• ⚙️ Agile delivery

Why Simple Machines is partnering with Hatch on this role. Hatch exists to level the playing field for people as they discover a career that’s right for them. So when you apply you have the chance to show more than just your resume.

A Final Note: This is a role with Simple Machines not with Hatch.