AI Product Engineer
Sydney, Melbourne, Remote in AUS
Permanent

AI Product Engineer

Position Summary:

The AI Product Engineer will drive innovation in Janison’s Jai platform, leveraging cutting-edge AI technologies to revolutionise educational assessment. This role is for a technologist who thrives at the intersection of AI, product development, and education technology. You’ll co-create capabilities with AI tools, shape product direction, and build systems that transform how assessments are created and delivered. Ideal candidates are passionate about AI’s potential in education and comfortable working in a fast-paced, experimental environment.

Duties & Responsibilities:

  • Co-create innovative features using AI tools (Copilot, Cursor, Claude, etc.) as primary development partner
  • Design and implement advanced prompt engineering strategies for assessment generation
  • Build and optimise AI pipelines for creating, validating, and scoring educational assessments
  • Develop data analytics solutions to measure assessment quality and AI performance
  • Contribute to product strategy based on emerging AI capabilities and educational needs
  • Rapidly prototype and iterate on AI-powered features using Python, TypeScript, and React
  • Design and implement PostgreSQL schemas optimized for AI-generated content and analytics
  • Collaborate with educators and assessment experts to translate pedagogical needs into technical solutions
  • Stay current with AI advancements and evaluate new models/tools for integration
  • Build evaluation frameworks for AI-generated assessment quality
  • Design and implement comprehensive testing strategies using AI-assisted tools to ensure assessment quality and system reliability
  • Develop automated test suites that validate AI-generated content against educational standards and psychometric requirements
  • Create integration tests for API endpoints, generation pipelines, and scoring systems using AI to generate edge cases and test scenarios
  • Build validation frameworks that catch template artifacts, formatting issues, and content quality problems in AI-generated assessments
  • Develop AI capabilities responsibly, ensuring data security, IP protection, and privacy are upheld throughout the product lifecycle.

What success looks like?

  • You thrive when collaborating with your team, solving complex problems together
  • You are excited to experiment with new AI models and techniques daily
  • You can rapidly prototype ideas using AI as your co-developer
  • You think in terms of user outcomes, not just technical implementation
  • You are comfortable with ambiguity and can define your own path
  • You contribute to the vision of AI-powered assessment, not just execute tasks
  • You will partner closely with Product and UX/Design teams in rapid prototyping cycles, translating user insights and design concepts into functional AI-powered features through iterative development
  • You adapt fluidly to evolving customer requirements and feedback, working outside traditional ticket-based workflows to quickly validate assumptions and deliver solutions that meet pedagogical needs

Experience, Skills & Qualifications:

Essential

  • Demonstrated experience using AI tools (GitHub Copilot, Cursor, Claude, ChatGPT) for development.
  • Strong Python skills with focus on AI/ML libraries and API integrations
  • Experience with prompt engineering and LLM optimisation techniques
  • Proficiency in React, TypeScript, and modern frontend development
  • PostgreSQL expertise including JSON operations and vector databases
  • Product-minded approach with ability to translate user needs into technical solutions
  • Data analytics skills for evaluating AI performance and assessment quality
  • Self-directed learner who stays current with AI developments
  • Experience with AI-assisted testing tools and test generation
  • Understanding of testing strategies for non-deterministic AI systems

Desirable

  • Experience with or passion for educational technology
  • Understanding of assessment design principles and psychometrics
  • Experience with QTI standards or educational interoperability
  • Knowledge of voice synthesis, audio processing for assessments

APPLY NOW

 

About Janison

Janison exists to transform the way people learn. Our team of educators, technologists and change agents empower teachers, students, accreditation bodies and governments to achieve meaningful educational outcomes by measuring knowledge and progress.

Founded 25 years ago, we are an Australian-owned edtech pioneer delivering more than 6.5 million assessments annually in 117 countries. Our technology supports our commitment to equity and accessibility for all.

Why Janison?

As a finalist in the 2023 Wrk+ Great Place to Work Awards, we are delighted to offer you a fun and inclusive workplace environment, plus:

  • Access to our Employee Share Ownership Program. We will match your shares of up to $2,000 per year
  • A 5th week of annual leave (conditions apply) and a day off on your birthday
  • Parental leave benefit including paid leave, continued Super contributions and more
  • A day off each year to volunteer with a community-based organisation dear to your heart
  • Annual pay review and bonus program
  • A focus on virtual engagement and inclusivity to support our distributed workforce across the globe
  • A focus on development and upskilling opportunities (if that’s what you’re after)

For a glimpse into Janison’s culture and to see our regular employee updates, follow our channel on LinkedIn. We’d love for you to be part of our community!

Back to careers