I build and evaluate ML systems.

Joshua Kirby

Joshua Kirby

  • Applied ML, from experiments to production
  • Native in Japanese and English

University of Birmingham

  • B.Sc. Artificial Intelligence & Computer Science
  • Expected 2027
  • 85% second-year average (First Class)

Attacking Whisper

  • Designed a 72-speaker study showing attack success fell from 51.6% in simulation to 21.9% in real calls.

  • Improved agreement between local tests and real calls, reducing the difference in attack success rates by about a third.

  • First author of a paper submitted to ICASSP 2027.

Read Case Study

AI Conversational Placement Test

  • Cut spoken-Japanese placement from 2 weeks to 30 minutes.

  • Evaluated grammar detection against about 600 manual annotations.

Read Case Study

RAG Customer Support Chatbot

  • Built production chatbots for two schools, used by 2,000+ users.

  • Compared retrieval choices using 700+ relevance judgments.

Read Case Study

More of my work

View all work

View site source