Job offer: AI Content Safety Quality Assurance

An entity supporting the technology strategy and digital transformation initiatives of a major financial firm.

• Content Safety Testing: Design, develop, and execute comprehensive test plans to ensure the security and reliability of content generated by large language models.
• LLM Integration: Work with LLM APIs (e.g., OpenAI's API) to integrate AI models into automated testing workflows, ensuring consistent and thorough content evaluation.
• Prompt Engineering: Leverage prompt engineering skills to enhance testing strategies and optimize LLM behaviour for safe and reliable output.
• Defect Identification & Resolution: Identify and document content safety issues or model behaviour concerns, and collaborate with AI developers to resolve them.
• Automation & Scripting: Develop automated testing scripts using Python to streamline LLM testing processes and ensure scalable and efficient content safety evaluations.

• Master's or Bachelor's degree in Computer Science, Engineering, or a related field
• Proficient in Python programming and comfortable working with LLM APIs (e.g., OpenAI)
• Experienced in testing the safety, security, and reliability of AI-generated content
• Knowledgeable in prompt engineering techniques and how they can enhance content safety
• Passionate about AI technologies and committed to ensuring the ethical and secure use of AI-generated content
• At least 1 year of hands-on experience with LLM APIs