Work with our Portfolio Companies.
0
Jobs
0
Companies
Making your next career move? Check out the openings at our Portfolio Companies.
AI/ML Engineer (Prompt Engineering & Productization)
Qualiti
Software Engineering, Data Science
Lehi, UT, USA
Posted on Aug 16, 2025
Job Title: AI/ML Engineer (Prompt Engineering & Productization)
Location: Lehi, Utah (Hybrid)
Company: Qualiti.ai
About Us:
At Qualiti, we’re pioneering AI-assisted automated testing solutions for web applications. Our platform enables software and QA teams to generate and execute tests efficiently, saving time and effort. By leveraging AI, we remove the complexities of writing and maintaining automated tests, empowering developers and QA teams to focus on delivering high-quality software.
Role Overview:
We are seeking an experienced Software Engineer specializing in AI and ML to help drive the development and productization of AI features. You will be central to our innovation engine—exploring prompt engineering techniques, building context-rich pipelines, and working closely with product and engineering teams to integrate AI into core user workflows.
Responsibilities:
- Develop, test, and optimize prompts for LLM-based test generation, validation, and enhancement.
- Build pipelines that ingest structured and unstructured data (HTML, screenshots, documentation) to provide context to models.
- Collaborate with engineering to deploy scalable, production-grade AI features.
- Evaluate LLM performance using qualitative and quantitative evaluation methods and continuously improve outcomes.
- Work with Product and UX teams to define how AI integrates naturally into user workflows.
- Stay current with advancements in LLMs, GenAI, and related tools to ensure our platform remains cutting-edge.
Required Qualifications:
- 3+ years of experience working with NLP/LLMs, machine learning, or data science.
- Strong Python skills and experience with libraries such as LangChain, Transformers, OpenAI, or similar.
- Hands-on experience in prompt engineering and chaining techniques.
- Experience deploying AI/ML solutions in production environments.
- Ability to work in a fast-paced, cross-functional team environment.
Preferred Qualifications:
- Experience with Playwright or similar browser automation tools.
- Familiarity with QA/testing domains or user behavior modeling.
- Experience with multi-modal AI model inputs (text + images).
- Experience with AWS or similar cloud infrastructure.
- Prior startup or product development experience.
- Passion for clean, readable code.
Benefits:
- Competitive salary and equity options.
- Medical, dental, and vision coverage.
- HSA program participation.
- Unlimited PTO.
- Professional growth and career advancement.