Fusion is a cloud-based 3D modeling, CA D, CAM, CAE, and PC B software platform for professional product design and manufacturing . We're looking for a motivate d Software QA Engineer to join the Design Engineering QA team, focusing on testing and validating Large Language Model (LLM ) features integrate d into Fusion. This role will ensure the quality , accuracy , and reliability of AI -powere d convers ational an d gener ative capabilities within the product .
This is a hybrid position in Pune, India. You will report to Senior Manager, SQA.
- Performmanual and automated testing forLLM-powered features toensure responsequality, accuracy, and consistency.
Perform manual and automated testing for LLM-powere d features to ensure response quality, accuracy, an d consistency .
- Designand execute testcases for prompt-response validation, including edgecases and adversarial inputs.
Design and execute test cases for prompt -response validation, including edge cases and advers arial inputs .
- Identifyanddocument LLM-specificissuessuchas hallucinations, inaccurateresponses, and inconsistent outputs.
Identify and document L LM-specific issues such as hallucinations , in accurate responses, and incons istent outputs.
- Test LLM safetyand guardrails includingcontentmoderation, inappropriateresponsehandling, and prompt injectionprevention.
Test LLM safety and guardrails including content moderation, inappropriate response handling, and prompt injection prevention.
- Validate LLM integrationwithFusion workflowsand features, ensuringseamless userexperience.
Validate LLM integration with Fusion workflows and features , ensuring seamless user experience .
- Trackand verifyLLM behaviorconsistencyacross modelupdates and versions.
Track and verify L LM behavior consistency across model updates and versions .
- Develop automation scripts forLLM testing usingin-house toolsand frameworks.
Develop automation scripts for LLM testing using in -house tools and frameworks .
- Collaboratewith development teams to ensuretimely defect resolution.
Collaborate with development teams to ensure tim ely def ect resolution .
- Validateand reproducecustomer-reported LLM issues.
Validate an d reproduce customer -reported L LM issues .
- Completeassigned testingtasks ontime and reportprogressregularly.
Complete assigne d testing tasks on time an d report progress regularly .
- Bachelor's degree in ComputerScience, SoftwareEngineering, or related field.
Bachelor's degree in Computer Science, Software Engineering, or related fiel d.
- 2+ years of software QA experience.
2+ years of software Q A experience .
- Basicunderstanding of LLM/AI concepts(prompts, tokens, modelresponses, contextwindows).
Basic understanding of LLM /AI concepts (prom pts , tokens , model responses , context windows ).
- Experience withtest casedevelopment and defect tracking.
Experience with test case development and def ect tracking.
- Familiarity with Pythonorscripting languages for test automation.
Fam iliarity with Python or scri pting languages for test automation .
- Experiencewith bugtracking systems and testmanagementtools.
Experience with bug tracking systems an d test management tools.
- Good analyticaland problem-solving skillswithattention to detail.
Goo d analytical and problem-solving skills with attention to detail .
- Ability to workeffectivelyin cross-functional teams.
Ability to work effectively in cross -functional teams .
- Canworkindependently onday-to-day activities.
Can work independently on day -to-day activities .
- Experience testing LLMorconversational AI applications(chatbots, AIassistants).
Experience testing LLM or convers ational AI applications (chat bots, AI assistants).
- Familiarity withLLM evaluation concepts(responserelevance, factual accuracy, coherence).
Familiarity with LLM evaluation concepts
(response relev ance, fact ual accuracy, coher ence).
- Experiencewith promptengineering orprompttesting.
Experience with prompt engineering or prompt testing .
- Knowledgeof LLM safety testing(biasdetection, contentfiltering, jailbreakprevention).
Knowledge of L LM safety testing
(bias detection , content filtering, j ailbreak prevention).
- Hands-on experience with3D CAD/CAE software(Fusion 360, Inventor, etc.).
Hands -on experience with 3D CAD /CAE software (Fusion 360 , Inventor, etc .).
- Familiarity with APItesting tools(Postman, RESTclients).
Familiarity with API testing tools (Postman, REST clients ).
- Familiarity withAgile/Scrum developmentmethodologies.
Fam iliarity with Agile/Sc rum development methodologies.
- Experience with AI/ML testingframeworks orevaluationtools.
Experience with AI /ML testing frameworks or evaluation tools .
#LI-CL1
Learn More
Welcome to Autodesk! Amazing things are created every day with our software – from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.
We take great pride in our culture here at Autodesk – it’s at the core of everything we do. Our culture guides the way we work and treat each other, informs how we connect with customers and partners, and defines how we show up in the world.
When you’re an Autodesker, you can do meaningful work that helps build a better world designed and made for all. Ready to shape the world and your future? Join us!
We take pride in cultivating a culture of belonging where everyone can thrive. Learn more here:
Are you an existing contractor or consultant with Autodesk?
Please search for open jobs and apply internally (not on this external site).