Evaluate model and prompt performance against defined test cases, and document results, regressions, and failure patterns.
Assist senior staff in the design and productionizing of internal LLM harnesses and multi-agent workflows.
Identify manual business processes that are good candidates for automation, and propose practical solutions.
BUSINESS ANALYSIS
Work with company staff to gather requirements and translate them into technical specifications.
Provide lifecycle support of applications, including troubleshooting, defect resolution, and enhancement requests.
Develop and maintain BI reports and dashboards that provide valuable information for business analysis.
PROFESSIONAL DEVELOPMENT
Build working knowledge of the company’s core platforms, including Epicor ERP, Salesforce, and Jitterbit integrations.
Keep current with the latest technologies, and share practical findings with the IT team.
Maintain confidentiality of proprietary information.
Qualifications
Education and Experience
Position requires a Bachelor’s degree in computer science or related field and 0-3 years of software development experience, including internship, co-op, or substantial academic project work.
Candidate must have demonstrated ability to develop and deploy working software using at least one general-purpose language (C#, Python, Java, or JavaScript/TypeScript), SQL, source control (GIT), and RESTful APIs, and must be able to explain and defend the design of their own prior work.
Routine use of AI-assisted development tools (Claude Code, GitHub Copilot, Cursor, Windsurf) and practical experience building LLM applications preferred.
Experience in a manufacturing environment preferred.
Exposure to Epicor, Jitterbit, or Salesforce is a plus.
Willingness to work primarily in the Microsoft/.NET stack is required.
Knowledge, Skills and Abilities
Read, analyze, and interpret a variety of information, such as technical procedures and business correspondence furnished in written, oral or diagram form.
Explain technical work clearly to both technical and non-technical staff, in writing and verbally.
Learn new platforms, languages, and tools quickly with limited formal training.
Requires job related software skills, Microsoft Office proficiency and the ability to operate a variety of standard office equipment.
Working Conditions/Physical Demands
Office environment, with occasional lifting and bending