LLM Evaluation Expert

A company is looking for an LLM Evaluation Expert specializing in Coding. Key Responsibilities Critically analyze and evaluate code responses generated by LLMs across various programming languages Select the most appropriate and efficient code solutions from multiple LLM-generated options Collaborate with the AI research team to identify areas for improvement in the LLM's coding capabilities Required Qualifications Advanced degree in Computer Science, Software Engineering, or a related field Extensive experience (5+ years) in software development across multiple programming languages Demonstrated ability to critically evaluate code quality and efficiency Strong analytical and decision-making skills Experience in technical writing, particularly in creating coding examples or tutorials

Apr 2, 2025 - 22:42
 0
LLM Evaluation Expert
A company is looking for an LLM Evaluation Expert specializing in Coding. Key Responsibilities Critically analyze and evaluate code responses generated by LLMs across various programming languages Select the most appropriate and efficient code solutions from multiple LLM-generated options Collaborate with the AI research team to identify areas for improvement in the LLM's coding capabilities Required Qualifications Advanced degree in Computer Science, Software Engineering, or a related field Extensive experience (5+ years) in software development across multiple programming languages Demonstrated ability to critically evaluate code quality and efficiency Strong analytical and decision-making skills Experience in technical writing, particularly in creating coding examples or tutorials