Open Source AI Engineer

A company is looking for an Open Source AI Engineer - Evals. Key Responsibilities Build LLM Eval Frameworks by designing and open-sourcing libraries, pipelines, and APIs Define Metrics and Benchmarks by curating datasets and developing evaluation metrics Collaborate with the Community by gathering feedback and guiding project direction Required Qualifications Hands-on experience with popular LLM frameworks and prompt engineering techniques Strong programming skills in Python; familiarity with TypeScript is a plus Understanding of core NLP evaluation methods for LLM systems Track record of contributions to open source projects or active engagement in developer communities Familiarity with debugging AI applications and building data-heavy dashboards is advantageous

Feb 19, 2025 - 22:07
 0
Open Source AI Engineer
A company is looking for an Open Source AI Engineer - Evals. Key Responsibilities Build LLM Eval Frameworks by designing and open-sourcing libraries, pipelines, and APIs Define Metrics and Benchmarks by curating datasets and developing evaluation metrics Collaborate with the Community by gathering feedback and guiding project direction Required Qualifications Hands-on experience with popular LLM frameworks and prompt engineering techniques Strong programming skills in Python; familiarity with TypeScript is a plus Understanding of core NLP evaluation methods for LLM systems Track record of contributions to open source projects or active engagement in developer communities Familiarity with debugging AI applications and building data-heavy dashboards is advantageous