Skip to content
View muhib-karim's full-sized avatar

Highlights

  • Pro

Block or report muhib-karim

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
muhib-karim/README.md

muhib-karim: AI evaluation, verification and validation, developer tools. Test engineer turned AI builder. Software you can inspect.

muhib-karim

AI engineer · Software verification & validation · Australia

I came to software through automotive test engineering, so I build tools the way I was trained to test: written requirements, repeatable checks and evidence someone else can inspect.

Projects

  • agent-eval-harness: compares coding models and agent CLIs on the same tasks, graded by hidden pytest suites, with unbiased pass@k and JSONL evidence.
  • api-vv-toolkit: turns an OpenAPI 3.x spec and written requirements into executed API tests and a requirements traceability matrix.
  • codegraph: indexes Python and Java into an embedded code graph and answers callers, inheritance, dead-code and change-impact queries with file:line evidence.
  • bangla-llm-eval: a small, reproducible Bangla evaluation of LLMs (translation, NLI, Bengali numerals) with raw outputs and a leaderboard.
  • humming-keyboard: Humming, a private keyboard with offline voice typing on your device, including Bangla.
  • code-video-kit: 34 typed Remotion components for code and data videos, with a rendered gallery.

Extended open source

Pinned Loading

  1. agent-eval-harness agent-eval-harness Public

    Python CLI and library for comparing coding models and agent CLIs on the same tasks: hidden pytest grading in isolated subprocesses, unbiased pass@k, JSONL evidence with SHA-256 provenance, and HTM…

    Python