1 dépôt
General tools for identifying deceptive tuning of model parameters to inflate performance.
Distinct from Earnings Manipulation Detection: Candidates are for financial manipulation or network conflicts, not ML hyperparameters.
Explore 1 awesome GitHub repository matching scientific & mathematical computing · Hyperparameter Manipulation Detectors. Refine with filters or upvote what's useful.
WritingAIPaper is a suite of tools designed for automating the structuring, drafting, and auditing of academic research manuscripts. It functions as an AI writing assistant that guides the creation of papers from a core idea to a finished document, utilizing a research manuscript structuring tool to organize content around specific technical contributions. The project includes a deceptive research practice detector that identifies common reporting manipulations, such as hyperparameter cherry-picking, selective metric reporting, and incremental padding. It also provides a submission readiness
Detects the switching of learning rate schedules or cherry-picking of seeds to skew experimental results.