docs: move research dossier into docs/ and update cross-references
This commit is contained in:
1 parent
04bf90c09b
commit
b891b0bbf4
9 files changed
+14
-14
No files matched your search
@@ -2,7 +2,7 @@
|
||||
|
||||
**Status: research dossier and partially executed prototype, 2026-10-31.** Revised Project B is the provisional priority. None of A/B/C has been established as a novel publishable result. No real dataset has been trained on or evaluated in this environment.
|
||||
|
||||
Read in order: `research_decision.md`, `novelty_matrix.md`, `mathematical_analysis.md`, `literature_review.md`, `experiment_plan.md`. Full bibliographic verification, dataset rights/downloads and several upstream implementations remain open, individually marked in the review. There are 10 A, 15 B and 12 C relevant reference placements with overlap, plus a pending NP-loss reference. General loss/calibration papers are explicitly distinguished from IRSTD papers.
|
||||
Read in order: `docs/research_decision.md`, `docs/novelty_matrix.md`, `docs/mathematical_analysis.md`, `docs/literature_review.md`, `docs/experiment_plan.md`. Full bibliographic verification, dataset rights/downloads and several upstream implementations remain open, individually marked in the review. There are 10 A, 15 B and 12 C relevant reference placements with overlap, plus a pending NP-loss reference. General loss/calibration papers are explicitly distinguished from IRSTD papers.
|
||||
|
||||
## Contents
|
||||
|
||||
@@ -13,7 +13,7 @@ Read in order: `research_decision.md`, `novelty_matrix.md`, `mathematical_analys
|
||||
- `configs/ablations.csv`: prepared versus unimplemented comparisons.
|
||||
- `evidence/papers.json`: bibliographic/status records; no copied paper text.
|
||||
- `results/`: actual test logs and analytic calculations only.
|
||||
- `manuscript_outline.md`, `research_log.md`: writing and milestone records.
|
||||
- `docs/manuscript_outline.md`, `docs/research_log.md`: writing and milestone records.
|
||||
|
||||
## Actual execution status
|
||||
|
||||
@@ -37,7 +37,7 @@ For CPU-only evaluation, omit PyTorch; `evaluate.py` imports it only when a lear
|
||||
|
||||
## Data preparation
|
||||
|
||||
No data, checkpoints or third-party code are bundled. Follow `data/README.md` and `experiment_plan.md`. Create `data/manifest.csv` with native uint8 image/mask paths, exact split membership and independent scene groups. Original test sets stay untouched; dev and cal come from training groups or separately authorized data. Binary masks cannot resolve overlapping target identities. License and annotation audits are required before claiming a valid benchmark.
|
||||
No data, checkpoints or third-party code are bundled. Follow `data/README.md` and `docs/experiment_plan.md`. Create `data/manifest.csv` with native uint8 image/mask paths, exact split membership and independent scene groups. Original test sets stay untouched; dev and cal come from training groups or separately authorized data. Binary masks cannot resolve overlapping target identities. License and annotation audits are required before claiming a valid benchmark.
|
||||
|
||||
```bash
|
||||
python scripts/audit_data.py --manifest data/manifest.csv --out data/audit.json
|
||||
@@ -84,4 +84,4 @@ The benchmark uses random images solely for timing. It excludes disk IO and lear
|
||||
|
||||
Add `--calibration-method fixed_sequence` to the calibration command to test the predeclared thresholds from highest to lowest and stop at the first failure. The default remains `bonferroni` for reference. Count risk uses the Hoeffding KL bound on FP/cap; any-alarm risk uses an exact binomial lower-tail test. The output reports a certified risk budget, not a simultaneous table of confidence bounds. Choose the procedure before calibration; selecting whichever procedure works on the same labels requires its own error allocation.
|
||||
|
||||
At alpha=.01 and delta=.05, zero observed errors need 299 independent images for the fixed-sequence any-alarm test, or 19,172 for count risk with cap=64. These are procedure-specific calculations, not universal lower bounds. See mathematical_analysis.md.
|
||||
At alpha=.01 and delta=.05, zero observed errors need 299 independent images for the fixed-sequence any-alarm test, or 19,172 for count risk with cap=64. These are procedure-specific calculations, not universal lower bounds. See docs/mathematical_analysis.md.
|
||||
Reference in new issue
Block a user