Government publications by agency. Part of what the twin can answer. Every figure below is the value the route serves, with its source; the raw response is at /api/twin/brain/govfull/agency/petrobangla.
Descriptive, sourced: no model
Basis: sourced records (URL, sha256 or locator per row), no model.
stored files, documents and chunks, and counts over them
| Upload year | Files | Bytes |
|---|---|---|
| 2024 | Files: 12 | Bytes: 20,417,350 |
| 2026 | Files: 16 | Bytes: 64,809,455 |
| Verdict | PDFs |
|---|---|
| Text | PDFs: 2 |
| Manifest line | Type | Bytes | Characters | Upload year | Upload month | Also in the office store | Text layer | Pages | Re-hash verified |
|---|---|---|---|---|---|---|---|---|---|
| 137 | Type: pdf |
| Source | Publisher | Unit | Caveat |
|---|---|---|---|
| Government untruncated corpus harvest (stored copies, gap row A3) | Publisher: Issuing ministries, departments, divisions and boards of the Government of Bangladesh (stored copies) | Unit: one row per stored PDF document: manifest line, URL, sha256 at fetch, bytes, chars, issuing agency, portal host, upload year/month, registry entity binding, overlap with the stored files from government portals; source file is relative to the corpus root | Caveat: All 4,049 documents are full PDF publications; 241 match SHA-256 hashes of the stored files from government portals (BRN46). Agency assignment is verified against exact registry entities. sha256 verified is set only for re-hashed files (the 400 deterministic random sample and the pilot); the rest carry the harvest sha256. |
phones_detected), never stored.| Characters: 561,365 |
| Upload year: 2026 |
| Upload month: 6 |
| Also in the office store: no |
| Text layer: not available |
| Pages: not available |
| Re-hash verified: not available |
| 319 | Type: pdf | Bytes: 3,411,270 | Characters: 533,370 | Upload year: 2026 | Upload month: 5 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 929 | Type: pdf | Bytes: 361,426 | Characters: 147,734 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 950 | Type: pdf | Bytes: 1,022,243 | Characters: 157,919 | Upload year: 2026 | Upload month: 6 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,041 | Type: pdf | Bytes: 975,521 | Characters: 100,857 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: Text | Pages: 42 | Re-hash verified: yes |
| 1,158 | Type: pdf | Bytes: 3,379,882 | Characters: 496,414 | Upload year: 2026 | Upload month: 2 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,440 | Type: pdf | Bytes: 3,366,752 | Characters: 519,205 | Upload year: 2026 | Upload month: 3 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,485 | Type: pdf | Bytes: 4,065,982 | Characters: 51,122 | Upload year: 2026 | Upload month: 6 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,813 | Type: pdf | Bytes: 240,510 | Characters: 69,994 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,864 | Type: pdf | Bytes: 3,836,099 | Characters: 463,289 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,904 | Type: pdf | Bytes: 406,753 | Characters: 77,504 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,990 | Type: pdf | Bytes: 3,815,475 | Characters: 453,037 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,004 | Type: pdf | Bytes: 949,380 | Characters: 214,657 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,082 | Type: pdf | Bytes: 945,909 | Characters: 358,515 | Upload year: 2026 | Upload month: 4 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,268 | Type: pdf | Bytes: 955,496 | Characters: 280,724 | Upload year: 2026 | Upload month: 6 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,285 | Type: pdf | Bytes: 386,327 | Characters: 49,914 | Upload year: 2026 | Upload month: 6 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,306 | Type: pdf | Bytes: 239,704 | Characters: 57,074 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,373 | Type: pdf | Bytes: 394,194 | Characters: 134,023 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,413 | Type: pdf | Bytes: 9,188,537 | Characters: 65,966 | Upload year: 2026 | Upload month: 6 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,554 | Type: pdf | Bytes: 3,282,822 | Characters: 554,429 | Upload year: 2026 | Upload month: 5 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,633 | Type: pdf | Bytes: 16,547,599 | Characters: 302,074 | Upload year: 2026 | Upload month: 1 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,789 | Type: pdf | Bytes: 7,655,717 | Characters: 970,799 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 3,207 | Type: pdf | Bytes: 3,821,705 | Characters: 476,767 | Upload year: 2026 | Upload month: 0 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 3,241 | Type: pdf | Bytes: 716,571 | Characters: 33,112 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 3,319 | Type: pdf | Bytes: 826,000 | Characters: 237,383 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 3,502 | Type: pdf | Bytes: 4,374,893 | Characters: 51,758 | Upload year: 2026 | Upload month: 6 | Also in the office store: no | Text layer: Text | Pages: 18 | Re-hash verified: yes |
| 3,638 | Type: pdf | Bytes: 3,347,424 | Characters: 487,549 | Upload year: 2026 | Upload month: 1 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 3,705 | Type: pdf | Bytes: 3,423,459 | Characters: 501,917 | Upload year: 2026 | Upload month: 4 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| Per-issuing-agency manifest datasets | Publisher: Built from the rows above by the inventory pipeline | Unit: one row per issuing agency, with its partition file, sha256, file counts, and text layer counts | Caveat: Each agency's inventory partition is the resumable unit of the pipeline; a rerun rewrites only partitions whose rows changed. |
| 200-chunk pilot: documents and chunks with printed fields across 14 agencies | Publisher: each document's stored PDF (PyMuPDF text layer) | Unit: one row per pilot document (fields with page and line) and per chunk (page range, counts, text sha256) | Caveat: Pilot documents were chosen to maximize agency diversity across text-layer candidates, chunked in consecutive page blocks up to 4,000 characters, hitting exactly 200 chunks total. Documents with personal data (CVs, data sheets, rosters, beneficiary lists, or >=2 mobile phone numbers on pages 1-2) are screened out before chunking. Phone numbers are never stored in any parquet or served payload. |
| Pipeline run log (measured) | Publisher: Measured pipeline runs on a 16-core machine | Unit: one row per stage run: items, bytes, seconds, workers | Caveat: Runs over files a previous run had read hit the page cache and overstate the rate; the projection uses the cold runs named in its basis. |