Government publications by agency. Part of what the twin can answer. Every figure below is the value the route serves, with its source; the raw response is at /api/twin/brain/govfull/agency/national-portal.
Descriptive, sourced: no model
Basis: sourced records (URL, sha256 or locator per row), no model.
stored files, documents and chunks, and counts over them
| Upload year | Files | Bytes |
|---|---|---|
| 2024 | Files: 31 | Bytes: 50,452,692 |
| 2026 | Files: 2 | Bytes: 5,584,921 |
| Verdict | PDFs |
|---|---|
| Legacy bangla | PDFs: 5 |
| Manifest line | Type | Bytes | Characters | Upload year | Upload month | Also in the office store | Text layer | Pages | Re-hash verified |
|---|---|---|---|---|---|---|---|---|---|
| 178 | Type: pdf |
| Source | Publisher | Unit | Caveat |
|---|---|---|---|
| Government untruncated corpus harvest (stored copies, gap row A3) | Publisher: Issuing ministries, departments, divisions and boards of the Government of Bangladesh (stored copies) | Unit: one row per stored PDF document: manifest line, URL, sha256 at fetch, bytes, chars, issuing agency, portal host, upload year/month, registry entity binding, overlap with the stored files from government portals; source file is relative to the corpus root | Caveat: All 4,049 documents are full PDF publications; 241 match SHA-256 hashes of the stored files from government portals (BRN46). Agency assignment is verified against exact registry entities. sha256 verified is set only for re-hashed files (the 400 deterministic random sample and the pilot); the rest carry the harvest sha256. |
phones_detected), never stored.| Characters: 111,922 |
| Upload year: 2024 |
| Upload month: 12 |
| Also in the office store: yes |
| Text layer: not available |
| Pages: not available |
| Re-hash verified: not available |
| 294 | Type: pdf | Bytes: 286,341 | Characters: 36,856 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 379 | Type: pdf | Bytes: 291,828 | Characters: 63,166 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,601 | Type: pdf | Bytes: 390,288 | Characters: 65,127 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,705 | Type: pdf | Bytes: 306,469 | Characters: 78,772 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,725 | Type: pdf | Bytes: 6,062,551 | Characters: 419,654 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,732 | Type: pdf | Bytes: 805,092 | Characters: 61,757 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,783 | Type: pdf | Bytes: 802,818 | Characters: 175,679 | Upload year: 2026 | Upload month: 7 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,955 | Type: pdf | Bytes: 361,239 | Characters: 79,845 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: Legacy bangla | Pages: 32 | Re-hash verified: yes |
| 1,959 | Type: pdf | Bytes: 5,375,143 | Characters: 194,584 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,970 | Type: pdf | Bytes: 281,276 | Characters: 66,565 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,971 | Type: pdf | Bytes: 1,121,788 | Characters: 118,262 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,042 | Type: pdf | Bytes: 291,823 | Characters: 59,210 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,055 | Type: pdf | Bytes: 2,461,635 | Characters: 424,142 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,091 | Type: pdf | Bytes: 6,062,551 | Characters: 419,654 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,277 | Type: pdf | Bytes: 6,062,551 | Characters: 419,654 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,556 | Type: pdf | Bytes: 4,782,103 | Characters: 355,970 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,670 | Type: pdf | Bytes: 356,696 | Characters: 86,643 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,689 | Type: pdf | Bytes: 356,998 | Characters: 83,276 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,780 | Type: pdf | Bytes: 563,356 | Characters: 77,931 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: Legacy bangla | Pages: 36 | Re-hash verified: yes |
| 2,919 | Type: pdf | Bytes: 805,092 | Characters: 61,757 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,964 | Type: pdf | Bytes: 258,376 | Characters: 78,196 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 3,019 | Type: pdf | Bytes: 1,408,884 | Characters: 225,207 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 3,085 | Type: pdf | Bytes: 281,276 | Characters: 66,565 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 3,215 | Type: pdf | Bytes: 411,918 | Characters: 88,831 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: Legacy bangla | Pages: 47 | Re-hash verified: yes |
| 3,274 | Type: pdf | Bytes: 327,774 | Characters: 80,603 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: Legacy bangla | Pages: 40 | Re-hash verified: yes |
| 3,279 | Type: pdf | Bytes: 165,454 | Characters: 55,819 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 3,459 | Type: pdf | Bytes: 256,843 | Characters: 64,067 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 3,704 | Type: pdf | Bytes: 8,280,830 | Characters: 73,563 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 3,780 | Type: pdf | Bytes: 442,057 | Characters: 165,170 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 3,912 | Type: pdf | Bytes: 303,058 | Characters: 73,408 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: Legacy bangla | Pages: 40 | Re-hash verified: yes |
| 3,966 | Type: pdf | Bytes: 4,782,103 | Characters: 355,970 | Upload year: 2026 | Upload month: 2 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 4,043 | Type: pdf | Bytes: 485,038 | Characters: 90,301 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| Per-issuing-agency manifest datasets | Publisher: Built from the rows above by the inventory pipeline | Unit: one row per issuing agency, with its partition file, sha256, file counts, and text layer counts | Caveat: Each agency's inventory partition is the resumable unit of the pipeline; a rerun rewrites only partitions whose rows changed. |
| 200-chunk pilot: documents and chunks with printed fields across 14 agencies | Publisher: each document's stored PDF (PyMuPDF text layer) | Unit: one row per pilot document (fields with page and line) and per chunk (page range, counts, text sha256) | Caveat: Pilot documents were chosen to maximize agency diversity across text-layer candidates, chunked in consecutive page blocks up to 4,000 characters, hitting exactly 200 chunks total. Documents with personal data (CVs, data sheets, rosters, beneficiary lists, or >=2 mobile phone numbers on pages 1-2) are screened out before chunking. Phone numbers are never stored in any parquet or served payload. |
| Pipeline run log (measured) | Publisher: Measured pipeline runs on a 16-core machine | Unit: one row per stage run: items, bytes, seconds, workers | Caveat: Runs over files a previous run had read hit the page cache and overstate the rate; the projection uses the cold runs named in its basis. |