Government publications by agency. Part of what the twin can answer. Every figure below is the value the route serves, with its source; the raw response is at /api/twin/brain/govfull/agency/lged.
Descriptive, sourced: no model
Basis: sourced records (URL, sha256 or locator per row), no model.
stored files, documents and chunks, and counts over them
| Upload year | Files | Bytes |
|---|---|---|
| 2024 | Files: 28 | Bytes: 65,259,197 |
| 2026 | Files: 10 | Bytes: 61,969,505 |
| Verdict | PDFs |
|---|---|
| Text | PDFs: 1 |
| Manifest line | Type | Bytes | Characters | Upload year | Upload month | Also in the office store | Text layer | Pages | Re-hash verified |
|---|---|---|---|---|---|---|---|---|---|
| 27 | Type: pdf |
| Source | Publisher | Unit | Caveat |
|---|---|---|---|
| Government untruncated corpus harvest (stored copies, gap row A3) | Publisher: Issuing ministries, departments, divisions and boards of the Government of Bangladesh (stored copies) | Unit: one row per stored PDF document: manifest line, URL, sha256 at fetch, bytes, chars, issuing agency, portal host, upload year/month, registry entity binding, overlap with the stored files from government portals; source file is relative to the corpus root | Caveat: All 4,049 documents are full PDF publications; 241 match SHA-256 hashes of the stored files from government portals (BRN46). Agency assignment is verified against exact registry entities. sha256 verified is set only for re-hashed files (the 400 deterministic random sample and the pilot); the rest carry the harvest sha256. |
phones_detected), never stored.| Characters: 42,793 |
| Upload year: 2024 |
| Upload month: 12 |
| Also in the office store: yes |
| Text layer: not available |
| Pages: not available |
| Re-hash verified: not available |
| 62 | Type: pdf | Bytes: 165,454 | Characters: 55,819 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 67 | Type: pdf | Bytes: 7,512,950 | Characters: 1,180,958 | Upload year: 2026 | Upload month: 5 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 94 | Type: pdf | Bytes: 7,512,950 | Characters: 1,180,958 | Upload year: 2026 | Upload month: 5 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 191 | Type: pdf | Bytes: 7,440,568 | Characters: 980,346 | Upload year: 2026 | Upload month: 4 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 300 | Type: pdf | Bytes: 2,962,345 | Characters: 117,822 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 492 | Type: pdf | Bytes: 4,462,054 | Characters: 195,570 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 638 | Type: pdf | Bytes: 607,199 | Characters: 227,900 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 649 | Type: pdf | Bytes: 2,390,015 | Characters: 222,686 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 672 | Type: pdf | Bytes: 354,224 | Characters: 73,222 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 916 | Type: pdf | Bytes: 338,270 | Characters: 79,293 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 928 | Type: pdf | Bytes: 14,684,349 | Characters: 179,227 | Upload year: 2026 | Upload month: 5 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 954 | Type: pdf | Bytes: 2,506,143 | Characters: 195,093 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,039 | Type: pdf | Bytes: 475,421 | Characters: 108,336 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,087 | Type: pdf | Bytes: 1,457,276 | Characters: 96,012 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,259 | Type: pdf | Bytes: 663,741 | Characters: 63,931 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,260 | Type: pdf | Bytes: 3,801,331 | Characters: 268,315 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,317 | Type: pdf | Bytes: 901,602 | Characters: 215,932 | Upload year: 2026 | Upload month: 3 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,396 | Type: pdf | Bytes: 412,230 | Characters: 120,060 | Upload year: 2026 | Upload month: 8 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,490 | Type: pdf | Bytes: 1,746,483 | Characters: 167,721 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,515 | Type: pdf | Bytes: 3,070,487 | Characters: 419,724 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,621 | Type: pdf | Bytes: 364,457 | Characters: 73,994 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,765 | Type: pdf | Bytes: 11,587,803 | Characters: 617,112 | Upload year: not available | Upload month: not available | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,842 | Type: pdf | Bytes: 12,067,321 | Characters: 3,474,931 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: Text | Pages: 649 | Re-hash verified: yes |
| 2,074 | Type: pdf | Bytes: 412,230 | Characters: 120,060 | Upload year: 2026 | Upload month: 8 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,105 | Type: pdf | Bytes: 5,776,003 | Characters: 70,409 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,514 | Type: pdf | Bytes: 421,420 | Characters: 29,764 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,573 | Type: pdf | Bytes: 4,075,874 | Characters: 299,655 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,619 | Type: pdf | Bytes: 2,201,994 | Characters: 97,260 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,677 | Type: pdf | Bytes: 2,852,585 | Characters: 101,319 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,679 | Type: pdf | Bytes: 967,709 | Characters: 138,143 | Upload year: 2026 | Upload month: 5 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,921 | Type: pdf | Bytes: 364,457 | Characters: 73,994 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,983 | Type: pdf | Bytes: 4,827,370 | Characters: 186,859 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 3,080 | Type: pdf | Bytes: 397,556 | Characters: 84,952 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 3,292 | Type: pdf | Bytes: 14,684,349 | Characters: 179,227 | Upload year: 2026 | Upload month: 5 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 3,409 | Type: pdf | Bytes: 4,075,874 | Characters: 299,655 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 3,844 | Type: pdf | Bytes: 757,280 | Characters: 61,050 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 3,917 | Type: pdf | Bytes: 7,440,568 | Characters: 980,346 | Upload year: 2026 | Upload month: 4 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 4,014 | Type: pdf | Bytes: 604,533 | Characters: 103,529 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| Per-issuing-agency manifest datasets | Publisher: Built from the rows above by the inventory pipeline | Unit: one row per issuing agency, with its partition file, sha256, file counts, and text layer counts | Caveat: Each agency's inventory partition is the resumable unit of the pipeline; a rerun rewrites only partitions whose rows changed. |
| 200-chunk pilot: documents and chunks with printed fields across 14 agencies | Publisher: each document's stored PDF (PyMuPDF text layer) | Unit: one row per pilot document (fields with page and line) and per chunk (page range, counts, text sha256) | Caveat: Pilot documents were chosen to maximize agency diversity across text-layer candidates, chunked in consecutive page blocks up to 4,000 characters, hitting exactly 200 chunks total. Documents with personal data (CVs, data sheets, rosters, beneficiary lists, or >=2 mobile phone numbers on pages 1-2) are screened out before chunking. Phone numbers are never stored in any parquet or served payload. |
| Pipeline run log (measured) | Publisher: Measured pipeline runs on a 16-core machine | Unit: one row per stage run: items, bytes, seconds, workers | Caveat: Runs over files a previous run had read hit the page cache and overstate the rate; the projection uses the cold runs named in its basis. |