Government publications by agency. Part of what the twin can answer. Every figure below is the value the route serves, with its source; the raw response is at /api/twin/brain/govfull/agency/sreda.
Descriptive, sourced: no model
Basis: sourced records (URL, sha256 or locator per row), no model.
stored files, documents and chunks, and counts over them
| Upload year | Files | Bytes |
|---|---|---|
| 2024 | Files: 26 | Bytes: 237,560,361 |
| 2026 | Files: 2 | Bytes: 3,042,412 |
| Verdict | PDFs |
|---|---|
| Text | PDFs: 3 |
| Manifest line | Type | Bytes | Characters | Upload year | Upload month | Also in the office store | Text layer | Pages | Re-hash verified |
|---|---|---|---|---|---|---|---|---|---|
| 554 | Type: pdf |
| Source | Publisher | Unit | Caveat |
|---|---|---|---|
| Government untruncated corpus harvest (stored copies, gap row A3) | Publisher: Issuing ministries, departments, divisions and boards of the Government of Bangladesh (stored copies) | Unit: one row per stored PDF document: manifest line, URL, sha256 at fetch, bytes, chars, issuing agency, portal host, upload year/month, registry entity binding, overlap with the stored files from government portals; source file is relative to the corpus root | Caveat: All 4,049 documents are full PDF publications; 241 match SHA-256 hashes of the stored files from government portals (BRN46). Agency assignment is verified against exact registry entities. sha256 verified is set only for re-hashed files (the 400 deterministic random sample and the pilot); the rest carry the harvest sha256. |
phones_detected), never stored.| Characters: 442,299 |
| Upload year: 2024 |
| Upload month: 12 |
| Also in the office store: no |
| Text layer: not available |
| Pages: not available |
| Re-hash verified: not available |
| 840 | Type: pdf | Bytes: 9,481,133 | Characters: 578,495 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 952 | Type: pdf | Bytes: 8,956,855 | Characters: 494,657 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,096 | Type: pdf | Bytes: 311,124 | Characters: 66,892 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,418 | Type: pdf | Bytes: 10,309,946 | Characters: 109,123 | Upload year: not available | Upload month: not available | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,525 | Type: pdf | Bytes: 710,991 | Characters: 122,047 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,744 | Type: pdf | Bytes: 1,746,513 | Characters: 37,621 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 1,929 | Type: pdf | Bytes: 8,834,909 | Characters: 398,414 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: Text | Pages: 201 | Re-hash verified: yes |
| 1,936 | Type: pdf | Bytes: 1,300,064 | Characters: 71,245 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,217 | Type: pdf | Bytes: 9,348,388 | Characters: 941,910 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,431 | Type: pdf | Bytes: 7,560,165 | Characters: 88,980 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,512 | Type: pdf | Bytes: 1,447,708 | Characters: 71,662 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,591 | Type: pdf | Bytes: 1,746,513 | Characters: 37,621 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,692 | Type: pdf | Bytes: 2,123,293 | Characters: 143,088 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,735 | Type: pdf | Bytes: 10,409,182 | Characters: 317,549 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,786 | Type: pdf | Bytes: 435,134 | Characters: 82,615 | Upload year: 2026 | Upload month: 7 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,806 | Type: pdf | Bytes: 1,781,621 | Characters: 81,921 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: Text | Pages: 62 | Re-hash verified: yes |
| 2,807 | Type: pdf | Bytes: 4,845,707 | Characters: 391,179 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,816 | Type: pdf | Bytes: 2,607,278 | Characters: 73,001 | Upload year: 2026 | Upload month: 3 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 2,947 | Type: pdf | Bytes: 412,069 | Characters: 89,725 | Upload year: not available | Upload month: not available | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 3,089 | Type: pdf | Bytes: 75,081,206 | Characters: 369,699 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 3,102 | Type: pdf | Bytes: 10,409,182 | Characters: 317,549 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: Text | Pages: 136 | Re-hash verified: yes |
| 3,326 | Type: pdf | Bytes: 582,576 | Characters: 89,640 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 3,352 | Type: pdf | Bytes: 11,727,295 | Characters: 441,955 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 3,656 | Type: pdf | Bytes: 1,781,621 | Characters: 81,921 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 3,695 | Type: pdf | Bytes: 10,273,669 | Characters: 337,962 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 3,728 | Type: pdf | Bytes: 18,585,388 | Characters: 1,076,492 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 3,782 | Type: pdf | Bytes: 14,180,002 | Characters: 237,108 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 3,805 | Type: pdf | Bytes: 505,181 | Characters: 62,027 | Upload year: 2024 | Upload month: 12 | Also in the office store: yes | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 4,027 | Type: pdf | Bytes: 4,203,155 | Characters: 378,576 | Upload year: 2024 | Upload month: 12 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| Per-issuing-agency manifest datasets | Publisher: Built from the rows above by the inventory pipeline | Unit: one row per issuing agency, with its partition file, sha256, file counts, and text layer counts | Caveat: Each agency's inventory partition is the resumable unit of the pipeline; a rerun rewrites only partitions whose rows changed. |
| 200-chunk pilot: documents and chunks with printed fields across 14 agencies | Publisher: each document's stored PDF (PyMuPDF text layer) | Unit: one row per pilot document (fields with page and line) and per chunk (page range, counts, text sha256) | Caveat: Pilot documents were chosen to maximize agency diversity across text-layer candidates, chunked in consecutive page blocks up to 4,000 characters, hitting exactly 200 chunks total. Documents with personal data (CVs, data sheets, rosters, beneficiary lists, or >=2 mobile phone numbers on pages 1-2) are screened out before chunking. Phone numbers are never stored in any parquet or served payload. |
| Pipeline run log (measured) | Publisher: Measured pipeline runs on a 16-core machine | Unit: one row per stage run: items, bytes, seconds, workers | Caveat: Runs over files a previous run had read hit the page cache and overstate the rate; the projection uses the cold runs named in its basis. |