Government publications by agency. Part of what the twin can answer. Every figure below is the value the route serves, with its source; the raw response is at /api/twin/brain/govfull/agency/bb.
Descriptive, sourced: no model
Basis: sourced records (URL, sha256 or locator per row), no model.
stored files, documents and chunks, and counts over them
| Verdict | PDFs |
|---|---|
| Text | PDFs: 41 |
| Legacy bangla | PDFs: 7 |
| Undecodable | PDFs: 1 |
| Manifest line | Type | Bytes | Characters | Also in the office store | Text layer | Pages | Re-hash verified |
|---|---|---|---|---|---|---|---|
| 15 | Type: pdf | Bytes: 3,181,004 |
| Pages | Chunks | Printed kind | Page | Line |
|---|---|---|---|---|
| 19 | Chunks: 16 | Printed kind: Quarterly Report | Page: 1 | Line: 5 |
Not held: Printed domain, Page, Line, Printed date, Page, Line, Printed memo, Page, Line.
| First page | Last page | Characters | Lines | Numeric tokens | Bangla share |
|---|---|---|---|---|---|
| 1 | Last page: 3 | Characters: 3,817 | Lines: 155 |
| Source | Publisher | Unit | Caveat |
|---|---|---|---|
| Government untruncated corpus harvest (stored copies, gap row A3) | Publisher: Issuing ministries, departments, divisions and boards of the Government of Bangladesh (stored copies) | Unit: one row per stored PDF document: manifest line, URL, sha256 at fetch, bytes, chars, issuing agency, portal host, upload year/month, registry entity binding, overlap with the stored files from government portals; source file is relative to the corpus root | Caveat: All 4,049 documents are full PDF publications; 241 match SHA-256 hashes of the stored files from government portals (BRN46). Agency assignment is verified against exact registry entities. sha256 verified is set only for re-hashed files (the 400 deterministic random sample and the pilot); the rest carry the harvest sha256. |
phones_detected), never stored.| Also in the office store: no |
| Text layer: not available |
| Pages: not available |
| Re-hash verified: not available |
| 18 | Type: pdf | Bytes: 798,867 | Characters: 62,363 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 19 | Type: pdf | Bytes: 1,952,021 | Characters: 299,585 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 29 | Type: pdf | Bytes: 1,270,349 | Characters: 61,175 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 40 | Type: pdf | Bytes: 1,941,377 | Characters: 80,832 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 41 | Type: pdf | Bytes: 1,965,850 | Characters: 86,134 | Also in the office store: no | Text layer: Legacy bangla | Pages: 20 | Re-hash verified: yes |
| 44 | Type: pdf | Bytes: 470,306 | Characters: 71,139 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 45 | Type: pdf | Bytes: 127,190 | Characters: 69,368 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 49 | Type: pdf | Bytes: 769,048 | Characters: 89,718 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 50 | Type: pdf | Bytes: 389,642 | Characters: 80,929 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 57 | Type: pdf | Bytes: 655,411 | Characters: 242,930 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 58 | Type: pdf | Bytes: 5,136,283 | Characters: 126,853 | Also in the office store: no | Text layer: Legacy bangla | Pages: 24 | Re-hash verified: yes |
| 63 | Type: pdf | Bytes: 9,244,944 | Characters: 368,303 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 68 | Type: pdf | Bytes: 2,218,410 | Characters: 429,762 | Also in the office store: no | Text layer: Text | Pages: 141 | Re-hash verified: yes |
| 73 | Type: pdf | Bytes: 1,903,739 | Characters: 86,241 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 77 | Type: pdf | Bytes: 1,364,462 | Characters: 62,091 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 97 | Type: pdf | Bytes: 2,452,997 | Characters: 647,406 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 113 | Type: pdf | Bytes: 2,645,113 | Characters: 108,473 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 128 | Type: pdf | Bytes: 2,531,884 | Characters: 759,697 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 131 | Type: pdf | Bytes: 3,967,398 | Characters: 254,519 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 132 | Type: pdf | Bytes: 1,885,766 | Characters: 125,369 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 134 | Type: pdf | Bytes: 1,060,427 | Characters: 368,410 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 141 | Type: pdf | Bytes: 557,103 | Characters: 287,429 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 142 | Type: pdf | Bytes: 123,351 | Characters: 91,118 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 144 | Type: pdf | Bytes: 1,898,566 | Characters: 79,536 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 147 | Type: pdf | Bytes: 10,776,087 | Characters: 686,628 | Also in the office store: no | Text layer: Text | Pages: 183 | Re-hash verified: yes |
| 148 | Type: pdf | Bytes: 2,558,713 | Characters: 90,320 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 149 | Type: pdf | Bytes: 274,701 | Characters: 89,288 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 150 | Type: pdf | Bytes: 1,693,213 | Characters: 60,874 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 152 | Type: pdf | Bytes: 864,099 | Characters: 69,800 | Also in the office store: no | Text layer: Text | Pages: 19 | Re-hash verified: yes |
| 159 | Type: pdf | Bytes: 1,630,202 | Characters: 288,760 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 171 | Type: pdf | Bytes: 936,620 | Characters: 223,219 | Also in the office store: no | Text layer: Text | Pages: 25 | Re-hash verified: yes |
| 173 | Type: pdf | Bytes: 10,099,401 | Characters: 1,827,088 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 176 | Type: pdf | Bytes: 585,593 | Characters: 234,805 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 199 | Type: pdf | Bytes: 19,050,136 | Characters: 103,280 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 200 | Type: pdf | Bytes: 305,051 | Characters: 113,957 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 205 | Type: pdf | Bytes: 13,831,141 | Characters: 1,880,099 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 208 | Type: pdf | Bytes: 846,095 | Characters: 211,462 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 214 | Type: pdf | Bytes: 1,757,909 | Characters: 268,335 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 218 | Type: pdf | Bytes: 327,140 | Characters: 256,443 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 225 | Type: pdf | Bytes: 1,825,314 | Characters: 291,897 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 229 | Type: pdf | Bytes: 8,341,447 | Characters: 264,804 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 232 | Type: pdf | Bytes: 309,500 | Characters: 80,145 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 234 | Type: pdf | Bytes: 6,533,895 | Characters: 112,173 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 249 | Type: pdf | Bytes: 14,171,280 | Characters: 262,063 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 253 | Type: pdf | Bytes: 9,037,288 | Characters: 282,293 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 263 | Type: pdf | Bytes: 1,053,189 | Characters: 340,598 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 264 | Type: pdf | Bytes: 2,953,414 | Characters: 250,647 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 266 | Type: pdf | Bytes: 1,358,205 | Characters: 88,882 | Also in the office store: no | Text layer: not available | Pages: not available | Re-hash verified: not available |
| 272 | Type: pdf | Bytes: 1,767,952 | Characters: 83,210 | Also in the office store: no | Text layer: Text | Pages: 24 | Re-hash verified: yes |
Not held: Upload year, Upload month.
| Bangla share: 0% |
| 4 | Last page: 4 | Characters: 5,174 | Lines: 42 | Numeric tokens: 68 | Bangla share: 0% |
| 5 | Last page: 5 | Characters: 2,700 | Lines: 166 | Numeric tokens: 81 | Bangla share: 0% |
| 6 | Last page: 6 | Characters: 2,291 | Lines: 75 | Numeric tokens: 56 | Bangla share: 0% |
| 7 | Last page: 7 | Characters: 2,324 | Lines: 104 | Numeric tokens: 63 | Bangla share: 0% |
| 8 | Last page: 8 | Characters: 2,084 | Lines: 104 | Numeric tokens: 59 | Bangla share: 0% |
| 9 | Last page: 9 | Characters: 2,108 | Lines: 122 | Numeric tokens: 85 | Bangla share: 0% |
| 10 | Last page: 10 | Characters: 1,972 | Lines: 100 | Numeric tokens: 42 | Bangla share: 0% |
| 11 | Last page: 11 | Characters: 2,088 | Lines: 106 | Numeric tokens: 56 | Bangla share: 0% |
| 12 | Last page: 12 | Characters: 2,511 | Lines: 32 | Numeric tokens: 24 | Bangla share: 0% |
| 13 | Last page: 13 | Characters: 2,189 | Lines: 51 | Numeric tokens: 35 | Bangla share: 0% |
| 14 | Last page: 15 | Characters: 3,983 | Lines: 97 | Numeric tokens: 75 | Bangla share: 0% |
| 16 | Last page: 16 | Characters: 2,211 | Lines: 32 | Numeric tokens: 30 | Bangla share: 0% |
| 17 | Last page: 17 | Characters: 2,370 | Lines: 97 | Numeric tokens: 69 | Bangla share: 0% |
| 18 | Last page: 18 | Characters: 2,313 | Lines: 35 | Numeric tokens: 6 | Bangla share: 0% |
| 19 | Last page: 19 | Characters: 3,490 | Lines: 316 | Numeric tokens: 280 | Bangla share: 0% |
| Per-issuing-agency manifest datasets | Publisher: Built from the rows above by the inventory pipeline | Unit: one row per issuing agency, with its partition file, sha256, file counts, and text layer counts | Caveat: Each agency's inventory partition is the resumable unit of the pipeline; a rerun rewrites only partitions whose rows changed. |
| 200-chunk pilot: documents and chunks with printed fields across 14 agencies | Publisher: each document's stored PDF (PyMuPDF text layer) | Unit: one row per pilot document (fields with page and line) and per chunk (page range, counts, text sha256) | Caveat: Pilot documents were chosen to maximize agency diversity across text-layer candidates, chunked in consecutive page blocks up to 4,000 characters, hitting exactly 200 chunks total. Documents with personal data (CVs, data sheets, rosters, beneficiary lists, or >=2 mobile phone numbers on pages 1-2) are screened out before chunking. Phone numbers are never stored in any parquet or served payload. |
| Pipeline run log (measured) | Publisher: Measured pipeline runs on a 16-core machine | Unit: one row per stage run: items, bytes, seconds, workers | Caveat: Runs over files a previous run had read hit the page cache and overstate the rate; the projection uses the cold runs named in its basis. |